IEEE Journal on Selected Areas in Communications · 2022 · 634 citations · 245 references
EngineeringComputer EngineeringComputer ScienceCommunication TheoryComputer ArchitectureInformation TheoryCommunication SystemsContext-aware ComputingInterprocess CommunicationAlgorithmic Information TheoryCommunication EncodingCommunication PrimitivesCommunication SemanticsContext RepresentationContext-aware CommunicationMessage ExchangeSend-receive Semantics
Current communication systems focus on reliably transmitting bit sequences, ignoring message meanings or communication goals. The authors propose that next‑generation systems should embed message semantics, goals, and contextual awareness into their design. This tutorial reviews semantic‑aware and task‑oriented communication approaches, emphasizing information‑theoretic foundations and the role of learning in developing algorithms and implementations.
Communication systems to date primarily aim at reliably communicating bit sequences. Such an approach provides efficient engineering designs that are agnostic to the meanings of the messages or to the goal that the message exchange aims to achieve. Next generation systems, however, can be potentially enriched by folding message semantics and goals of communication into their design. Further, these systems can be made cognizant of the context in which communication exchange takes place, thereby providing avenues for novel design insights. This tutorial summarizes the efforts to date, starting from its early adaptations, semantic-aware and task-oriented communications, covering the foundations, algorithms and potential implementations. The focus is on approaches that utilize information theory to provide the foundations, as well as the significant role of learning in semantics and task-aware communications.
245
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
A Mathematical Theory of Communication
Claude E. Shannon · Bell System Technical Journal · 1948 · 80.7K citations
Densely Connected Convolutional Networks
Gao Huang, Zhuang Liu, Laurens van der Maaten et al. · 2017 · 44.7K citations