Digital Communications and Networks · 2022 · 23 citations · 17 references
ComputingCommunicationComputer ScienceDigital CommunicationNatural Language ProcessingSemanticsInformation ExtractionNatural Language UnderstandingSemantic ProcessingSentence ProcessingContextContext ExtractionContext RepresentationContext-aware CommunicationContextual EncodingSemantic AccuracySemantic InformationSemantic Knowledge Representation
Context information is significant for semantic extraction and recovery of messages in semantic communication. However, context information is not fully utilized in the existing semantic communication systems since relationships between sentences are often ignored. In this paper, we propose an extended context-based semantic communication (ECSC) system for text transmission, in which context information within and between sentences are explored for semantic representation and recovery. At the encoder, self-attention and segment-level relative attention are used to extract context information within and between sentences, respectively. In addition, a gate mechanism is adopted at the encoder to incorporate the context information from different ranges. At the decoder, Transformer-XL is introduced to obtain more semantic information from the historical communication processes for semantic recovery. Simulation results show the effectiveness of our proposed model in improving the semantic accuracy between transmitted and recovered messages under various channel conditions.
17
Deep Learning Enabled Semantic Communication Systems
Huiqiang Xie, Zhijin Qin, Geoffrey Ye Li et al. · IEEE Transactions on Signal Processing · 2021 · 1.3K citations · Full text
Gabriel Murray, Steve Renals, Jean Carletta et al. · Meeting of the Association for Computational Linguistics · 2005 · 719 citations