IEEE Network · 2023 · 10 citations · 9 references
ComputingCommunicationComputer ScienceComputer VisionMachine LearningNatural Language ProcessingDeep LearningMulti-task LearningScene UnderstandingSemantic NetworksTask ParallelismCommunication Overhead ReductionContrastive LearningMulti-task Deep LearningMulti-task Neural NetworksMultitask LearningSemantic InformationSemantic Knowledge RepresentationTraining Time
Semantic communication has sparked great interest, due to the rising demands of emerging applications on high communication capacity and low latency. The majority of existing semantic communication methods are task-oriented, which transmit task-related semantic information via synchronous trained deep learning-based (DL-based) encoders and decoders. However, these methods have limitations in handling multi-task communications. Moreover, the synchronous training paradigm also leads to significant communication overhead in the establishing phase. In this article, we propose an asynchronous multi-task semantic communication method. In the proposed method, the DL-based encoder is trained independently using a contrastive learning method to extract task-independent semantic knowledge. Then, the receiver trains different DL-based decoders to perform various communication tasks based on the pre-trained encoder. Our method enables the accomplishment of multiple communication tasks in a single transmission. Moreover, the asynchronous training paradigm can reduce the communication overhead during the training phase of our system. The experimental results demonstrate that the proposed method achieves state-of-the-art performance in image classification and reconstruction tasks while requiring less than 10% of the training communication time compared to existing semantic communication systems.
9
Exploring Simple Siamese Representation Learning
Xinlei Chen, Kaiming He · 2021 · 3.3K citations
Deep Learning Enabled Semantic Communication Systems
Huiqiang Xie, Zhijin Qin, Geoffrey Ye Li et al. · IEEE Transactions on Signal Processing · 2021 · 1.3K citations · Full text
Resource Allocation for Text Semantic Communications
Lei Yan, Zhijin Qin, Rui Zhang et al. · IEEE Wireless Communications Letters · 2022 · 272 citations · Full text