Lightweight Joint Source-Channel Coding for Semantic Communications

Semantic communications, which aim to effectively convey the meaning of messages (such as text and images) rather than transmitting the exact messages themselves, have garnered widespread attention from industry and academia. A suitable joint source-channel coding (JSCC) scheme is crucial for semant...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:IEEE communications letters Ročník 27; číslo 12; s. 1
Hlavní autori: Jia, Yunjian, Huang, Zhen, Luo, Kun, Wen, Wanli
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: New York IEEE 01.12.2023
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Predmet:
Artificial neural networks
Coding
Communication
Communications systems
Decoding
deep neural network
joint source-channel coding
Lightweight
Mathematical models
Messages
Neural networks
Parameters
Receivers
Reliability
Semantic communications
Semantics
Transformer
Transformers
Transmitters
ISSN:1089-7798, 1558-2558
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:Semantic communications, which aim to effectively convey the meaning of messages (such as text and images) rather than transmitting the exact messages themselves, have garnered widespread attention from industry and academia. A suitable joint source-channel coding (JSCC) scheme is crucial for semantic communication systems, as it can significantly improve system performance, such as communication reliability. Current research efforts primarily focus on employing various deep neural network (DNN) models, particularly the Transformer model, to design JSCC schemes. However, existing Transformer-based JSCC schemes usually exhibit a considerable number of model parameters and computational demands, limiting their real-world applicability. To address this challenge, we propose a novel DNN model based on DeLighT, a deep and lightweight variant of the standard Transformer, using a text semantic communication system (TSC) as an example. This proposed model enables a lightweight JSCC scheme for the TSC system. Through simulation results, we demonstrate that the proposed JSCC scheme achieves comparable or better communication reliability than the Transformer-based JSCC scheme while requiring significantly fewer parameters and smaller runtime.
Bibliografia:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1089-7798
1558-2558
DOI:10.1109/LCOMM.2023.3329533