Engineering a Lightweight Deep Joint Source-Channel-Coding-Based Semantic Communication System

Deep joint source-channel coding (DeepJSCC) has emerged as a novel technology in semantic communication, coinciding with the increasing demand for the edge devices in the Internet of Things (IoT). Consequently, the deployment of DeepJSCC on edge devices has become a crucial research direction. Howev...

Full description

Saved in:
Bibliographic Details
Published in:IEEE internet of things journal Vol. 12; no. 1; pp. 458 - 471
Main Authors: Zhang, Weihan, Wu, Shaohua, Meng, Siqi, He, Jinghang, Zhang, Qinyu
Format: Journal Article
Language:English
Published: Piscataway IEEE 01.01.2025
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:
Algorithms
Coding
Communications systems
Compatibility
Deep joint source-channel coding (DeepJSCC)
Devices
Digital systems
edge devices
Ensemble learning
Fading
Image reconstruction
Internet of Things
Internet of Things (IoT)
Lightweight
lightweight model
Mathematical models
quantization
Quantization (signal)
Rician channels
Rician fading channel
Semantics
Signal to noise ratio
Training
Weight reduction
ISSN:2327-4662, 2327-4662
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Deep joint source-channel coding (DeepJSCC) has emerged as a novel technology in semantic communication, coinciding with the increasing demand for the edge devices in the Internet of Things (IoT). Consequently, the deployment of DeepJSCC on edge devices has become a crucial research direction. However, DeepJSCC faces challenges related to channel fading. Moreover, implementing DeepJSCC on the edge devices poses challenges due to the constrained computational resources as well as the compatibility issue between DeepJSCC and digital systems. In this article, we devote to engineering the DeepJSCC system deployed on the edge devices. First, we propose a method named DeepJSCC with Ensemble learning (DeepJSCC-ES) to resist the channel fading. Then, we present a pruning algorithm called the DeepJSCC signal-to-noise ratio (SNR)-adaptive pruning method (DJSAP) to make the DeepJSCC network lightweight, reducing the computational demands on the edge nodes. Further, we propose a method called the simulated fixed-point quantization training based on soft quantization function (SFPQSQ) to tackle the compatibility issue between DeepJSCC and digital systems. Finally, we deploy the whole DeepJSCC system on the edge devices and conduct experiments to test the DeepJSCC system. The results of simulations show that the proposed DeepJSCC-ES system outperforms the baseline DeepJSCC, particularly excelling in low SNR conditions. Furthermore, the parameter size of the pruned model using DJSAP is compressed by 93.37% while the average structural similarity index metric (SSIM) decreases only by 0.92% compared with the baseline DeepJSCC. Additionally, the SFPQSQ works better than the ordinary quantization methods in tackling the compatibility issue between DeepJSCC and digital systems. The experiment results also show that our proposed system can serve as a feasible solution for practical deployment on the edge devices.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:2327-4662
2327-4662
DOI:10.1109/JIOT.2024.3463652