Low-Delay Analog Joint Source-Channel Coding with Deep Learning

We consider the design of low-delay joint source-channel coding (JSCC) schemes for the transmission of discrete-time analog sources over noisy channels based on deep neural networks. The design problem is addressed as optimization of an autoencoder model, and several scenarios are discussed. For poi...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on communications Vol. 71; no. 1; p. 1
Main Authors: Xuan, Ziwei, Narayanan, Krishna
Format: Journal Article
Language:English
Published: New York IEEE 01.01.2023
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:
Artificial neural networks
AWGN channels
Channels
Coders
Coding
Communication
Decoding
Deep learning
Design optimization
Distortion
distributed source-channel coding
Joint source-channel coding
Machine learning
Neural networks
Noise measurement
Random noise
Receivers
Recurrent neural networks
RNNs
SIRENs
Training
Transmission
ISSN:0090-6778, 1558-0857
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We consider the design of low-delay joint source-channel coding (JSCC) schemes for the transmission of discrete-time analog sources over noisy channels based on deep neural networks. The design problem is addressed as optimization of an autoencoder model, and several scenarios are discussed. For point-to-point communication of independent and identically distributed (i.i.d) Gaussian sources and Gauss-Markov sources over additive-white Gaussian noise (AWGN) channels, the encoder and decoder are constructed using recurrent neural networks (RNNs). With minimum prior knowledge used for design, the performance of these RNNs-based models is optimized using fine tuning techniques during training. Sinusoidal representation networks (SIRENs)-based models are proposed and optimized for three JSCC problems namely, transmitting multivariate Gaussian sources over AWGN channels, transmitting i.i.d Gaussian sources with side information at the decoder, and for communicating correlated sources over orthogonal Gaussian channels. We show that these deep learning-based JSCC schemes perform comparably or better than state-of-the-art (SOTA) traditional schemes. The proposed scheme can extend flexibly to different pairs of source and channel dimensions. Moreover, the spontaneously learned encoder mappings exhibit structured patterns that are interpretable.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:0090-6778
1558-0857
DOI:10.1109/TCOMM.2022.3222874