Analog Joint Source-Channel Coding for Distributed Functional Compression using Deep Neural Networks

In this paper, we study Joint Source-Channel Coding (JSCC) for distributed analog functional compression over both Gaussian Multiple Access Channel (MAC) and AWGN channels. Notably, we propose a deep neural network based solution for learning encoders and decoders. We propose three methods of increa...

Full description

Saved in:
Bibliographic Details
Published in:2021 IEEE International Symposium on Information Theory (ISIT) pp. 2429 - 2434
Main Authors: Saidutta, Yashas Malur, Abdi, Afshin, Fekri, Faramarz
Format: Conference Proceeding
Language:English
Published: IEEE 12.07.2021
Subjects:
AWGN channels
Deep learning
Image coding
Minimization
Rate-distortion
Training
Upper bound
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper, we study Joint Source-Channel Coding (JSCC) for distributed analog functional compression over both Gaussian Multiple Access Channel (MAC) and AWGN channels. Notably, we propose a deep neural network based solution for learning encoders and decoders. We propose three methods of increasing performance. The first one frames the problem as an autoencoder; the second one incorporates the power constraint in the objective by using a Lagrange multiplier; the third method derives the objective from the information bottleneck principle. We show that all proposed methods are variational approximations to upper bounds on the indirect rate-distortion problem's minimization objective. Further, we show that the third method is the variational approximation of a tighter upper bound compared to the other two. Finally, we show empirical performance results for image classification. We compare with existing work and showcase the performance improvement yielded by the proposed methods.
DOI:10.1109/ISIT45174.2021.9517797