Polarized Dropout: A Novel Deep Joint Source Channel Coding Scheme for Erasure Channels

This letter investigates the challenges encountered by deep joint source-channel coding in erasure channels. We explore the effectiveness of the widely adopted dropout technique in endowing deep neural networks with resilience against erasures. However, directly applying dropout at the channel layer...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE communications letters Jg. 28; H. 9; S. 1986 - 1990
Hauptverfasser: Ren, Zichang, Wang, Yiru, Zhao, Yuping
Format: Journal Article
Sprache:Englisch
Veröffentlicht: New York IEEE 01.09.2024
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Schlagworte:
Artificial neural networks
Channels
Coding
Decoding
deep learning
erasure channel
Joint source-channel coding
Number theory
Performance degradation
polar code
Receivers
Symbols
Training
Transfer functions
Transforms
Vectors
ISSN:1089-7798, 1558-2558
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:This letter investigates the challenges encountered by deep joint source-channel coding in erasure channels. We explore the effectiveness of the widely adopted dropout technique in endowing deep neural networks with resilience against erasures. However, directly applying dropout at the channel layer introduces uncertainty into the neural network's training process, leading to performance degradation. To address this issue, we introduce the Polarized Dropout scheme and a novel network architecture that encodes analog symbols using the Walsh-Hadamard transform based on real-number field computation. Leveraging the polarization of symbol recovery probabilities, for a given erasure rate, a determined set of neurons will be assigned a dropout rate of 1, while the remainder are assigned a dropout rate of 0. Simulation results indicate a maximum enhancement of nearly 6dB in communication performance.
Bibliographie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1089-7798
1558-2558
DOI:10.1109/LCOMM.2024.3422176