Near lossless source coding with side information at the decoder: Beyond conditional entropy

In near lossless source coding with decoder only side information, i.e., Slepian-Wolf coding (with one encoder), a source X with finite alphabet X is first encoded, and then later decoded subject to a small error probability with the help of side information Y with finite alphabet Y available only t...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:2008 Information Theory and Applications Workshop S. 454 - 460
Hauptverfasser: En-hui Yang, Da-ke He
Format: Tagungsbericht
Sprache:Englisch
Veröffentlicht: IEEE 01.01.2008
Schlagworte:
Decoding
Encoding
Entropy
Error probability
Maximum likelihood decoding
Probability distribution
Source coding
ISBN:9781424426706, 1424426707
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:In near lossless source coding with decoder only side information, i.e., Slepian-Wolf coding (with one encoder), a source X with finite alphabet X is first encoded, and then later decoded subject to a small error probability with the help of side information Y with finite alphabet Y available only to the decoder. The classical result by Slepian and Wolf shows that the minimum average compression rate achievable asymptotically subject to a small error probability constraint for a memoryless pair (X , Y) is given by the conditional entropy H(X|Y). In this paper, we look beyond conditional entropy and investigate the tradeoff between compression rate and decoding error spectrum in Slepian-Wolf coding when the decoding error probability goes to zero exponentially fast. It is shown that when the decoding error probability goes to zero at the speed of 2 -deltan , where delta is a positive constant and n denotes the source sequences' length, the minimum average compression rate achievable asymptotically is strictly greater than H(X|Y) regardless of how small delta is. More specifically, the minimum average compression rate achievable asymptotically is lower bounded by a quantity called the intrinsic conditional entropy H in (X|Y, delta), which is strictly greater than H(X|Y), and is also asymptotically achievable for small delta.
ISBN:9781424426706
1424426707
DOI:10.1109/ITA.2008.4601089