Near lossless source coding with side information at the decoder: Beyond conditional entropy

In near lossless source coding with decoder only side information, i.e., Slepian-Wolf coding (with one encoder), a source X with finite alphabet X is first encoded, and then later decoded subject to a small error probability with the help of side information Y with finite alphabet Y available only t...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:2008 Information Theory and Applications Workshop s. 454 - 460
Hlavní autori: En-hui Yang, Da-ke He
Médium: Konferenčný príspevok..
Jazyk:English
Vydavateľské údaje: IEEE 01.01.2008
Predmet:
Decoding
Encoding
Entropy
Error probability
Maximum likelihood decoding
Probability distribution
Source coding
ISBN:9781424426706, 1424426707
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:In near lossless source coding with decoder only side information, i.e., Slepian-Wolf coding (with one encoder), a source X with finite alphabet X is first encoded, and then later decoded subject to a small error probability with the help of side information Y with finite alphabet Y available only to the decoder. The classical result by Slepian and Wolf shows that the minimum average compression rate achievable asymptotically subject to a small error probability constraint for a memoryless pair (X , Y) is given by the conditional entropy H(X|Y). In this paper, we look beyond conditional entropy and investigate the tradeoff between compression rate and decoding error spectrum in Slepian-Wolf coding when the decoding error probability goes to zero exponentially fast. It is shown that when the decoding error probability goes to zero at the speed of 2 -deltan , where delta is a positive constant and n denotes the source sequences' length, the minimum average compression rate achievable asymptotically is strictly greater than H(X|Y) regardless of how small delta is. More specifically, the minimum average compression rate achievable asymptotically is lower bounded by a quantity called the intrinsic conditional entropy H in (X|Y, delta), which is strictly greater than H(X|Y), and is also asymptotically achievable for small delta.
ISBN:9781424426706
1424426707
DOI:10.1109/ITA.2008.4601089