Extended Gray-Wyner System With Complementary Causal Side Information

We establish the rate region of an extended Gray-Wyner system (EGW) for 2-DMS <inline-formula> <tex-math notation="LaTeX">(X,Y) </tex-math></inline-formula> with two additional decoders having complementary causal side information. We show that the 5-D rate region o...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on information theory Jg. 64; H. 8; S. 5862 - 5878
Hauptverfasser: Li, Cheuk Ting, El Gamal, Abbas
Format: Journal Article
Sprache:Englisch
Veröffentlicht: New York IEEE 01.08.2018
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Schlagworte:
Codes
Coding
Communication channels
complementary delivery
Decoders
Decoding
Entropy
Gray–Wyner system
Indexes
Körner graph entropy
Mutual information
Privacy
privacy funnel
Random variables
side information
Source coding
ISSN:0018-9448, 1557-9654
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:We establish the rate region of an extended Gray-Wyner system (EGW) for 2-DMS <inline-formula> <tex-math notation="LaTeX">(X,Y) </tex-math></inline-formula> with two additional decoders having complementary causal side information. We show that the 5-D rate region of the EGW system is equivalent to the 3-D mutual information region consisting of the set of all triples of the form <inline-formula> <tex-math notation="LaTeX">(I(X;U),\,I(Y;U),\,I(X,Y;U)) </tex-math></inline-formula> for some <inline-formula> <tex-math notation="LaTeX">p_{U|X,Y} </tex-math></inline-formula>. This correspondence greatly simplifies the exploration of the the extreme points of the rate region. In addition to the operationally significant extreme points of the original Gray-Wyner rate region, which include Wyner's common information, Gács-Körner common information, and the information bottleneck, the extreme points of the rate region for the EGW system also include the Körner graph entropy, the privacy funnel and excess functional information, as well as three new quantities of potential interest. We further show that projections of the mutual information region yield the rate regions for many settings involving a two discrete memoryless source (2-DMS), including lossless source coding with causal side information, distributed channel synthesis, and lossless source coding with a helper. To further motivate the mutual information region itself, we draw analogies between set operations and its extreme points. This allows us to find random variables that can be considered as intersection, difference, and symmetric difference of two random variables. Finally, we establish the rate regions for two related setups to the EGW system, namely, the noncausal EGW system and the lossy EGW system.
Bibliographie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:0018-9448
1557-9654
DOI:10.1109/TIT.2017.2787182