Smoothing Brascamp-Lieb Inequalities and Strong Converses of Coding Theorems

The Brascamp-Lieb inequality in functional analysis can be viewed as a measure of the "uncorrelatedness" of a joint probability distribution. We define the smooth Brascamp-Lieb (BL) divergence as the infimum of the best constant in the Brascamp-Lieb inequality under a perturbation of the j...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:IEEE transactions on information theory Ročník 66; číslo 2; s. 704 - 721
Hlavní autoři: Liu, Jingbo, Courtade, Thomas A., Cuff, Paul, Verdu, Sergio
Médium: Journal Article
Jazyk:angličtina
Vydáno: New York IEEE 01.02.2020
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Témata:
Brascamp-Lieb inequality
Channel coding
Codes
Coding
coding theorems
common randomness
Divergence
Entropy
finite blocklength
Functional analysis
Gray-Wyner network
hypercontractivity
Inequality
Infimum
Perturbation
Probability distribution
Random variables
Shannon theory
Smoothing methods
strong converse
Upper bounds
ISSN:0018-9448, 1557-9654
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:The Brascamp-Lieb inequality in functional analysis can be viewed as a measure of the "uncorrelatedness" of a joint probability distribution. We define the smooth Brascamp-Lieb (BL) divergence as the infimum of the best constant in the Brascamp-Lieb inequality under a perturbation of the joint probability distribution. An information spectrum upper bound on the smooth BL divergence is proved, using properties of the subgradient of a certain convex functional. In particular, in the i.i.d. setting, such an infimum converges to the best constant in a certain mutual information inequality. We then derive new single-shot converse bounds for the omniscient helper common randomness generation problem and the Gray-Wyner source coding problem in terms of the smooth BL divergence, where the proof relies on the functional formulation of the Brascamp-Lieb inequality. Exact second-order rates are thus obtained in the stationary memoryless and nonvanishing error setting. These offer rare instances of strong converses/second-order converses for continuous sources when the rate region involves auxiliary random variables.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:0018-9448
1557-9654
DOI:10.1109/TIT.2019.2953151