Greedy additive approximation algorithms for minimum-entropy coupling problem

Given two probability distributions p = (p 1 ,p 2 ,...,p n ) and q = (q 1 ,q 2 ,...,q m ) of two discrete random variables X and Y respectively, the minimum-entropy coupling problem is to find the minimum-entropy joint distribution among all possible joint distributions of X and Y having p and q as...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Proceedings / IEEE International Symposium on Information Theory s. 1127 - 1131
Hlavní autor: Rossi, Massimiliano
Médium: Konferenční příspěvek
Jazyk:angličtina
Vydáno: IEEE 01.07.2019
Témata:
Additives
Approximation algorithms
Couplings
Entropy
Greedy algorithms
Probability distribution
Random variables
ISSN:2157-8117
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Given two probability distributions p = (p 1 ,p 2 ,...,p n ) and q = (q 1 ,q 2 ,...,q m ) of two discrete random variables X and Y respectively, the minimum-entropy coupling problem is to find the minimum-entropy joint distribution among all possible joint distributions of X and Y having p and q as marginals. This problem is known to be NP-hard and recently have been proposed greedy algorithms that provide different guarantees, i.e. solutions that are local minimum [Kocaoglu et al. AAAI'17] and 1-bit approximation [Cicalese et al. ISIT'17]. In this paper, we show that the algorithm proposed by Kocaoglu et al. provides, in addition, a 1-bit approximation guarantee in the case of 2 variables. Then, we provide a general criteria for guaranteeing an additive approximation factor of 1 that might be of independent interest in other contexts where couplings are used.
ISSN:2157-8117
DOI:10.1109/ISIT.2019.8849717