On the Optimality of Binning for Distributed Hypothesis Testing
We study a hypothesis testing problem in which data are compressed distributively and sent to a detector that seeks to decide between two possible distributions for the data. The aim is to characterize all achievable encoding rates and exponents of the type 2 error probability when the type 1 error...
Saved in:
| Published in: | IEEE transactions on information theory Vol. 58; no. 10; pp. 6282 - 6303 |
|---|---|
| Main Authors: | , |
| Format: | Journal Article |
| Language: | English |
| Published: |
New York, NY
IEEE
01.10.2012
Institute of Electrical and Electronics Engineers The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Subjects: | |
| ISSN: | 0018-9448, 1557-9654 |
| Online Access: | Get full text |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Abstract | We study a hypothesis testing problem in which data are compressed distributively and sent to a detector that seeks to decide between two possible distributions for the data. The aim is to characterize all achievable encoding rates and exponents of the type 2 error probability when the type 1 error probability is at most a fixed value. For related problems in distributed source coding, schemes based on random binning perform well and are often optimal. For distributed hypothesis testing, however, the use of binning is hindered by the fact that the overall error probability may be dominated by errors in the binning process. We show that despite this complication, binning is optimal for a class of problems in which the goal is to "test against conditional independence." We then use this optimality result to give an outer bound for a more general class of instances of the problem. |
|---|---|
| AbstractList | We study a hypothesis testing problem in which data are compressed distributively and sent to a detector that seeks to decide between two possible distributions for the data. The aim is to characterize all achievable encoding rates and exponents of the type 2 error probability when the type 1 error probability is at most a fixed value. For related problems in distributed source coding, schemes based on random binning perform well and are often optimal. For distributed hypothesis testing, however, the use of binning is hindered by the fact that the overall error probability may be dominated by errors in the binning process. We show that despite this complication, binning is optimal for a class of problems in which the goal is to "test against conditional independence." We then use this optimality result to give an outer bound for a more general class of instances of the problem. We study a hypothesis testing problem in which data are compressed distributively and sent to a detector that seeks to decide between two possible distributions for the data. The aim is to characterize all achievable encoding rates and exponents of the type 2 error probability when the type 1 error probability is at most a fixed value. For related problems in distributed source coding, schemes based on random binning perform well and are often optimal. For distributed hypothesis testing, however, the use of binning is hindered by the fact that the overall error probability may be dominated by errors in the binning process. We show that despite this complication, binning is optimal for a class of problems in which the goal is to "test against conditional independence." We then use this optimality result to give an outer bound for a more general class of instances of the problem. [PUBLICATION ABSTRACT] |
| Author | Wagner, A. B. Rahman, M. S. |
| Author_xml | – sequence: 1 givenname: M. S. surname: Rahman fullname: Rahman, M. S. email: mr534@cornell.edu organization: Sch. of Electr. & Comput. Eng., Cornell Univ., Ithaca, NY, USA – sequence: 2 givenname: A. B. surname: Wagner fullname: Wagner, A. B. email: wagner@cornell.edu organization: Sch. of Electr. & Comput. Eng., Cornell Univ., Ithaca, NY, USA |
| BackLink | http://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&idt=26403663$$DView record in Pascal Francis |
| BookMark | eNp90DtLQzEABeAgCtbHLrhcEMHl1rxzM4nWV0HoUueQ5iYauSY1SYf-e1NaHRycQuA7J-Ecgf0QgwXgDMExQlBez6fzMYYIjzGGXEiyB0aIMdFKzug-GEGIulZS2h2Co5w_6pUyhEfgZhaa8m6b2bL4Tz34sm6ia-58CD68NS6m5t7nkvxiVWzfPK-XsersczO3uVRyAg6cHrI93Z3H4PXxYT55bl9mT9PJ7UtrCKOlJVpIqHvSS2yos71lTnfIQGkow4wy7RaUuUUvuMZdz63puF4wbgXCyAqByTG42vYuU_xa1bfVp8_GDoMONq6yQgQxLiiHsNKLP_QjrlKov1MIEskpZHijLndKZ6MHl3QwPqtlqjOktcKVEc5JdXzrTIo5J-uU8UUXH0NJ2g-1Um32V3V_tdlf7favQfgn-NP9T-R8G_HW2l_OMRNUIvINfZ2Qug |
| CODEN | IETTAW |
| CitedBy_id | crossref_primary_10_1109_TIT_2021_3091773 crossref_primary_10_1109_TIT_2020_2972348 crossref_primary_10_3390_e27040378 crossref_primary_10_1109_TIT_2018_2833626 crossref_primary_10_1109_TIT_2023_3238339 crossref_primary_10_1177_09544070251357652 crossref_primary_10_1109_TAC_2021_3102474 crossref_primary_10_1109_TPAMI_2019_2906207 crossref_primary_10_1109_TSIPN_2016_2524572 crossref_primary_10_1109_TIT_2017_2688348 crossref_primary_10_1109_TIT_2019_2897698 crossref_primary_10_3390_e21050478 crossref_primary_10_1109_TIT_2021_3073533 crossref_primary_10_3390_info12070268 crossref_primary_10_1109_TIT_2019_2953750 crossref_primary_10_1080_09349847_2024_2316916 crossref_primary_10_1109_TIT_2020_3019654 crossref_primary_10_1109_TCOMM_2018_2798659 crossref_primary_10_1109_TIT_2020_2993172 crossref_primary_10_1109_JSAC_2022_3223408 crossref_primary_10_1109_TIT_2019_2910065 crossref_primary_10_1109_TIT_2018_2837050 crossref_primary_10_1177_09544070251329660 crossref_primary_10_1109_TIT_2022_3208814 crossref_primary_10_3390_e25020304 crossref_primary_10_3390_e22060665 |
| Cites_doi | 10.1090/dimacs/066/03 10.1109/ISIT.2010.5513294 10.1109/TIT.2008.2008146 10.1109/ISIT.2009.5205595 10.1109/TIT.2008.920249 10.1109/TIT.1987.1057383 10.1109/TIT.2012.2201346 10.1109/TIT.2010.2090225 10.1109/ISIT.2009.5205873 10.1109/JSAC.2004.830888 10.1109/TSP.2010.2044249 10.1109/TIT.2011.2145570 10.1109/ISIT.2004.1365154 10.1002/j.1538-7305.1980.tb03344.x 10.1109/TIT.2008.920343 10.1109/TIT.2009.2034791 10.1109/18.641555 10.1109/TIT.2011.2162178 10.1109/TAC.1985.1103988 10.1109/TIT.2008.929944 10.1109/TIT.1981.1056281 10.1109/TIT.1973.1055037 10.1109/TIT.1986.1057194 10.1109/TIT.1982.1056524 10.1109/TIT.2009.2027519 10.1109/TIT.2008.928951 10.1109/TIT.2005.850110 10.1002/047174882X 10.1109/ISIT.1994.394874 10.1109/18.720540 10.1109/ISIT.2008.4595019 10.1109/TIT.2004.836707 |
| ContentType | Journal Article |
| Copyright | 2015 INIST-CNRS Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) Oct 2012 |
| Copyright_xml | – notice: 2015 INIST-CNRS – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) Oct 2012 |
| DBID | 97E RIA RIE AAYXX CITATION IQODW 7SC 7SP 8FD JQ2 L7M L~C L~D F28 FR3 |
| DOI | 10.1109/TIT.2012.2206793 |
| DatabaseName | IEEE All-Society Periodicals Package (ASPP) 2005–Present IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE Electronic Library (IEL) CrossRef Pascal-Francis Computer and Information Systems Abstracts Electronics & Communications Abstracts Technology Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional ANTE: Abstracts in New Technology & Engineering Engineering Research Database |
| DatabaseTitle | CrossRef Technology Research Database Computer and Information Systems Abstracts – Academic Electronics & Communications Abstracts ProQuest Computer Science Collection Computer and Information Systems Abstracts Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Professional Engineering Research Database ANTE: Abstracts in New Technology & Engineering |
| DatabaseTitleList | Technology Research Database Technology Research Database |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering Computer Science Applied Sciences |
| EISSN | 1557-9654 |
| EndPage | 6303 |
| ExternalDocumentID | 2761357091 26403663 10_1109_TIT_2012_2206793 6257491 |
| Genre | orig-research Feature |
| GroupedDBID | -~X .DC 0R~ 29I 3EH 4.4 5GY 5VS 6IK 97E AAJGR AARMG AASAJ AAWTH ABAZT ABFSI ABQJQ ABVLG ACGFO ACGFS ACGOD ACIWK AENEX AETEA AETIX AGQYO AGSQL AHBIQ AI. AIBXA AKJIK AKQYR ALLEH ALMA_UNASSIGNED_HOLDINGS ASUFR ATWAV BEFXN BFFAM BGNUA BKEBE BPEOZ CS3 DU5 E.L EBS EJD F5P HZ~ H~9 IAAWW IBMZZ ICLAB IDIHD IFIPE IFJZH IPLJI JAVBF LAI M43 MS~ O9- OCL P2P PQQKQ RIA RIE RNS RXW TAE TN5 VH1 VJK AAYXX CITATION IQODW RIG 7SC 7SP 8FD JQ2 L7M L~C L~D F28 FR3 |
| ID | FETCH-LOGICAL-c354t-3a790ad3d92c4fede5fa81c09c452545afb45fbd76a28d6ec86ab56e7121e7723 |
| IEDL.DBID | RIE |
| ISICitedReferencesCount | 74 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000308965600003&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 0018-9448 |
| IngestDate | Sat Sep 27 16:58:02 EDT 2025 Sun Jun 29 15:30:27 EDT 2025 Mon Jul 21 09:16:44 EDT 2025 Sat Nov 29 03:53:15 EST 2025 Tue Nov 18 21:00:59 EST 2025 Tue Aug 26 17:18:12 EDT 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 10 |
| Keywords | Error probability Source coding Quantize-Bin-Test scheme Measurement sensor Distributed source signal Hypothesis test Binning test against conditional independence outer bound Gaussian many-help-one hypothesis testing against independence distributed hypothesis testing rate-exponent region Gel'fand and Pinsker hypothesis testing against independence |
| Language | English |
| License | https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html CC BY 4.0 |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c354t-3a790ad3d92c4fede5fa81c09c452545afb45fbd76a28d6ec86ab56e7121e7723 |
| Notes | SourceType-Scholarly Journals-1 ObjectType-Feature-1 content type line 14 ObjectType-Article-2 content type line 23 |
| PQID | 1039640520 |
| PQPubID | 36024 |
| PageCount | 22 |
| ParticipantIDs | ieee_primary_6257491 proquest_miscellaneous_1315674600 crossref_primary_10_1109_TIT_2012_2206793 pascalfrancis_primary_26403663 proquest_journals_1039640520 crossref_citationtrail_10_1109_TIT_2012_2206793 |
| PublicationCentury | 2000 |
| PublicationDate | 2012-10-01 |
| PublicationDateYYYYMMDD | 2012-10-01 |
| PublicationDate_xml | – month: 10 year: 2012 text: 2012-10-01 day: 01 |
| PublicationDecade | 2010 |
| PublicationPlace | New York, NY |
| PublicationPlace_xml | – name: New York, NY – name: New York |
| PublicationTitle | IEEE transactions on information theory |
| PublicationTitleAbbrev | TIT |
| PublicationYear | 2012 |
| Publisher | IEEE Institute of Electrical and Electronics Engineers The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Publisher_xml | – name: IEEE – name: Institute of Electrical and Electronics Engineers – name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| References | ref35 ref13 ref34 ref12 ref37 ref15 ref36 ref14 ref31 ref32 ref10 ref2 ref1 ref39 berger (ref17) 1978; 229 ref16 ref19 han (ref4) 1998; 44 gel'fand (ref25) 1979; 15 ref24 ref23 ref26 ref20 ref22 csiszr (ref33) 1981 ref21 kelly (ref11) 2007 ref28 ref27 viswanath (ref30) 2004; 66 ref29 berger (ref3) 1979 ref8 ref7 ref9 ref6 ref5 globerson (ref38) 2004 tung (ref18) 1978 |
| References_xml | – volume: 66 start-page: 43 year: 2004 ident: ref30 publication-title: Advances in Network Information Theory doi: 10.1090/dimacs/066/03 – ident: ref12 doi: 10.1109/ISIT.2010.5513294 – ident: ref24 doi: 10.1109/TIT.2008.2008146 – ident: ref39 doi: 10.1109/ISIT.2009.5205595 – ident: ref19 doi: 10.1109/TIT.2008.920249 – ident: ref6 doi: 10.1109/TIT.1987.1057383 – ident: ref9 doi: 10.1109/TIT.2012.2201346 – ident: ref22 doi: 10.1109/TIT.2010.2090225 – ident: ref34 doi: 10.1109/ISIT.2009.5205873 – ident: ref29 doi: 10.1109/JSAC.2004.830888 – ident: ref2 doi: 10.1109/TSP.2010.2044249 – volume: 15 start-page: 45 year: 1979 ident: ref25 article-title: Coding of sources on the basis of observations with incomplete information publication-title: Problemy Peredachi Informatsii – ident: ref31 doi: 10.1109/TIT.2011.2145570 – ident: ref27 doi: 10.1109/ISIT.2004.1365154 – year: 2004 ident: ref38 publication-title: Hebrew Univ – ident: ref23 doi: 10.1002/j.1538-7305.1980.tb03344.x – ident: ref21 doi: 10.1109/TIT.2008.920343 – volume: 229 start-page: 171 year: 1978 ident: ref17 publication-title: The Information Theory Approach to Communications – ident: ref20 doi: 10.1109/TIT.2009.2034791 – year: 1979 ident: ref3 article-title: Decentralized estimation and decision theory publication-title: IEEE 7th Spring Workshop Inf Theory – ident: ref36 doi: 10.1109/18.641555 – year: 2007 ident: ref11 article-title: Error exponents and test channel optimization for the Wyner-Ziv problem publication-title: 45th Annu Allerton Conf – ident: ref14 doi: 10.1109/TIT.2011.2162178 – ident: ref32 doi: 10.1109/TAC.1985.1103988 – ident: ref1 doi: 10.1109/TIT.2008.929944 – ident: ref15 doi: 10.1109/TIT.1981.1056281 – year: 1978 ident: ref18 publication-title: Multiterminal source coding – ident: ref8 doi: 10.1109/TIT.1973.1055037 – year: 1981 ident: ref33 publication-title: Information Theory Coding Theorems for Discrete Memoryless Systems – ident: ref5 doi: 10.1109/TIT.1986.1057194 – ident: ref13 doi: 10.1109/TIT.1982.1056524 – ident: ref37 doi: 10.1109/TIT.2009.2027519 – ident: ref16 doi: 10.1109/TIT.2008.928951 – ident: ref26 doi: 10.1109/TIT.2005.850110 – ident: ref35 doi: 10.1002/047174882X – ident: ref7 doi: 10.1109/ISIT.1994.394874 – volume: 44 start-page: 2300 year: 1998 ident: ref4 article-title: Statistical inference under multiterminal data compression publication-title: IEEE Trans Inf Theory doi: 10.1109/18.720540 – ident: ref10 doi: 10.1109/ISIT.2008.4595019 – ident: ref28 doi: 10.1109/TIT.2004.836707 |
| SSID | ssj0014512 |
| Score | 2.4377675 |
| Snippet | We study a hypothesis testing problem in which data are compressed distributively and sent to a detector that seeks to decide between two possible... |
| SourceID | proquest pascalfrancis crossref ieee |
| SourceType | Aggregation Database Index Database Enrichment Source Publisher |
| StartPage | 6282 |
| SubjectTerms | Applied sciences Binning Coding Coding, codes Compressed Detectors distributed hypothesis testing Encoding Entropy Error probability Errors Exact sciences and technology Exponents Gaussian many-help-one hypothesis testing against independence Gel'fand and Pinsker hypothesis testing against independence Hypothesis testing Information theory Information, signal and communications theory Optimization outer bound Probability distribution Quantize-Bin-Test scheme Random variables rate-exponent region Signal and communications theory Source coding Telecommunications and information theory test against conditional independence Testing Vectors |
| Title | On the Optimality of Binning for Distributed Hypothesis Testing |
| URI | https://ieeexplore.ieee.org/document/6257491 https://www.proquest.com/docview/1039640520 https://www.proquest.com/docview/1315674600 |
| Volume | 58 |
| WOSCitedRecordID | wos000308965600003&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVIEE databaseName: IEEE Electronic Library (IEL) customDbUrl: eissn: 1557-9654 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0014512 issn: 0018-9448 databaseCode: RIE dateStart: 19630101 isFulltext: true titleUrlDefault: https://ieeexplore.ieee.org/ providerName: IEEE |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1La9tAEB7c0EN7qFO7pU5Ss4FeClWsx-5KOpU2iXEudg8u-CZW-yiGVA6WXci_z8xKFjUthd4Eu4vEzM7uN5rHB_DBKasEVeOYyLmASx4GmREqsDG36D0ghHbGk02k83m2WuXfevCpq4Wx1vrkM3tFjz6WbzZ6T7_KJojVU06l6s_SVDa1Wl3EgIuo6QweoQGjz3EISYb5ZHm3pByu-CqmXuV5cnQFeU4VyohUNQrFNWwWfxzM_raZ9v_vO0_hVYsq2ZdmG7yGnq0G0D8wNrDWgAfw8rf2g0P4vKgY4j-2wGPjp8fjbOPY17VnMWKIZtkNtdUlRixr2Ozxgaq16nXNltSao_rxBr5Pb5fXs6AlVAh0IvguSFSah8okJo81d9ZY4VQW6TDXFN3kQrmSC1eaVKo4M9LqTKpSSFRaHFmE4clbOKk2lX0HTLkkC8tMlC7SPDGizEKJrpzQpUTVp2IEk4OMC912GyfSi_vCex1hXqBWCtJK0WplBB-7FQ9Np41_zB2S1Lt5rcBHMD5SYzeOqA9vaonrLg56LVpbrQsKhuO4iMMRXHbDaGUUOlGV3exxToJ-bsoRHZ79_dXn8II-sEnzu4CT3XZv38Nz_Wu3rrdjv1WfAANc5ZI |
| linkProvider | IEEE |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3dS9xAEB_EFlofeq1WPHvaLfgiNN4m2c3HU2lt5aT27EME38JmP-SgzYm5E_zvndnkgqIU-hbYXRJmdnZ_k_n4ARw4ZZWkahwTOheIRPAgM1IFNhIWvQeE0M54sol0Os0uL_Pfa_C5r4Wx1vrkM3tEjz6Wb-Z6Sb_KxojVU0Gl6i-kEBFvq7X6mIGQYdsbPEQTRq9jFZTk-bg4LSiLKzqKqFt5Hj-6hDyrCuVEqgbF4lo-iydHs79vTgb_96Vv4U2HK9nXdiO8gzVbb8JgxdnAOhPehI0HDQi34Mt5zRABsnM8OP56RM7mjn2beR4jhniWfafGusSJZQ2b3F1TvVYza1hBzTnqq_dwcfKjOJ4EHaVCoGMpFkGs0pwrE5s80sJZY6VTWah5rim-KaRylZCuMmmioswkVmeJqmSCaotCi0A83ob1el7bHWDKxRmvMlm5UIvYyCrjCTpzUlcJKj-VQxivZFzqrt840V78Kb3fwfMStVKSVspOK0M47Fdct702_jF3i6Tez-sEPoT9R2rsxxH34V2d4LrRSq9lZ61NSeFwHJcRH8KnfhjtjIInqrbzJc6J0dNNBeLD3edf_RFeTYpfZ-XZ6fTnB3hNH9sm_Y1gfXGztHvwUt8uZs3Nvt-29xn76Nk |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=On+the+Optimality+of+Binning+for+Distributed+Hypothesis+Testing&rft.jtitle=IEEE+transactions+on+information+theory&rft.au=Rahman%2C+M+S&rft.au=Wagner%2C+A+B&rft.date=2012-10-01&rft.pub=The+Institute+of+Electrical+and+Electronics+Engineers%2C+Inc.+%28IEEE%29&rft.issn=0018-9448&rft.eissn=1557-9654&rft.volume=58&rft.issue=10&rft.spage=6282&rft_id=info:doi/10.1109%2FTIT.2012.2206793&rft.externalDBID=NO_FULL_TEXT&rft.externalDocID=2761357091 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0018-9448&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0018-9448&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0018-9448&client=summon |