Reliability in Source Coding With Side Information

We study error exponents for source coding with side information. Both achievable exponents and converse bounds are obtained for the following two cases: lossless source coding with coded information and lossy source coding with full side information (Wyner-Ziv). These results recover and extend sev...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Veröffentlicht in:	IEEE transactions on information theory Jg. 58; H. 8; S. 5086 - 5111
Hauptverfasser:	Kelly, B. G., Wagner, A. B.
Format:	Journal Article
Sprache:	Englisch
Veröffentlicht:	New York, NY IEEE 01.08.2012 Institute of Electrical and Electronics Engineers The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Schlagworte:	Applied sciences Channels Coding Coding theory Coding, codes Decoding Entropy Error analysis Error exponents Exact sciences and technology Exponents Games Gaussian Information theory Information, signal and communications theory Joints Lossless Mathematical analysis Mathematical problems Normal distribution Optimization Optimization techniques Random variables Relays side information Signal and communications theory Source coding Telecommunications and information theory test channel optimization Wyner-Ziv problem test channel optimization Lossless circuit Source coding Coding errors side information Lossy medium Optimal test Optimization Information source Error exponents Wyner-Ziv problem Wyner Ziv problem Reliability
ISSN:	0018-9448, 1557-9654
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Abstract	We study error exponents for source coding with side information. Both achievable exponents and converse bounds are obtained for the following two cases: lossless source coding with coded information and lossy source coding with full side information (Wyner-Ziv). These results recover and extend several existing results on source-coding error exponents and are tight in some circumstances. Our bounds have a natural interpretation as a two-player game between nature and the code designer, with nature seeking to minimize the exponent and the code designer seeking to maximize it. In the Wyner-Ziv problem, our analysis exposes a tension in the choice of test channel with the optimal test channel balancing two competing error events. The Gaussian and binary-erasure cases are examined in detail.
AbstractList	We study error exponents for source coding with side information. Both achievable exponents and converse bounds are obtained for the following two cases: lossless source coding with coded information and lossy source coding with full side information (Wyner-Ziv). These results recover and extend several existing results on source-coding error exponents and are tight in some circumstances. Our bounds have a natural interpretation as a two-player game between nature and the code designer, with nature seeking to minimize the exponent and the code designer seeking to maximize it. In the Wyner-Ziv problem, our analysis exposes a tension in the choice of test channel with the optimal test channel balancing two competing error events. The Gaussian and binary-erasure cases are examined in detail.
Author	Wagner, A. B. Kelly, B. G.
Author_xml	– sequence: 1 givenname: B. G. surname: Kelly fullname: Kelly, B. G. email: bgk6@cornell.edu organization: Sch. of Electr. & Comput. Eng., Cornell Univ., Ithaca, NY, USA – sequence: 2 givenname: A. B. surname: Wagner fullname: Wagner, A. B. email: wagner@cornell.edu organization: Sch. of Electr. & Comput. Eng., Cornell Univ., Ithaca, NY, USA
BackLink	http://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&idt=26185717$$DView record in Pascal Francis
BookMark	eNp9kM1LAzEQxYMo2FbvgpcFEbxszeRrs0cpfhQKgi14DNlsVlO22ZpsD_3vTW310IMMzDDwe8O8N0SnvvMWoSvAYwBc3i-mizHBQMYkdcrECRoA50VeCs5O0QBjkHnJmDxHwxiXaWUcyACRN9s6XbnW9dvM-WzebYKx2aSrnf_I3l3_mc1dbbOpb7qw0r3r_AU6a3Qb7eVhjtDi6XExeclnr8_TycMsN5SzPi9LYwqoG0mkFcBBGNpIKRiuK1azqhGlYNRCVei6JjXRkhtpacUFswWjmI7Q3f7sOnRfGxt7tXLR2LbV3nabqIAKDlyUJUvozRG6TDZ8ek6BSFVQCTvq9kDpaHTbBO2Ni2od3EqHrSICJC8SO0Jiz5nQxRhso4zrf5z3QbtWAVa7xFVKXO0SV4fEkxAfCX9v_yO53kuctfYPFwRzKjn9Bh-5ip8
CODEN	IETTAW
CitedBy_id	crossref_primary_10_1109_TIT_2015_2402279 crossref_primary_10_1109_TIT_2011_2162178 crossref_primary_10_1109_TIT_2015_2400994 crossref_primary_10_1109_TIT_2012_2206793 crossref_primary_10_3390_e23030265 crossref_primary_10_1109_TIT_2012_2201346 crossref_primary_10_1109_TIT_2015_2400999 crossref_primary_10_1109_ACCESS_2019_2920982 crossref_primary_10_1109_TIT_2014_2358682 crossref_primary_10_1109_TIT_2017_2674675 crossref_primary_10_1109_TIT_2017_2688348
Cites_doi	10.1109/TIT.2007.911296 10.1109/TIT.1975.1055469 10.1109/TIT.1981.1056281 10.1016/S0019-9958(78)90034-7 10.1109/ISIT.2010.5513505 10.1109/CISS.2006.286638 10.1109/18.340465 10.1109/TIT.1976.1055508 10.1109/TIT.2012.2201346 10.1109/18.720540 10.1109/JPROC.2004.839619 10.1109/ALLERTON.2010.5706994 10.1109/TIT.2003.810622 10.1109/18.915643 10.1109/TIT.2007.892789 10.1109/ISIT.2008.4595243 10.1109/ISIT.2010.5513294 10.1109/TIT.2006.878169 10.1109/TIT.1982.1056524 10.1109/TIT.2005.862077 10.1017/CBO9780511804441 10.1109/TIT.2011.2162178 10.1109/TIT.1974.1055204 10.1109/ISIT.1995.535778 10.1109/18.669158 10.1109/TIT.1975.1055374 10.1109/18.32119 10.1109/TIT.2005.853304 10.1109/TIT.1980.1056166
ContentType	Journal Article
Copyright	2015 INIST-CNRS Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) Aug 2012
Copyright_xml	– notice: 2015 INIST-CNRS – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) Aug 2012
DBID	97E RIA RIE AAYXX CITATION IQODW 7SC 7SP 8FD JQ2 L7M L~C L~D F28 FR3
DOI	10.1109/TIT.2012.2201346
DatabaseName	IEEE Xplore (IEEE) IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE Xplore CrossRef Pascal-Francis Computer and Information Systems Abstracts Electronics & Communications Abstracts Technology Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional ANTE: Abstracts in New Technology & Engineering Engineering Research Database
DatabaseTitle	CrossRef Technology Research Database Computer and Information Systems Abstracts – Academic Electronics & Communications Abstracts ProQuest Computer Science Collection Computer and Information Systems Abstracts Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Professional Engineering Research Database ANTE: Abstracts in New Technology & Engineering
DatabaseTitleList	Technology Research Database Technology Research Database
Database_xml	– sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://ieeexplore.ieee.org/ sourceTypes: Publisher
DeliveryMethod	fulltext_linktorsrc
Discipline	Engineering Computer Science Applied Sciences
EISSN	1557-9654
EndPage	5111
ExternalDocumentID	3470830701 26185717 10_1109_TIT_2012_2201346 6205385
Genre	orig-research Feature
GroupedDBID	-~X .DC 0R~ 29I 3EH 4.4 5GY 5VS 6IK 97E AAJGR AARMG AASAJ AAWTH ABAZT ABFSI ABQJQ ABVLG ACGFO ACGFS ACGOD ACIWK AENEX AETEA AETIX AGQYO AGSQL AHBIQ AI. AIBXA AKJIK AKQYR ALLEH ALMA_UNASSIGNED_HOLDINGS ASUFR ATWAV BEFXN BFFAM BGNUA BKEBE BPEOZ CS3 DU5 E.L EBS EJD F5P HZ~ H~9 IAAWW IBMZZ ICLAB IDIHD IFIPE IFJZH IPLJI JAVBF LAI M43 MS~ O9- OCL P2P PQQKQ RIA RIE RNS RXW TAE TN5 VH1 VJK AAYXX CITATION IQODW RIG 7SC 7SP 8FD JQ2 L7M L~C L~D F28 FR3
ID	FETCH-LOGICAL-c354t-99cc71df828e61516c3f88640db4d4bf69643e1b7add2d2a85c8e3b564e74303
IEDL.DBID	RIE
ISICitedReferencesCount	19
ISICitedReferencesURI	http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000306518600007&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN	0018-9448
IngestDate	Sat Sep 27 23:26:22 EDT 2025 Sun Nov 30 04:02:36 EST 2025 Mon Jul 21 09:14:45 EDT 2025 Sat Nov 29 03:53:14 EST 2025 Tue Nov 18 20:45:20 EST 2025 Tue Aug 26 17:18:12 EDT 2025
IsPeerReviewed	true
IsScholarly	true
Issue	8
Keywords	test channel optimization Lossless circuit Source coding Coding errors side information Lossy medium Optimal test Optimization Information source Error exponents Wyner-Ziv problem Wyner Ziv problem Reliability
Language	English
License	https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html CC BY 4.0
LinkModel	DirectLink
MergedId	FETCHMERGED-LOGICAL-c354t-99cc71df828e61516c3f88640db4d4bf69643e1b7add2d2a85c8e3b564e74303
Notes	SourceType-Scholarly Journals-1 ObjectType-Feature-1 content type line 14 ObjectType-Article-2 content type line 23
PQID	1616173814
PQPubID	36024
PageCount	26
ParticipantIDs	pascalfrancis_primary_26185717 crossref_citationtrail_10_1109_TIT_2012_2201346 crossref_primary_10_1109_TIT_2012_2201346 ieee_primary_6205385 proquest_miscellaneous_1365156994 proquest_journals_1616173814
PublicationCentury	2000
PublicationDate	2012-08-01
PublicationDateYYYYMMDD	2012-08-01
PublicationDate_xml	– month: 08 year: 2012 text: 2012-08-01 day: 01
PublicationDecade	2010
PublicationPlace	New York, NY
PublicationPlace_xml	– name: New York, NY – name: New York
PublicationTitle	IEEE transactions on information theory
PublicationTitleAbbrev	TIT
PublicationYear	2012
Publisher	IEEE Institute of Electrical and Electronics Engineers The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml	– name: IEEE – name: Institute of Electrical and Electronics Engineers – name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References	ref35 ref34 ref37 ref15 ref36 ref30 ref33 ref11 ref32 ref2 ref1 ref17 ref38 ref16 ihara (ref31) 2000; e83 a csiszr (ref10) 1981 arutyunyan (ref13) 1989; 25 han (ref19) 1998; 44 jayaraman (ref18) 1995 ref23 ref26 ref25 ref20 ref22 ref21 ref28 ref27 gallager (ref24) 1976 ref29 ref8 ref7 ref4 ref3 arutyunyan (ref14) 2007 ref6 ref5 majumdar (ref12) 2007 cover (ref9) 2006
References_xml	– volume: e83 a start-page: 1891 year: 2000 ident: ref31 article-title: Error exponent for coding of memoryless Gaussian sources with a fidelity criterion publication-title: IEICE Trans Fundamentals – year: 2007 ident: ref14 publication-title: private communication – ident: ref3 doi: 10.1109/TIT.2007.911296 – year: 2006 ident: ref9 publication-title: Elements of Information Theory – ident: ref5 doi: 10.1109/TIT.1975.1055469 – year: 2007 ident: ref12 publication-title: Multimedia over IP and Wireless Networks Compression Networking and Systems – ident: ref25 doi: 10.1109/TIT.1981.1056281 – ident: ref6 doi: 10.1016/S0019-9958(78)90034-7 – ident: ref37 doi: 10.1016/S0019-9958(78)90034-7 – year: 1976 ident: ref24 publication-title: Source coding with side information and universal coding – ident: ref20 doi: 10.1109/ISIT.2010.5513505 – ident: ref16 doi: 10.1109/CISS.2006.286638 – year: 1995 ident: ref18 publication-title: On error exponents in multiterminal source coding and hypothesis testing – ident: ref29 doi: 10.1109/18.340465 – ident: ref33 doi: 10.1109/TIT.1976.1055508 – ident: ref35 doi: 10.1109/TIT.2012.2201346 – volume: 44 start-page: 2300 year: 1998 ident: ref19 article-title: Statistical inference under multiterminal data compression publication-title: IEEE Trans Inf Theory doi: 10.1109/18.720540 – ident: ref1 doi: 10.1109/JPROC.2004.839619 – ident: ref11 doi: 10.1109/ALLERTON.2010.5706994 – ident: ref21 doi: 10.1109/TIT.2003.810622 – year: 1981 ident: ref10 publication-title: Information Theory Coding Theorems for Discrete Memoryless Systems – volume: 25 start-page: 24 year: 1989 ident: ref13 article-title: E-optimal coding rates of a randomly varying source with side information at the decoder publication-title: Problemy Peredachi Informatsii – ident: ref36 doi: 10.1109/18.915643 – ident: ref23 doi: 10.1109/TIT.2007.892789 – ident: ref8 doi: 10.1109/ISIT.2008.4595243 – ident: ref15 doi: 10.1109/ISIT.2010.5513294 – ident: ref7 doi: 10.1109/TIT.2006.878169 – ident: ref28 doi: 10.1109/TIT.1982.1056524 – ident: ref22 doi: 10.1109/TIT.2005.862077 – ident: ref38 doi: 10.1017/CBO9780511804441 – ident: ref26 doi: 10.1109/TIT.2011.2162178 – ident: ref30 doi: 10.1109/TIT.1974.1055204 – ident: ref32 doi: 10.1109/ISIT.1995.535778 – ident: ref34 doi: 10.1109/18.669158 – ident: ref4 doi: 10.1109/TIT.1975.1055374 – ident: ref17 doi: 10.1109/18.32119 – ident: ref2 doi: 10.1109/TIT.2005.853304 – ident: ref27 doi: 10.1109/TIT.1980.1056166
SSID	ssj0014512
Score	2.1748044
Snippet	We study error exponents for source coding with side information. Both achievable exponents and converse bounds are obtained for the following two cases:...
SourceID	proquest pascalfrancis crossref ieee
SourceType	Aggregation Database Index Database Enrichment Source Publisher
StartPage	5086
SubjectTerms	Applied sciences Channels Coding Coding theory Coding, codes Decoding Entropy Error analysis Error exponents Exact sciences and technology Exponents Games Gaussian Information theory Information, signal and communications theory Joints Lossless Mathematical analysis Mathematical problems Normal distribution Optimization Optimization techniques Random variables Relays side information Signal and communications theory Source coding Telecommunications and information theory test channel optimization Wyner-Ziv problem
Title	Reliability in Source Coding With Side Information
URI	https://ieeexplore.ieee.org/document/6205385 https://www.proquest.com/docview/1616173814 https://www.proquest.com/docview/1365156994
Volume	58
WOSCitedRecordID	wos000306518600007&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText	1
inHoldings	1
isFullTextHit
isPrint
journalDatabaseRights	– providerCode: PRVIEE databaseName: IEEE Electronic Library (IEL) customDbUrl: eissn: 1557-9654 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0014512 issn: 0018-9448 databaseCode: RIE dateStart: 19630101 isFulltext: true titleUrlDefault: https://ieeexplore.ieee.org/ providerName: IEEE
link	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LS8QwEB5UPOjBt1hfRPAiWHc3SdP2KKIoiAgu6q206QQXpCv7EPz3zqTdoiiCl1JISsNMJvkmM_kG4Dg3ClHaNOxFWIZa6iQsbJmH0kmnyMBs7Nn5H2_ju7vk-Tm9n4PT9i4MIvrkMzzjVx_LL4d2ykdlHSNpyiTRPMzHsanvarURAx31ambwHhkw-RyzkGQ37fRv-pzDJc8kPRVD3S9bkK-pwhmR-ZiE4upqFj8WZr_bXK3-b5xrsNKgSnFeT4N1mMNqA1ZnFRtEY8AbsPyFfnATJOcj1zzdH2JQiQd_kC8uhryfiafB5EU8DEoUzZUlVuEW9K8u-xfXYVNDIbQq0pMwTS2Ju3TkWCGDF2OVSxKju2WhS104w3xc2CtiWudkKfMksgmqIjIaCVt01TYsVMMKd0Aw15SVzFcUo86dyWUstXHKowRn4gA6M6lmtuEX5zIXr5n3M7ppRnrIWA9Zo4cATtov3mpujT_6brKc236NiAM4_Ka4tp0cwyQiVzWA_Zkms8Y6xxmhXAJuhFV0AEdtM9kVB0vyCodT6qO4SLxJU737-6_3YIkHWCcD7sPCZDTFA1i075PBeHToJ-cnmG3e3g
linkProvider	IEEE
linkToHtml	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1RS9xAEB6sLVQfaqstxqrdQl8KjXe3u9kkj0UUpechGFrfQrKZpQclJ96d4L93ZrMXLC2CLyGwG7LM7Ox-szP7DcCXyihEafN4lGATa6mzuLZNFUsnnSIDs6ln5_85TieT7Po6v1yDb_1dGET0yWd4xK8-lt_M7JKPygZG0pTJkhfwkitnhdtafcxAJ6OOG3xEJkxexyooOcwHxXnBWVzySNJTMdh9tAn5qiqcE1nNSSyuq2fxz9Ls95vTreeN9C28CbhSfO8mwjtYw3YbtlY1G0Qw4W3YfERAuAOSM5I7pu57MW3FlT_KF8cz3tHEr-nit7iaNijCpSVW4nsoTk-K47M4VFGIrUr0Is5zSwJvHLlWyPDFWOWyzOhhU-tG184wIxeO6pRWOtnIKktshqpOjEZCF0P1AdbbWYu7IJhtykpmLEpRV85UMpXaOOVxgjNpBIOVVEsbGMa50MWf0nsaw7wkPZSshzLoIYKv_Rc3HbvGE313WM59vyDiCA7_UlzfTq5hlpCzGsH-SpNlsM95STiXoBuhFR3B576ZLIvDJVWLsyX1UVwm3uS53vv_rz_B67PiYlyOzyc_PsIGD7ZLDdyH9cXtEg_glb1bTOe3h36iPgBef-In
openUrl	ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Reliability+in+Source+Coding+With+Side+Information&rft.jtitle=IEEE+transactions+on+information+theory&rft.au=Kelly%2C+BG&rft.au=Wagner%2C+AB&rft.date=2012-08-01&rft.pub=The+Institute+of+Electrical+and+Electronics+Engineers%2C+Inc.+%28IEEE%29&rft.issn=0018-9448&rft.eissn=1557-9654&rft.volume=58&rft.issue=8&rft.spage=5086&rft_id=info:doi/10.1109%2FTIT.2012.2201346&rft.externalDBID=NO_FULL_TEXT&rft.externalDocID=3470830701
thumbnail_l	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0018-9448&client=summon
thumbnail_m	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0018-9448&client=summon
thumbnail_s	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0018-9448&client=summon