Texture-Distortion-Constrained Joint Source-Channel Coding of Multi-View Video Plus Depth-Based 3D Video

A novel joint source and channel coding scheme tailored to 3D video is proposed in this paper to minimize the end-to-end view synthesis distortion within a given total bit rate for both texture and depth as well as a maximum tolerable distortion constraint for texture. First, we formulate a joint te...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Veröffentlicht in:	IEEE transactions on circuits and systems for video technology Jg. 29; H. 11; S. 3326 - 3340
Hauptverfasser:	Gao, Pan, Xiang, Wei, Liang, Dong
Format:	Journal Article
Sprache:	Englisch
Veröffentlicht:	New York IEEE 01.11.2019 The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Schlagworte:	3D video transmission Algorithms Bit rate Channel coding Codes Coding Constraints Distortion Errors Joint source and channel coding joint texture and depth map coding Lagrange multiplier Modal choice Source coding Streaming media Synthesis Texture texture distortion constraint Three-dimensional displays Video compression
ISSN:	1051-8215, 1558-2205
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Abstract	A novel joint source and channel coding scheme tailored to 3D video is proposed in this paper to minimize the end-to-end view synthesis distortion within a given total bit rate for both texture and depth as well as a maximum tolerable distortion constraint for texture. First, we formulate a joint texture and depth coding mode selection strategy for error-resilient source coding of multi-view video plus depth-based 3D video through using the Lagrange multiplier method. Then, by considering the effect of residual errors after channel coding, we evolve to a more general formulation that jointly optimizes error-resilient source coding and channel coding in an integrated manner for unequal error protection between texture and depth, for which a theoretic solution using a proposed dual-trellis is derived. Finally, we extend the general formulation by including the texture distortion constraint. We show how to optimize the view synthesis quality while simultaneously catering to the texture quality constraint. Experimental results demonstrate the proposed algorithm has much better performance than existing related work.
AbstractList	A novel joint source and channel coding scheme tailored to 3D video is proposed in this paper to minimize the end-to-end view synthesis distortion within a given total bit rate for both texture and depth as well as a maximum tolerable distortion constraint for texture. First, we formulate a joint texture and depth coding mode selection strategy for error-resilient source coding of multi-view video plus depth-based 3D video through using the Lagrange multiplier method. Then, by considering the effect of residual errors after channel coding, we evolve to a more general formulation that jointly optimizes error-resilient source coding and channel coding in an integrated manner for unequal error protection between texture and depth, for which a theoretic solution using a proposed dual-trellis is derived. Finally, we extend the general formulation by including the texture distortion constraint. We show how to optimize the view synthesis quality while simultaneously catering to the texture quality constraint. Experimental results demonstrate the proposed algorithm has much better performance than existing related work.
Author	Xiang, Wei Gao, Pan Liang, Dong
Author_xml	– sequence: 1 givenname: Pan orcidid: 0000-0002-4492-5430 surname: Gao fullname: Gao, Pan email: gaopan.1005@gmail.com organization: College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, China – sequence: 2 givenname: Wei orcidid: 0000-0002-0608-065X surname: Xiang fullname: Xiang, Wei email: wei.xiang@jcu.edu.au organization: College of Science and Engineering, James Cook University, Cairns, QLD, Australia – sequence: 3 givenname: Dong surname: Liang fullname: Liang, Dong email: liangdong@nuaa.edu.cn organization: College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, China
BookMark	eNp9kMtOwzAQRS1UJNrCD8AmEmsXP-LUXULKU0UgtXQbucmYugp2sR0Bf09KKhYsWM1Ic--dmTNAPessIHRKyYhSMrlY5PPlYsQIlSMmx-MJ4QeoT4WQmDEiem1PBMWSUXGEBiFsCKGpTMd9tF7AZ2w84KkJ0flonMW5syF6ZSxUyYMzNiZz1_gScL5W1kKd5K4y9jVxOnls6mjw0sBHsjQVuOS5bkIyhW1c4ysV2gA-7SbH6FCrOsDJvg7Ry831Ir_Ds6fb-_xyhks2ERHzVMsVpYKoVMkq1axSSq5kVSrFmaBMsJRNiOYChFalWmWZ0O2LUgKlrOSaD9F5l7v17r2BEItNe7xtVxaM0xZWJgVrVaxTld6F4EEXW2_elP8qKCl2RIsfosWOaLEn2prkH1Npotoh29Gq_7eedVYDAL-7pCBZygn_Bk-XhfE
CODEN	ITCTEM
CitedBy_id	crossref_primary_10_1109_TCSVT_2022_3161103 crossref_primary_10_1109_TMM_2023_3323895 crossref_primary_10_1109_TMM_2019_2933336 crossref_primary_10_1109_TCSVT_2022_3162916
Cites_doi	10.1145/2910017.2910610 10.1109/TCSVT.2011.2154730 10.1109/ICIP.2012.6467194 10.1109/TIP.2013.2293419 10.1109/TMM.2014.2299768 10.1109/TCSVT.2006.881198 10.1109/TIP.2013.2269274 10.1109/JSTSP.2015.2402633 10.1016/S0923-5965(98)00061-7 10.1109/TCSVT.2014.2363746 10.1109/TMM.2017.2694218 10.1109/TCSVT.2015.2389511 10.1109/TIP.2011.2158230 10.1109/ICMEW.2017.8026295 10.1109/ICASSP.2013.6638014 10.1109/ACSSC.2014.7094533 10.1109/JPROC.2010.2091090 10.1109/TCSVT.2015.2477935 10.1109/TIP.2017.2690058 10.1109/83.217221 10.1109/PCS.2012.6213284 10.1109/TCE.2008.4560175 10.1109/TCSVT.2016.2631568 10.1109/TMM.2006.887989 10.1109/LSP.2014.2346739 10.1109/49.848250 10.1109/JSTSP.2014.2330332 10.1109/JPROC.2010.2100010 10.1109/TCOMM.2014.2380316 10.1109/TIP.2013.2269801 10.1109/TIP.2003.819861 10.1109/76.911161 10.1109/TCSVT.2013.2280071 10.1109/TMM.2014.2331013 10.1109/TCOMM.2014.022314.120890 10.1109/MMSP.2017.8122225
ContentType	Journal Article
Copyright	Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2019
Copyright_xml	– notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2019
DBID	97E RIA RIE AAYXX CITATION 7SC 7SP 8FD JQ2 L7M L~C L~D
DOI	10.1109/TCSVT.2018.2877903
DatabaseName	IEEE Xplore (IEEE) IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE Electronic Library (IEL) CrossRef Computer and Information Systems Abstracts Electronics & Communications Abstracts Technology Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional
DatabaseTitle	CrossRef Technology Research Database Computer and Information Systems Abstracts – Academic Electronics & Communications Abstracts ProQuest Computer Science Collection Computer and Information Systems Abstracts Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Professional
DatabaseTitleList	Technology Research Database
Database_xml	– sequence: 1 dbid: RIE name: IEEE/IET Electronic Library url: https://ieeexplore.ieee.org/ sourceTypes: Publisher
DeliveryMethod	fulltext_linktorsrc
Discipline	Engineering
EISSN	1558-2205
EndPage	3340
ExternalDocumentID	10_1109_TCSVT_2018_2877903 8506430
Genre	orig-research
GrantInformation_xml	– fundername: National Natural Science Foundation of China grantid: 61701227; 61601223 funderid: 10.13039/501100001809 – fundername: Science Foundation Ireland grantid: 15/RP/2776 funderid: 10.13039/501100001602 – fundername: Natural Science Foundation of Jiangsu Province grantid: BK20170806; BK20150756 funderid: 10.13039/501100004608 – fundername: National Key R&D Program of China grantid: 2017YFB0802300
GroupedDBID	-~X 0R~ 29I 4.4 5GY 5VS 6IK 97E AAJGR AARMG AASAJ AAWTH ABAZT ABQJQ ABVLG ACGFO ACGFS ACIWK AENEX AETIX AGQYO AGSQL AHBIQ AI. AIBXA AKJIK AKQYR ALLEH ALMA_UNASSIGNED_HOLDINGS ASUFR ATWAV BEFXN BFFAM BGNUA BKEBE BPEOZ CS3 DU5 EBS EJD HZ~ H~9 ICLAB IFIPE IFJZH IPLJI JAVBF LAI M43 O9- OCL P2P RIA RIE RNS RXW TAE TN5 VH1 AAYXX CITATION 7SC 7SP 8FD JQ2 L7M L~C L~D RIG
ID	FETCH-LOGICAL-c295t-34f8b1150a4a8d4f2daa8b8dcaa32512524290f35e5facab665f22088e112c3f3
IEDL.DBID	RIE
ISICitedReferencesCount	5
ISICitedReferencesURI	http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000494710600015&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN	1051-8215
IngestDate	Mon Jun 30 10:19:48 EDT 2025 Sat Nov 29 01:44:12 EST 2025 Tue Nov 18 21:27:20 EST 2025 Wed Aug 27 02:40:42 EDT 2025
IsPeerReviewed	true
IsScholarly	true
Issue	11
Language	English
License	https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html https://doi.org/10.15223/policy-029 https://doi.org/10.15223/policy-037
LinkModel	DirectLink
MergedId	FETCHMERGED-LOGICAL-c295t-34f8b1150a4a8d4f2daa8b8dcaa32512524290f35e5facab665f22088e112c3f3
Notes	ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14
ORCID	0000-0002-0608-065X 0000-0002-4492-5430
PQID	2311106852
PQPubID	85433
PageCount	15
ParticipantIDs	proquest_journals_2311106852 crossref_citationtrail_10_1109_TCSVT_2018_2877903 crossref_primary_10_1109_TCSVT_2018_2877903 ieee_primary_8506430
PublicationCentury	2000
PublicationDate	2019-11-01
PublicationDateYYYYMMDD	2019-11-01
PublicationDate_xml	– month: 11 year: 2019 text: 2019-11-01 day: 01
PublicationDecade	2010
PublicationPlace	New York
PublicationPlace_xml	– name: New York
PublicationTitle	IEEE transactions on circuits and systems for video technology
PublicationTitleAbbrev	TCSVT
PublicationYear	2019
Publisher	IEEE The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml	– name: IEEE – name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References	bertsekar (ref33) 2003 ref35 ref13 ref34 ref12 ref15 ref14 ref31 ref30 ref11 ref32 ref10 ref2 ref1 ref17 ref16 ref19 ref18 doan (ref42) 2013 (ref36) 2012 ref24 ref23 ref26 ref25 ref20 ref41 ref22 ref21 ref43 (ref38) 2014 ref28 ref27 ref29 wenger (ref39) 1999 ref8 (ref40) 2016 ref7 ref9 ref4 ref3 ref6 ref5 (ref37) 2010
References_xml	– ident: ref13 doi: 10.1145/2910017.2910610 – ident: ref30 doi: 10.1109/TCSVT.2011.2154730 – ident: ref17 doi: 10.1109/ICIP.2012.6467194 – ident: ref11 doi: 10.1109/TIP.2013.2293419 – ident: ref18 doi: 10.1109/TMM.2014.2299768 – ident: ref29 doi: 10.1109/TCSVT.2006.881198 – ident: ref4 doi: 10.1109/TIP.2013.2269274 – ident: ref23 doi: 10.1109/JSTSP.2015.2402633 – year: 2012 ident: ref36 publication-title: 3D-ATM reference software version 6 0 – ident: ref41 doi: 10.1016/S0923-5965(98)00061-7 – year: 2003 ident: ref33 publication-title: Nonlinear Programming – ident: ref16 doi: 10.1109/TCSVT.2014.2363746 – start-page: 2900 year: 2013 ident: ref42 article-title: Efficient view synthesis based error concealment method for multiview video plus depth publication-title: Proc IEEE Int Symp Circuits Syst (ISCAS) – ident: ref3 doi: 10.1109/TMM.2017.2694218 – ident: ref6 doi: 10.1109/TCSVT.2015.2389511 – ident: ref8 doi: 10.1109/TIP.2011.2158230 – ident: ref24 doi: 10.1109/ICMEW.2017.8026295 – year: 1999 ident: ref39 publication-title: Proposed Error Patterns for Internet Experiments – ident: ref22 doi: 10.1109/ICASSP.2013.6638014 – ident: ref31 doi: 10.1109/ACSSC.2014.7094533 – ident: ref1 doi: 10.1109/JPROC.2010.2091090 – ident: ref5 doi: 10.1109/TCSVT.2015.2477935 – ident: ref27 doi: 10.1109/TIP.2017.2690058 – year: 2016 ident: ref40 publication-title: 3D-HTM reference software version 16 0 – ident: ref32 doi: 10.1109/83.217221 – ident: ref7 doi: 10.1109/PCS.2012.6213284 – ident: ref20 doi: 10.1109/TCE.2008.4560175 – ident: ref34 doi: 10.1109/TCSVT.2016.2631568 – ident: ref28 doi: 10.1109/TMM.2006.887989 – ident: ref21 doi: 10.1109/LSP.2014.2346739 – ident: ref26 doi: 10.1109/49.848250 – ident: ref15 doi: 10.1109/JSTSP.2014.2330332 – ident: ref2 doi: 10.1109/JPROC.2010.2100010 – year: 2014 ident: ref38 publication-title: Common Test Conditions of 3DV Core Experiments – year: 2010 ident: ref37 publication-title: ISO/IEC JTC1/SC29/WG11 3DV/FTV EE2 Report on VSRS Extrapolation – ident: ref14 doi: 10.1109/TCOMM.2014.2380316 – ident: ref9 doi: 10.1109/TIP.2013.2269801 – ident: ref43 doi: 10.1109/TIP.2003.819861 – ident: ref25 doi: 10.1109/76.911161 – ident: ref35 doi: 10.1109/TCSVT.2013.2280071 – ident: ref19 doi: 10.1109/TMM.2014.2331013 – ident: ref12 doi: 10.1109/TCOMM.2014.022314.120890 – ident: ref10 doi: 10.1109/MMSP.2017.8122225
SSID	ssj0014847
Score	2.325339
Snippet	A novel joint source and channel coding scheme tailored to 3D video is proposed in this paper to minimize the end-to-end view synthesis distortion within a...
SourceID	proquest crossref ieee
SourceType	Aggregation Database Enrichment Source Index Database Publisher
StartPage	3326
SubjectTerms	3D video transmission Algorithms Bit rate Channel coding Codes Coding Constraints Distortion Errors Joint source and channel coding joint texture and depth map coding Lagrange multiplier Modal choice Source coding Streaming media Synthesis Texture texture distortion constraint Three-dimensional displays Video compression
Title	Texture-Distortion-Constrained Joint Source-Channel Coding of Multi-View Video Plus Depth-Based 3D Video
URI	https://ieeexplore.ieee.org/document/8506430 https://www.proquest.com/docview/2311106852
Volume	29
WOSCitedRecordID	wos000494710600015&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText	1
inHoldings	1
isFullTextHit
isPrint
journalDatabaseRights	– providerCode: PRVIEE databaseName: IEEE/IET Electronic Library customDbUrl: eissn: 1558-2205 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0014847 issn: 1051-8215 databaseCode: RIE dateStart: 19910101 isFulltext: true titleUrlDefault: https://ieeexplore.ieee.org/ providerName: IEEE
link	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3NS8MwFA9TPOjBb3F-kYM3jbZp0yZH3RziQQTn8Fby8YKD0crW6b9vknZDUARvhSZp01-T93tJ3vshdB6D9PInbqRR56Kk1jCilOJeNZVqI7iXRApiE_njI399FU8ddLmMhQGAcPgMrvxl2Ms3lZ77pbLrkF0tcQ76Sp7nTazWcscg5UFMzNGF2D03ZosAmUhcD3vPo6E_xcWvnH-Qi4VAVmuEgqrKj6k42JfB1v_ebBtttjwS3zTA76AOlLto41t2wT30NnQT73wKpB9SgXgEiNfnDKoQYPBDNS5r_BxW74mPMihhgnuVN2a4sjiE5pLRGD7xaGygwk-T-Qz34b1-I7fO9hmc9Js7--hlcDfs3ZNWWIFoKlhNktRy5amgTCU3qaVGSq640VImnu8wZ7dFZBMGzEotVZYxS6mbj8CxM53Y5ACtllUJhwhTm4DgPGXUZqmSmYqtinIBOnLMhsq8i-LFly50m3Xcd3NSBO8jEkVAp_DoFC06XXSxrPPe5Nz4s_Sex2NZsoWii04WgBbtsJwVjsy6VjLO6NHvtY7RumtbNMGGJ2i1ns7hFK3pj3o8m56FP-4Lj57SEQ
linkProvider	IEEE
linkToHtml	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1db9MwFL2aBhLwMD7GRMcAP_AG3hLHTu1HaJkGjGrSQrW3yB_XWqUqmdoU_j62k1ZIICTeIsWO45zY91zb9x6AtznqKH8SRhoLLgr3TlBjjIyqqcw6JaMkUhKbGM9m8uZGXe3B-10sDCKmw2d4Gi_TXr5r7SYulZ2l7GpFcNDvCc5Z3kdr7fYMuExyYoEw5KHlXGxDZDJ1Vk2u51U8xyVPg4cwVluJrMEMJV2VPybjZGHOH__fuz2Bg4FJkg899E9hD5tn8Oi3_IKHcFuFqXezQjpNyUAiBjQqdCZdCHTkS7toOnKd1u9pjDNocEkmbTRnpPUkBefS-QJ_kvnCYUuulps1meJdd0s_BuvnSDHt7zyH7-efqskFHaQVqGVKdLTgXppIBjXX0nHPnNbSSGe1LiLjEcFyq8wXAoXXVpuyFJ6xMCNh4Ge28MUR7Ddtgy-AMF-gkpIL5ktudGlyb7KxQpsFbsP0eAT59kvXdsg7Hru5rJP_kak6oVNHdOoBnRG829W567Nu_LP0YcRjV3KAYgQnW0DrYWCu60Bnw1NKKdjx32u9gQcX1bfL-vLz7OtLeBjaUX3o4Qnsd6sNvoL79ke3WK9ep7_vF6WV1Vg
openUrl	ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Texture-Distortion-Constrained+Joint+Source-Channel+Coding+of+Multi-View+Video+Plus+Depth-Based+3D+Video&rft.jtitle=IEEE+transactions+on+circuits+and+systems+for+video+technology&rft.au=Gao%2C+Pan&rft.au=Xiang%2C+Wei&rft.au=Liang%2C+Dong&rft.date=2019-11-01&rft.pub=The+Institute+of+Electrical+and+Electronics+Engineers%2C+Inc.+%28IEEE%29&rft.issn=1051-8215&rft.eissn=1558-2205&rft.volume=29&rft.issue=11&rft.spage=3326&rft_id=info:doi/10.1109%2FTCSVT.2018.2877903&rft.externalDBID=NO_FULL_TEXT
thumbnail_l	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1051-8215&client=summon
thumbnail_m	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1051-8215&client=summon
thumbnail_s	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1051-8215&client=summon