End-to-End Distortion Modeling for Error-Resilient Screen Content Video Coding

To improve the compression performance of screen content coding, extension coding standards (HEVC-SCC, VVC-SCC) have been developed. However, considering the compression ratio alone may lead to packet losses in bitstreams which may cause plenty of images decoded incorrectly, degrading the video qual...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Veröffentlicht in:	IEEE transactions on multimedia Jg. 26; S. 4458 - 4468
Hauptverfasser:	Tang, Tong, Yin, Zhiyang, Li, Jie, Wang, Honggang, Wu, Dapeng, Wang, Ruyan
Format:	Journal Article
Sprache:	Englisch
Veröffentlicht:	Piscataway IEEE 2024 The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Schlagworte:	Coding Coding standards Compression ratio Decoding Distortion distortion modeling Encoding error concealment error resilient coding Errors Estimation Image coding Image quality Screen content video Streaming media Video coding Video compression
ISSN:	1520-9210, 1941-0077
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Abstract	To improve the compression performance of screen content coding, extension coding standards (HEVC-SCC, VVC-SCC) have been developed. However, considering the compression ratio alone may lead to packet losses in bitstreams which may cause plenty of images decoded incorrectly, degrading the video quality at the receiver side. Thus, it urgently needs to study source-channel jointly coding scheme of screen content video. The most significant challenge lies in the complex spatial-temporal characteristics of screen content video, which complicate the creation of an accurate end-to-end distortion model. In this article, we delve into the traits of screen content video and construct an end-to-end distortion model. Building upon this, we introduce an error resilient coding scheme specifically for screen content video. More specifically, we first consider the characteristic of non-stationary temporal domain variation and classify the screen content images into three types of frames using a fast block-searching method. We then propose an adaptive error concealment method, taking into account the spatial-temporal prediction characteristics. Following this, we derive a pixel-level end-to-end distortion model and incorporate it into the rate distortion optimization process. Our experimental results reveal that, compared to state-of-the-art methods, our proposed method significantly enhances both objective and subjective quality across a variety of channel conditions.
AbstractList	To improve the compression performance of screen content coding, extension coding standards (HEVC-SCC, VVC-SCC) have been developed. However, considering the compression ratio alone may lead to packet losses in bitstreams which may cause plenty of images decoded incorrectly, degrading the video quality at the receiver side. Thus, it urgently needs to study source-channel jointly coding scheme of screen content video. The most significant challenge lies in the complex spatial-temporal characteristics of screen content video, which complicate the creation of an accurate end-to-end distortion model. In this article, we delve into the traits of screen content video and construct an end-to-end distortion model. Building upon this, we introduce an error resilient coding scheme specifically for screen content video. More specifically, we first consider the characteristic of non-stationary temporal domain variation and classify the screen content images into three types of frames using a fast block-searching method. We then propose an adaptive error concealment method, taking into account the spatial-temporal prediction characteristics. Following this, we derive a pixel-level end-to-end distortion model and incorporate it into the rate distortion optimization process. Our experimental results reveal that, compared to state-of-the-art methods, our proposed method significantly enhances both objective and subjective quality across a variety of channel conditions.
Author	Wu, Dapeng Wang, Ruyan Yin, Zhiyang Tang, Tong Wang, Honggang Li, Jie
Author_xml	– sequence: 1 givenname: Tong orcidid: 0000-0003-0616-2003 surname: Tang fullname: Tang, Tong email: tangtong@cqupt.edu.cn organization: School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, China – sequence: 2 givenname: Zhiyang orcidid: 0009-0005-7606-2309 surname: Yin fullname: Yin, Zhiyang email: yzy2022@gmail.com organization: School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, China – sequence: 3 givenname: Jie orcidid: 0009-0005-8975-9156 surname: Li fullname: Li, Jie email: lijie0093@gmail.com organization: School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, China – sequence: 4 givenname: Honggang surname: Wang fullname: Wang, Honggang email: hwang1@umassed.edu organization: Electrical and Computer Engineering Department, University of Massachusetts Dartmouth, North Dartmouth, MA, USA – sequence: 5 givenname: Dapeng orcidid: 0000-0003-2105-9418 surname: Wu fullname: Wu, Dapeng email: wudp@cqupt.edu.cn organization: School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, China – sequence: 6 givenname: Ruyan orcidid: 0000-0003-3109-4807 surname: Wang fullname: Wang, Ruyan email: wangry@cqupt.edu.cn organization: School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, China
BookMark	eNp9kL1PwzAQxS0EEm1hZ2CIxJxyduI4HlEpH1ILEhRWy0kuyFWxi-0O_Pc4agfEwHR3ut-703tjcmydRUIuKEwpBXm9Wi6nDFgxLQpW1JIfkRGVJc0BhDhOPWeQS0bhlIxDWAPQkoMYkae57fLo8lSyWxOi89E4my1dhxtjP7Le-WzuvfP5CwazMWhj9tp6RJvNnI3D-G46dGnqEn9GTnq9CXh-qBPydjdfzR7yxfP94-xmkbdMspizDnpJq7LSRcMFCCoq1IXmHFnJONZcYlOjbkXXAqVcy6bs0h5aBK2hwWJCrvZ3t9597TBEtXY7b9NLxWQpSki2IVHVnmq9C8Fjr1oT9WAwem02ioIaslMpOzVkpw7ZJSH8EW69-dT--z_J5V5iEPEXzmrOE_IDmpd7Og
CODEN	ITMUF8
CitedBy_id	crossref_primary_10_3390_wevj15010018 crossref_primary_10_3390_electronics14020221 crossref_primary_10_3389_feart_2024_1364209 crossref_primary_10_1109_TMM_2025_3535367 crossref_primary_10_3390_s24144711
Cites_doi	10.1109/SSP.2016.7551806 10.1109/SSD54932.2022.9955746 10.1109/VCIP.2015.7457809 10.1109/TIP.2022.3224876 10.1109/TBC.2018.2878360 10.1109/TC.2019.2946795 10.1109/ICSIP55141.2022.9886385 10.1109/ICIP42928.2021.9506399 10.1109/TCE.2021.3069464 10.1109/TIP.2022.3152003 10.1109/ICIP.2018.8451175 10.1109/TBC.2020.3028340 10.1109/ICIP40778.2020.9191038 10.1109/TCSVT.2021.3064210 10.1109/TMM.2019.2957991 10.1109/IEEECONF51394.2020.9443375 10.1109/TCSVT.2019.2927912 10.1109/TMM.2008.2001354 10.1109/ITW48936.2021.9611448 10.1109/TCSVT.2019.2909564 10.1109/TCSVT.2018.2877903 10.1109/TIP.2020.3018256 10.3390/app10144923 10.1109/TMM.2006.887989 10.1109/ICCSS53909.2021.9722004 10.1109/TCSVT.2018.2879956 10.1002/9781118693803.ch4 10.1109/TMM.2021.3066050 10.1109/JIOT.2022.3143506 10.1109/ICCE.2018.8326287 10.1109/TIP.2020.3043124 10.1109/TCSVT.2018.2851252 10.1109/TCSVT.2017.2657758 10.1109/PCS.2018.8456257 10.1109/TBC.2018.2865644 10.1109/ACCESS.2018.2879867 10.1109/TMM.2017.2758578 10.1109/HNICEM48295.2019.9073471
ContentType	Journal Article
Copyright	Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024
Copyright_xml	– notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024
DBID	97E RIA RIE AAYXX CITATION 7SC 7SP 8FD JQ2 L7M L~C L~D
DOI	10.1109/TMM.2023.3323895
DatabaseName	IEEE Xplore (IEEE) IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE Electronic Library (IEL) CrossRef Computer and Information Systems Abstracts Electronics & Communications Abstracts Technology Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional
DatabaseTitle	CrossRef Technology Research Database Computer and Information Systems Abstracts – Academic Electronics & Communications Abstracts ProQuest Computer Science Collection Computer and Information Systems Abstracts Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Professional
DatabaseTitleList	Technology Research Database
Database_xml	– sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://ieeexplore.ieee.org/ sourceTypes: Publisher
DeliveryMethod	fulltext_linktorsrc
Discipline	Engineering Computer Science
EISSN	1941-0077
EndPage	4468
ExternalDocumentID	10_1109_TMM_2023_3323895 10285532
Genre	orig-research
GrantInformation_xml	– fundername: National Natural Science Foundation of China grantid: U20A20157; 61771082; 62271096; 61871062 funderid: 10.13039/501100001809 – fundername: Science and Technology Research Program of Chongqing Municipal Education Commission grantid: KJQN202300632 – fundername: Key projects for technological innovation and application development grantid: CSTB2022TIAD-KPX0067 – fundername: Youth Innovation Group Support Program of ICE Discipline of CQUPT grantid: SCIE-QN-2022-04 – fundername: University Innovation Research Group of Chongqing grantid: CXQT20017 – fundername: Chongqing Postdoctoral Special Funding grantid: 2022CQBSHTB2057
GroupedDBID	-~X 0R~ 29I 4.4 5GY 5VS 6IK 97E AAJGR AARMG AASAJ AAWTH ABAZT ABQJQ ABVLG ACGFO ACGFS ACIWK AENEX AETIX AGQYO AGSQL AHBIQ AI. AIBXA AKJIK AKQYR ALLEH ALMA_UNASSIGNED_HOLDINGS ATWAV BEFXN BFFAM BGNUA BKEBE BPEOZ CS3 DU5 EBS EJD HZ~ H~9 IFIPE IFJZH IPLJI JAVBF LAI M43 O9- OCL P2P PQQKQ RIA RIE RNS TN5 VH1 ZY4 AAYXX CITATION 7SC 7SP 8FD JQ2 L7M L~C L~D
ID	FETCH-LOGICAL-c292t-2d0f91646a3b5707176ea3a55e2425e859eb8eac7dc0115a9b4da3a0ce0aa0be3
IEDL.DBID	RIE
ISICitedReferencesCount	8
ISICitedReferencesURI	http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001181498100011&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN	1520-9210
IngestDate	Sun Nov 30 05:08:48 EST 2025 Sat Nov 29 03:10:12 EST 2025 Tue Nov 18 22:18:28 EST 2025 Wed Aug 27 02:12:37 EDT 2025
IsPeerReviewed	true
IsScholarly	true
Language	English
License	https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html https://doi.org/10.15223/policy-029 https://doi.org/10.15223/policy-037
LinkModel	DirectLink
MergedId	FETCHMERGED-LOGICAL-c292t-2d0f91646a3b5707176ea3a55e2425e859eb8eac7dc0115a9b4da3a0ce0aa0be3
Notes	ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14
ORCID	0009-0005-7606-2309 0000-0003-2105-9418 0000-0003-3109-4807 0000-0003-0616-2003 0009-0005-8975-9156
PQID	2947400070
PQPubID	75737
PageCount	11
ParticipantIDs	proquest_journals_2947400070 crossref_citationtrail_10_1109_TMM_2023_3323895 ieee_primary_10285532 crossref_primary_10_1109_TMM_2023_3323895
PublicationCentury	2000
PublicationDate	20240000 2024-00-00 20240101
PublicationDateYYYYMMDD	2024-01-01
PublicationDate_xml	– year: 2024 text: 20240000
PublicationDecade	2020
PublicationPlace	Piscataway
PublicationPlace_xml	– name: Piscataway
PublicationTitle	IEEE transactions on multimedia
PublicationTitleAbbrev	TMM
PublicationYear	2024
Publisher	IEEE The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml	– name: IEEE – name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References	ref13 ref35 ref12 ref34 ref15 ref37 ref14 ref36 ref31 ref30 ref11 ref33 ref10 ref32 (ref38) 2023 (ref41) 2023 ref2 ref1 ref17 ref16 ref19 ref18 ref24 Yu (ref39) 2014 ref23 ref26 ref25 ref20 ref22 ref21 Bjntegaard (ref42) 2001 ref28 ref27 ref29 ref8 ref7 ref9 ref4 ref3 ref6 ref5 ref40
References_xml	– ident: ref28 doi: 10.1109/SSP.2016.7551806 – ident: ref5 doi: 10.1109/SSD54932.2022.9955746 – ident: ref36 doi: 10.1109/VCIP.2015.7457809 – ident: ref37 doi: 10.1109/TIP.2022.3224876 – ident: ref26 doi: 10.1109/TBC.2018.2878360 – ident: ref6 doi: 10.1109/TC.2019.2946795 – ident: ref15 doi: 10.1109/ICSIP55141.2022.9886385 – ident: ref20 doi: 10.1109/ICIP42928.2021.9506399 – ident: ref31 doi: 10.1109/TCE.2021.3069464 – ident: ref2 doi: 10.1109/TIP.2022.3152003 – ident: ref21 doi: 10.1109/ICIP.2018.8451175 – ident: ref27 doi: 10.1109/TBC.2020.3028340 – ident: ref12 doi: 10.1109/ICIP40778.2020.9191038 – ident: ref3 doi: 10.1109/TCSVT.2021.3064210 – ident: ref10 doi: 10.1109/TMM.2019.2957991 – ident: ref16 doi: 10.1109/IEEECONF51394.2020.9443375 – ident: ref13 doi: 10.1109/TCSVT.2019.2927912 – ident: ref35 doi: 10.1109/TMM.2008.2001354 – ident: ref40 doi: 10.1109/ITW48936.2021.9611448 – year: 2023 ident: ref41 article-title: Video coding utilities (VCU) – ident: ref11 doi: 10.1109/TCSVT.2019.2909564 – ident: ref17 doi: 10.1109/TCSVT.2018.2877903 – ident: ref4 doi: 10.1109/TIP.2020.3018256 – ident: ref30 doi: 10.3390/app10144923 – ident: ref29 doi: 10.1109/TMM.2006.887989 – year: 2023 ident: ref38 article-title: HM reference software 16.7 – year: 2014 ident: ref39 article-title: Common test condition for screen content coding – ident: ref33 doi: 10.1109/ICCSS53909.2021.9722004 – ident: ref7 doi: 10.1109/TCSVT.2018.2879956 – ident: ref18 doi: 10.1002/9781118693803.ch4 – ident: ref34 doi: 10.1109/TMM.2021.3066050 – ident: ref14 doi: 10.1109/JIOT.2022.3143506 – ident: ref25 doi: 10.1109/ICCE.2018.8326287 – ident: ref24 doi: 10.1109/TIP.2020.3043124 – ident: ref23 doi: 10.1109/TCSVT.2018.2851252 – ident: ref1 doi: 10.1109/TCSVT.2017.2657758 – ident: ref8 doi: 10.1109/PCS.2018.8456257 – ident: ref19 doi: 10.1109/TBC.2018.2865644 – ident: ref22 doi: 10.1109/ACCESS.2018.2879867 – year: 2001 ident: ref42 article-title: Calculation of average PSNR differences between RD-curves – ident: ref9 doi: 10.1109/TMM.2017.2758578 – ident: ref32 doi: 10.1109/HNICEM48295.2019.9073471
SSID	ssj0014507
Score	2.447083
Snippet	To improve the compression performance of screen content coding, extension coding standards (HEVC-SCC, VVC-SCC) have been developed. However, considering the...
SourceID	proquest crossref ieee
SourceType	Aggregation Database Enrichment Source Index Database Publisher
StartPage	4458
SubjectTerms	Coding Coding standards Compression ratio Decoding Distortion distortion modeling Encoding error concealment error resilient coding Errors Estimation Image coding Image quality Screen content video Streaming media Video coding Video compression
Title	End-to-End Distortion Modeling for Error-Resilient Screen Content Video Coding
URI	https://ieeexplore.ieee.org/document/10285532 https://www.proquest.com/docview/2947400070
Volume	26
WOSCitedRecordID	wos001181498100011&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText	1
inHoldings	1
isFullTextHit
isPrint
journalDatabaseRights	– providerCode: PRVIEE databaseName: IEEE Electronic Library (IEL) customDbUrl: eissn: 1941-0077 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0014507 issn: 1520-9210 databaseCode: RIE dateStart: 19990101 isFulltext: true titleUrlDefault: https://ieeexplore.ieee.org/ providerName: IEEE
link	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3PT8IwFG6UeNCDKGJE0ezgxUOhdC1dj0YhHoQYg4TbsrVvCQlhZoB_v33dICRGE09bs7Zp9rXvR9v3PkLuE-cyODEnaBRpQ4VhmqZSZxQM56pn-1nkOZamr2o8jmYz_VYFq_tYGADwl8-gg6_-LN_mZoNbZV1UhlKGTuIeKtUvg7V2RwZC-thop48Y1c6R2Z5JMt2djEYdpAnvhKHTUEglsaeDPKnKD0ns1cuw_s-BnZHTyo4MHkvgz8kBLBukvuVoCKol2yAnewkHL8h4sLR0nVP3CJ59ghDEJUBCNAxLD5wFGwyKIi_oO6zmC4yVdF3h1ZzAp7FyxencQu5KqPOa5GM4mDy90IpRgRqu-ZpyyzKNGcWSMJUKXbk-JGEiJaDnAZHUkEZOFCtr0FRMdCqs-84MsCRhKYSXpLbMl3BFAqUzpUGmgotQKOglkmU9biSX3IbaZi3S3f7j2FTpxpH1YhF7t4Pp2KESIypxhUqLPOxafJapNv6o20QU9uqVALRIe4tjXC3GVeymohJoDLHrX5rdkGPXuyi3Vtqkti42cEuOzNd6viru_Dz7BsZZzgk
linkProvider	IEEE
linkToHtml	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3PS8MwFH6ICurB6VScTu3Bi4dsWZrY5ig6UdyGyBRvpU1eYTBW6aZ_v3lZNwai4KkNTZrSL3k_krz3AVymzmVwYk6yONaGScM1y5TOGRohoo69zmPPsfTWiwaD-P1dP1fB6j4WBhH94TNs0a3fy7eF-aSlsjYpQ6VCJ3E3iDqrCtdabhpI5aOjnUbiTDtXZrEryXV72O-3iCi8FYZORxGZxIoW8rQqP2SxVzD3tX9-2h7sVpZkcDOHfh_WcFKH2oKlIagmbR12VlIOHsCgO7FsVjB3Ce58ihBCJiBKNApMD5wNG3TLsijZC05HY4qWdK-iwzmBT2Tlim8ji4UrkdY7hNf77vD2gVWcCswILWZMWJ5ryimWhpmKyJm7xjRMlULyPTBWGrPYCePIGjIWU51J655zgzxNeYbhEaxPigkeQxDpPNKoMilkKCPspIrnHWGUUMKG2uYNaC_-cWKqhOPEezFOvOPBdeJQSQiVpEKlAVfLFh_zZBt_1D0kFFbqzQFoQHOBY1JNx2niBmMkyRziJ780u4Cth2G_l_QeB0-nsO16kvOFliasz8pPPINN8zUbTctzP-a-Aa3x0VI
openUrl	ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=End-to-End+Distortion+Modeling+for+Error-Resilient+Screen+Content+Video+Coding&rft.jtitle=IEEE+transactions+on+multimedia&rft.au=Tang%2C+Tong&rft.au=Yin%2C+Zhiyang&rft.au=Li%2C+Jie&rft.au=Wang%2C+Honggang&rft.date=2024&rft.pub=IEEE&rft.issn=1520-9210&rft.volume=26&rft.spage=4458&rft.epage=4468&rft_id=info:doi/10.1109%2FTMM.2023.3323895&rft.externalDocID=10285532
thumbnail_l	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1520-9210&client=summon
thumbnail_m	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1520-9210&client=summon
thumbnail_s	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1520-9210&client=summon