Decoding-Energy-Rate-Distortion Optimization for Video Coding

This paper presents a method for generating coded video bit streams requiring less decoding energy than conventionally coded bit streams. To this end, we propose extending the standard rate-distortion optimization approach to also consider the decoding energy. In the encoder, the decoding energy is...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Veröffentlicht in:	IEEE transactions on circuits and systems for video technology Jg. 29; H. 1; S. 171 - 182
Hauptverfasser:	Herglotz, Christian, Heindel, Andreas, Kaup, Andre
Format:	Journal Article
Sprache:	Englisch
Veröffentlicht:	New York IEEE 01.01.2019 The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Schlagworte:	Codec Decoding decoding energy Distortion Encoding Energy Energy costs energy model Hardware HEVC Optimization Parameters Random access memory rate-distortion optimization Software Streams Video compression
ISSN:	1051-8215, 1558-2205
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Abstract	This paper presents a method for generating coded video bit streams requiring less decoding energy than conventionally coded bit streams. To this end, we propose extending the standard rate-distortion optimization approach to also consider the decoding energy. In the encoder, the decoding energy is estimated during runtime using a feature-based energy model. These energy estimates are then used to calculate decoding-energy-rate-distortion costs that are minimized by the encoder. This ultimately leads to optimal tradeoffs between these three parameters. Therefore, we introduce the mathematical theory for describing decoding-energy-rate-distortion optimization and the proposed encoder algorithm is explained in detail. For rate-energy control, a new encoder parameter is introduced. Finally, measurements of the software decoding process for HEVC-coded bit streams are performed. Results show that this approach can lead to up to 30% of decoding energy reduction at a constant visual objective quality when accepting a bit rate increase at the same order of magnitude.
AbstractList	This paper presents a method for generating coded video bit streams requiring less decoding energy than conventionally coded bit streams. To this end, we propose extending the standard rate-distortion optimization approach to also consider the decoding energy. In the encoder, the decoding energy is estimated during runtime using a feature-based energy model. These energy estimates are then used to calculate decoding-energy-rate-distortion costs that are minimized by the encoder. This ultimately leads to optimal tradeoffs between these three parameters. Therefore, we introduce the mathematical theory for describing decoding-energy-rate-distortion optimization and the proposed encoder algorithm is explained in detail. For rate-energy control, a new encoder parameter is introduced. Finally, measurements of the software decoding process for HEVC-coded bit streams are performed. Results show that this approach can lead to up to 30% of decoding energy reduction at a constant visual objective quality when accepting a bit rate increase at the same order of magnitude.
Author	Kaup, Andre Herglotz, Christian Heindel, Andreas
Author_xml	– sequence: 1 givenname: Christian orcidid: 0000-0001-8975-0171 surname: Herglotz fullname: Herglotz, Christian email: christian.herglotz@fau.de organization: Chair of Multimedia Communications and Signal Processing, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany – sequence: 2 givenname: Andreas orcidid: 0000-0003-2029-3755 surname: Heindel fullname: Heindel, Andreas email: andreas.heindel@fau.de organization: Chair of Multimedia Communications and Signal Processing, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany – sequence: 3 givenname: Andre orcidid: 0000-0002-0929-5074 surname: Kaup fullname: Kaup, Andre email: andre.kaup@fau.de organization: Chair of Multimedia Communications and Signal Processing, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
BookMark	eNp9kEtPAjEQgBuDiYD-Ab2QeC52uu22e_BgAB8JCYki16bszpIS2GK3HPDXuyzEgwdPM5PMN4-vRzqVr5CQW2BDAJY9zEcfi_mQM1BDrhRoyC5IF6TUlHMmO03OJFDNQV6RXl2vGQOhheqSxzHmvnDVik4qDKsDfbcR6djV0YfofDWY7aLbum_bFqUPg4Ur0A9GLXRNLku7qfHmHPvk83kyH73S6ezlbfQ0pTnPZKQ8K61NC5UIwWyZohRZClpyUSrLrFAshcwKzLiQqU2BY7FURV5yaznXDJdJn9yf5u6C_9pjHc3a70PVrDQcUqFBNl82XfrUlQdf1wFLk7vYHh6DdRsDzBxlmVaWOcoyZ1kNyv-gu-C2Nhz-h-5OkEPEX0ADS5gUyQ_6v3bD
CODEN	ITCTEM
CitedBy_id	crossref_primary_10_1109_MCAS_2023_3234739 crossref_primary_10_1109_ACCESS_2020_2986580 crossref_primary_10_1109_TMM_2018_2876044 crossref_primary_10_1109_JETCAS_2025_3533041 crossref_primary_10_1016_j_jnca_2022_103564 crossref_primary_10_1109_TCSVT_2021_3130739 crossref_primary_10_1109_TIP_2023_3346695 crossref_primary_10_1109_JETCAS_2025_3540360 crossref_primary_10_1109_MCE_2023_3347714 crossref_primary_10_1109_ACCESS_2024_3434682 crossref_primary_10_1109_TCE_2021_3122076 crossref_primary_10_1109_JETCAS_2025_3539948 crossref_primary_10_1155_2022_2455782
Cites_doi	10.1109/TMM.2005.846790 10.1109/TCE.2014.6937333 10.1109/PCS.2016.7906400 10.1109/VCIP.2013.6706445 10.1109/GCCE.2013.6664837 10.1109/TMM.2011.2177079 10.1137/0806023 10.1109/ICASSP.2005.1415611 10.1109/DASIP.2014.7115632 10.1109/ICIP.2014.7025421 10.1109/TCSVT.2005.846433 10.1109/TCSVT.2016.2598705 10.1016/j.image.2004.06.004 10.1109/TIT.1968.1054193 10.1109/MMSP.2007.4412832 10.1109/TCSVT.2011.2133750 10.1109/79.733497 10.1109/ICDCS.2014.13 10.1109/TCSVT.2012.2221192 10.1016/j.image.2004.05.007 10.1109/JSTSP.2013.2270429 10.1109/ICMEW.2013.6618340 10.1109/ICIP.2014.7025423 10.1109/ICIP.2016.7532416 10.1109/TCSVT.2009.2026810 10.1109/IWSSIP.2013.6623457 10.1109/29.90373
ContentType	Journal Article
Copyright	Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2019
Copyright_xml	– notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2019
DBID	97E RIA RIE AAYXX CITATION 7SC 7SP 8FD JQ2 L7M L~C L~D
DOI	10.1109/TCSVT.2017.2771819
DatabaseName	IEEE Xplore (IEEE) IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE Electronic Library (IEL) CrossRef Computer and Information Systems Abstracts Electronics & Communications Abstracts Technology Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional
DatabaseTitle	CrossRef Technology Research Database Computer and Information Systems Abstracts – Academic Electronics & Communications Abstracts ProQuest Computer Science Collection Computer and Information Systems Abstracts Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Professional
DatabaseTitleList	Technology Research Database
Database_xml	– sequence: 1 dbid: RIE name: IEEE Xplore Digital Library url: https://ieeexplore.ieee.org/ sourceTypes: Publisher
DeliveryMethod	fulltext_linktorsrc
Discipline	Engineering
EISSN	1558-2205
EndPage	182
ExternalDocumentID	10_1109_TCSVT_2017_2771819 8103054
Genre	orig-research
GrantInformation_xml	– fundername: Deutsche Forschungsgemeinschaft funderid: 10.13039/501100001659
GroupedDBID	-~X 0R~ 29I 4.4 5GY 5VS 6IK 97E AAJGR AARMG AASAJ AAWTH ABAZT ABQJQ ABVLG ACGFO ACGFS ACIWK AENEX AETIX AGQYO AGSQL AHBIQ AI. AIBXA AKJIK AKQYR ALLEH ALMA_UNASSIGNED_HOLDINGS ASUFR ATWAV BEFXN BFFAM BGNUA BKEBE BPEOZ CS3 DU5 EBS EJD HZ~ H~9 ICLAB IFIPE IFJZH IPLJI JAVBF LAI M43 O9- OCL P2P RIA RIE RNS RXW TAE TN5 VH1 AAYXX CITATION 7SC 7SP 8FD JQ2 L7M L~C L~D
ID	FETCH-LOGICAL-c295t-29faa6d73440af6e549618524f7a0a470619a4e92456a612edb7dcf2aa2280eb3
IEDL.DBID	RIE
ISICitedReferencesCount	38
ISICitedReferencesURI	http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000455706400014&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN	1051-8215
IngestDate	Sun Nov 09 07:05:06 EST 2025 Sat Nov 29 01:44:11 EST 2025 Tue Nov 18 21:41:07 EST 2025 Wed Aug 27 02:56:15 EDT 2025
IsPeerReviewed	true
IsScholarly	true
Issue	1
Language	English
License	https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html https://doi.org/10.15223/policy-029 https://doi.org/10.15223/policy-037
LinkModel	DirectLink
MergedId	FETCHMERGED-LOGICAL-c295t-29faa6d73440af6e549618524f7a0a470619a4e92456a612edb7dcf2aa2280eb3
Notes	ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14
ORCID	0000-0003-2029-3755 0000-0001-8975-0171 0000-0002-0929-5074
PQID	2164815205
PQPubID	85433
PageCount	12
ParticipantIDs	crossref_citationtrail_10_1109_TCSVT_2017_2771819 proquest_journals_2164815205 ieee_primary_8103054 crossref_primary_10_1109_TCSVT_2017_2771819
PublicationCentury	2000
PublicationDate	2019-Jan. 2019-1-00 20190101
PublicationDateYYYYMMDD	2019-01-01
PublicationDate_xml	– month: 01 year: 2019 text: 2019-Jan.
PublicationDecade	2010
PublicationPlace	New York
PublicationPlace_xml	– name: New York
PublicationTitle	IEEE transactions on circuits and systems for video technology
PublicationTitleAbbrev	TCSVT
PublicationYear	2019
Publisher	IEEE The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml	– name: IEEE – name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References	ref35 ref12 ref37 ref15 ref14 ref31 ref30 ref33 ref11 ref32 ref10 (ref7) 2017 (ref3) 2013 (ref39) 2017 (ref19) 2017 ref17 (ref44) 2016 ref16 (ref2) 2003 pouwelse (ref23) 2001 (ref18) 2017 ref24 carroll (ref4) 2013 ref25 berger (ref36) 1971 ref20 ref42 ref41 ref22 ref21 ref43 herglotz (ref45) 2017 (ref6) 0 (ref1) 2017 ref28 ref27 kalali (ref13) 2012 ref29 ref8 ref9 bossen (ref40) 2013 li (ref34) 2013 ref5 pakdeepaiboonpol (ref26) 2005 bjøntegaard (ref38) 2001
References_xml	– ident: ref28 doi: 10.1109/TMM.2005.846790 – ident: ref9 doi: 10.1109/TCE.2014.6937333 – ident: ref12 doi: 10.1109/PCS.2016.7906400 – ident: ref31 doi: 10.1109/VCIP.2013.6706445 – ident: ref16 doi: 10.1109/GCCE.2013.6664837 – ident: ref17 doi: 10.1109/TMM.2011.2177079 – year: 2016 ident: ref44 publication-title: PandaBoard – ident: ref42 doi: 10.1137/0806023 – ident: ref24 doi: 10.1109/ICASSP.2005.1415611 – start-page: 1 year: 2001 ident: ref23 article-title: Power-aware video decoding publication-title: Proc 22nd Picture Coding Symp – year: 2013 ident: ref40 publication-title: Common Test Conditions and Software Reference Configurations – start-page: 1 year: 2012 ident: ref13 article-title: A high performance and low energy intra prediction hardware for HEVC video decoding publication-title: Proc Conf Design Archit Signal Image Process (DASIP) – year: 2001 ident: ref38 publication-title: Calculation of average PSNR differences between RD curves – ident: ref27 doi: 10.1109/DASIP.2014.7115632 – ident: ref14 doi: 10.1109/ICIP.2014.7025421 – year: 1971 ident: ref36 publication-title: Rate Distortion Theory A Mathematical Basis for Data Compression – ident: ref21 doi: 10.1109/TCSVT.2005.846433 – year: 2017 ident: ref18 publication-title: FFMPEG – start-page: 1 year: 2005 ident: ref26 article-title: Energy optimization for mobile MPEG-4 video decoder publication-title: Proc 2nd Int Conf Mobile Technol Appl Syst – year: 2013 ident: ref3 publication-title: High Efficiency Video Coding – ident: ref32 doi: 10.1109/TCSVT.2016.2598705 – ident: ref25 doi: 10.1016/j.image.2004.06.004 – ident: ref35 doi: 10.1109/TIT.1968.1054193 – start-page: 477 year: 2013 ident: ref34 article-title: QP refinement according to Lagrange multiplier for High Efficiency Video Coding publication-title: Proc IEEE Int Symp Circuits Syst (ISCAS) – ident: ref30 doi: 10.1109/MMSP.2007.4412832 – year: 2017 ident: ref1 publication-title: Cisco Visual Networking Index Global Mobile Data Traffic Forecast Update – ident: ref20 doi: 10.1109/TCSVT.2011.2133750 – ident: ref5 doi: 10.1109/79.733497 – year: 2017 ident: ref45 publication-title: Decoding Energy Estimation Tool (DENESTO) – year: 2003 ident: ref2 publication-title: Advanced video coding for generic audio-visual services – ident: ref11 doi: 10.1109/ICDCS.2014.13 – ident: ref43 doi: 10.1109/TCSVT.2012.2221192 – ident: ref29 doi: 10.1016/j.image.2004.05.007 – ident: ref37 doi: 10.1109/JSTSP.2013.2270429 – ident: ref33 doi: 10.1109/ICMEW.2013.6618340 – start-page: 1 year: 2013 ident: ref4 article-title: The systems hacker's guide to the galaxy energy usage in a modern smartphone publication-title: Proc 4th Asia-Pacific Workshop Syst (APSys) – year: 2017 ident: ref39 publication-title: Encoder for Decoding Energy Saving HEVC-Bit Streams – ident: ref15 doi: 10.1109/ICIP.2014.7025423 – year: 2017 ident: ref7 publication-title: H 264/AVC Reference Software – ident: ref10 doi: 10.1109/ICIP.2016.7532416 – year: 0 ident: ref6 publication-title: Joint Collaborative Team on Video Coding HEVC Test Model Reference Software (HM) – ident: ref22 doi: 10.1109/TCSVT.2009.2026810 – year: 2017 ident: ref19 publication-title: libde265 HEVC – ident: ref41 doi: 10.1109/IWSSIP.2013.6623457 – ident: ref8 doi: 10.1109/29.90373
SSID	ssj0014847
Score	2.4436238
Snippet	This paper presents a method for generating coded video bit streams requiring less decoding energy than conventionally coded bit streams. To this end, we...
SourceID	proquest crossref ieee
SourceType	Aggregation Database Enrichment Source Index Database Publisher
StartPage	171
SubjectTerms	Codec Decoding decoding energy Distortion Encoding Energy Energy costs energy model Hardware HEVC Optimization Parameters Random access memory rate-distortion optimization Software Streams Video compression
Title	Decoding-Energy-Rate-Distortion Optimization for Video Coding
URI	https://ieeexplore.ieee.org/document/8103054 https://www.proquest.com/docview/2164815205
Volume	29
WOSCitedRecordID	wos000455706400014&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText	1
inHoldings	1
isFullTextHit
isPrint
journalDatabaseRights	– providerCode: PRVIEE databaseName: IEEE Xplore Digital Library customDbUrl: eissn: 1558-2205 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0014847 issn: 1051-8215 databaseCode: RIE dateStart: 19910101 isFulltext: true titleUrlDefault: https://ieeexplore.ieee.org/ providerName: IEEE
link	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LT8MwDLa2iQMceA3EYKAeuEG2PtKkOXBAYxOngWBMu1Vp60iTYEN78Ptxsm6aBELi1kNcVZ9T-3Mc2wDXtCmKPIo4M0LEjCPGTCfSsDDCUAk0WovCDZuQ_X4yGqnnCtxuamEQ0V0-w5Z9dLn8Ypov7VFZO7EzsWJehaqUYlWrtckY8MQNEyO6ELCE_Ni6QMZX7UHndTiwt7hkK5Rki21XnS0n5Kaq_DDFzr_0Dv73ZYewX_JI736l-COo4OQY9ra6C9bh7oFCS-uaWNcV-LEX4pXswfUFserwnshcfJR1mB6RV284LnDqdZzQCbz1uoPOIyunJbA8VPGChcoBKyPOfW0EUuAnbGU0N1L7mkty3EpzVDbTqYnXYJHJIjeh1rYjDsXUp1CbTCd4Bl6WBz6qhJhWZnhsYvJiAnPuG5HwwGRZA4I1fGlethK3Ey3eUxdS-Cp1kKcW8rSEvAE3G5nPVSONP1fXLciblSW-DWiutZSW_9o8DSniS4iG-PH571IXsEvvVquDkybUFrMlXsJO_rUYz2dXbht9Azsbw7Q
linkProvider	IEEE
linkToHtml	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LS8NAEB5qFdSDryrWZw7edNsk3Tz24EH6oGKtorX0FjbJLBS0lT78_c5u01BQBG857JLwzWbmm92d-QCuaFGkSa3GmfJ9j3FEj8kwUMytoSt8VFL6qRGbCLrdcDAQzwW4yWthENFcPsOKfjRn-ek4meutsmqoNbE8vgbrWjkrq9bKzwx4aOTEiDA4LKRItiyRsUW1V3_t9_Q9rqDiBuSNdV-dlTBkdFV-OGMTYVq7__u2PdjJmKR1tzD9PhRwdADbK_0FS3DboORSByfWNCV-7IWYJWuYziDaINYTOYyPrBLTIvpq9Ycpjq26mXQIb61mr95mmV4CS1zhzZgrDLRBjXNbKh8p9fN1bTRXgbQlDyh0C8lR6LNOScwG0zhIE-VKqXviUFZ9BMXReITHYMWJY6MIiWvFinvKozjmY8Jt5YfcUXFcBmcJX5RkzcS1psV7ZJIKW0QG8khDHmWQl-E6n_O5aKXx5-iSBjkfmeFbhrOllaLsb5tGLuV8IRER2zv5fdYlbLZ7j52oc999OIUteo9YbKOcQXE2meM5bCRfs-F0cmGW1DebOcb9
openUrl	ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Decoding-Energy-Rate-Distortion+Optimization+for+Video+Coding&rft.jtitle=IEEE+transactions+on+circuits+and+systems+for+video+technology&rft.au=Herglotz%2C+Christian&rft.au=Heindel%2C+Andreas&rft.au=Kaup%2C+Andre&rft.date=2019-01-01&rft.pub=IEEE&rft.issn=1051-8215&rft.volume=29&rft.issue=1&rft.spage=171&rft.epage=182&rft_id=info:doi/10.1109%2FTCSVT.2017.2771819&rft.externalDocID=8103054
thumbnail_l	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1051-8215&client=summon
thumbnail_m	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1051-8215&client=summon
thumbnail_s	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1051-8215&client=summon