A Fast HEVC Encoding Method Using Depth Information of Collocated CUs and RD Cost Characteristics of PU Modes

The latest video coding standard, high efficiency video coding (HEVC), aims to achieve better coding efficiency than the H.264/AVC standard. To improve the coding performance of HEVC, tools and structures are included that also increase the computational complexity of encoding, especially for the mo...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on broadcasting Vol. 63; no. 4; pp. 680 - 692
Main Authors: Tai, Kuang-Han, Hsieh, Min-Yuan, Chen, Mei-Juan, Chen, Chia-Yen, Yeh, Chia-Hung
Format: Journal Article
Language:English
Published: New York IEEE 01.12.2017
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:
Algorithms
Coding
Coding standards
coding unit
Computation
Computational complexity
Computer programs
Correlation
Cost analysis
Cost control
Costs
Delay
Delays
early termination
Encoding
HEVC encoder
mode decision
Motion simulation
Prediction algorithms
prediction unit
Quantization (signal)
Random access
rate-distortion cost
Video compression
ISSN:0018-9316, 1557-9611
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract The latest video coding standard, high efficiency video coding (HEVC), aims to achieve better coding efficiency than the H.264/AVC standard. To improve the coding performance of HEVC, tools and structures are included that also increase the computational complexity of encoding, especially for the mode decisions in the coding unit (CU), which is a structural element in the HEVC. For each CU size, the HEVC encoder performs mode decision and motion estimation using all prediction unit (PU) types and incurs massive computational burdens. In this paper, we investigate the depth correlation between the current and the collocated CU to avoid irrelevant CU procedure and truncate some PU predictions as a result. We also investigate the relationship of the rate-distortion (RD) costs after the Merge/SKIP prediction. By analyzing different CU sizes and quantization parameters, we build a mathematical model to represent the relationship for the RD costs after the Merge/SKIP prediction with an adaptive termination of the CU procedure. In addition, the relationship of the RD costs after the Merge/SKIP prediction and 2N\boldsymbol {\times }2\text{N} mode is also explored. Search range reduction is used to further speed up our algorithm. Experimental results show that our algorithm can reduce the coding time by up to 80%, and provide average coding time savings of 46%, 45%, and 52%, for low delay B, low delay P, and random access configurations, respectively. Moreover, the proposed algorithm is able to maintain coding performance similar to HM 11.0. The proposed scheme outperforms previous work in terms of both the coding speed and the RD performance.
AbstractList The latest video coding standard, high efficiency video coding (HEVC), aims to achieve better coding efficiency than the H.264/AVC standard. To improve the coding performance of HEVC, tools and structures are included that also increase the computational complexity of encoding, especially for the mode decisions in the coding unit (CU), which is a structural element in the HEVC. For each CU size, the HEVC encoder performs mode decision and motion estimation using all prediction unit (PU) types and incurs massive computational burdens. In this paper, we investigate the depth correlation between the current and the collocated CU to avoid irrelevant CU procedure and truncate some PU predictions as a result. We also investigate the relationship of the rate-distortion (RD) costs after the Merge/SKIP prediction. By analyzing different CU sizes and quantization parameters, we build a mathematical model to represent the relationship for the RD costs after the Merge/SKIP prediction with an adaptive termination of the CU procedure. In addition, the relationship of the RD costs after the Merge/SKIP prediction and 2N[Formula Omitted] mode is also explored. Search range reduction is used to further speed up our algorithm. Experimental results show that our algorithm can reduce the coding time by up to 80%, and provide average coding time savings of 46%, 45%, and 52%, for low delay B, low delay P, and random access configurations, respectively. Moreover, the proposed algorithm is able to maintain coding performance similar to HM 11.0. The proposed scheme outperforms previous work in terms of both the coding speed and the RD performance.
The latest video coding standard, high efficiency video coding (HEVC), aims to achieve better coding efficiency than the H.264/AVC standard. To improve the coding performance of HEVC, tools and structures are included that also increase the computational complexity of encoding, especially for the mode decisions in the coding unit (CU), which is a structural element in the HEVC. For each CU size, the HEVC encoder performs mode decision and motion estimation using all prediction unit (PU) types and incurs massive computational burdens. In this paper, we investigate the depth correlation between the current and the collocated CU to avoid irrelevant CU procedure and truncate some PU predictions as a result. We also investigate the relationship of the rate-distortion (RD) costs after the Merge/SKIP prediction. By analyzing different CU sizes and quantization parameters, we build a mathematical model to represent the relationship for the RD costs after the Merge/SKIP prediction with an adaptive termination of the CU procedure. In addition, the relationship of the RD costs after the Merge/SKIP prediction and 2N\boldsymbol {\times }2\text{N} mode is also explored. Search range reduction is used to further speed up our algorithm. Experimental results show that our algorithm can reduce the coding time by up to 80%, and provide average coding time savings of 46%, 45%, and 52%, for low delay B, low delay P, and random access configurations, respectively. Moreover, the proposed algorithm is able to maintain coding performance similar to HM 11.0. The proposed scheme outperforms previous work in terms of both the coding speed and the RD performance.
Author Kuang-Han Tai
Chia-Yen Chen
Mei-Juan Chen
Min-Yuan Hsieh
Chia-Hung Yeh
Author_xml – sequence: 1
  givenname: Kuang-Han
  surname: Tai
  fullname: Tai, Kuang-Han
– sequence: 2
  givenname: Min-Yuan
  surname: Hsieh
  fullname: Hsieh, Min-Yuan
– sequence: 3
  givenname: Mei-Juan
  orcidid: 0000-0003-3382-8296
  surname: Chen
  fullname: Chen, Mei-Juan
– sequence: 4
  givenname: Chia-Yen
  surname: Chen
  fullname: Chen, Chia-Yen
– sequence: 5
  givenname: Chia-Hung
  surname: Yeh
  fullname: Yeh, Chia-Hung
BookMark eNp9kMFPwjAUhxuDiYDeTbw08Tx8r2PresQBQiLRGPC6dG0nI7BiWw7-9w4hHjx4enkvv-_3kq9HOo1tDCG3CANEEA_Lx3zAAPmAccZYLC5IF5OERyJF7JAuAGaRiDG9Ij3vNwAQA7Au2Y3oVPpAZ5P3nE4aZXXdfNCFCWur6cofl7HZhzWdN5V1Oxlq21Bb0dxut1bJYDTNV57KRtO3cXttq_K1dFIF42ofauWP6dcVXVht_DW5rOTWm5vz7JPVdLLMZ9Hzy9M8Hz1HKk54iLJEaDnkpSjLIZZcqxiGSaqExkyAkqoSlYRUxbrkiJgZpkyiMS2hZKiVgrhP7k-9e2c_D8aHYmMPrmlfFig4b_XwjLUpOKWUs947UxV7V--k-yoQiqPUopVaHKUWZ6ktkv5BVB1-pAQn6-1_4N0JrI0xv3-4EJAIEX8D69OEtg
CODEN IETBAC
CitedBy_id crossref_primary_10_1007_s11554_019_00854_1
crossref_primary_10_1016_j_image_2019_06_014
crossref_primary_10_1109_TBC_2021_3071013
crossref_primary_10_1007_s00542_020_05035_w
crossref_primary_10_1109_ACCESS_2020_2986580
crossref_primary_10_1007_s11554_021_01096_w
crossref_primary_10_1007_s11042_018_6527_y
crossref_primary_10_1109_JIOT_2018_2837034
crossref_primary_10_1007_s11042_018_6882_8
crossref_primary_10_1016_j_image_2019_115634
crossref_primary_10_1109_TCSVT_2019_2893396
crossref_primary_10_1155_2021_6628041
crossref_primary_10_1109_TBC_2022_3176193
crossref_primary_10_3390_sym12010113
crossref_primary_10_1007_s42452_020_2909_7
crossref_primary_10_3390_s19081927
crossref_primary_10_1007_s11554_020_00985_w
crossref_primary_10_1109_ACCESS_2024_3434682
crossref_primary_10_1186_s13640_018_0340_4
crossref_primary_10_1109_ACCESS_2019_2902196
crossref_primary_10_1007_s11042_023_14691_9
crossref_primary_10_1109_JETCAS_2025_3539948
Cites_doi 10.1109/TCSVT.2014.2360031
10.1109/TMM.2014.2356795
10.1109/TCE.2013.6490261
10.1109/PCS.2012.6213262
10.1109/TCSVT.2012.2221191
10.1109/TBC.2015.2505406
10.1109/TBC.2014.2321682
10.1109/TCSVT.2014.2313892
10.1109/TMM.2012.2231060
10.1109/TCSVT.2003.815165
10.1109/TMM.2013.2291958
10.1109/TCSVT.2012.2221255
10.1109/ICASSP.2012.6288011
10.1109/TIP.2014.2341927
10.1109/CMSP.2011.167
ContentType Journal Article
Copyright Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2017
Copyright_xml – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2017
DBID 97E
RIA
RIE
AAYXX
CITATION
7SP
8FD
L7M
DOI 10.1109/TBC.2017.2722239
DatabaseName IEEE All-Society Periodicals Package (ASPP) 2005–Present
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Electronic Library (IEL)
CrossRef
Electronics & Communications Abstracts
Technology Research Database
Advanced Technologies Database with Aerospace
DatabaseTitle CrossRef
Technology Research Database
Advanced Technologies Database with Aerospace
Electronics & Communications Abstracts
DatabaseTitleList Technology Research Database
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Journalism & Communications
Engineering
EISSN 1557-9611
EndPage 692
ExternalDocumentID 10_1109_TBC_2017_2722239
7990599
Genre orig-research
GroupedDBID -~X
.DC
0R~
29I
4.4
5GY
5VS
6IK
97E
AAJGR
AARMG
AASAJ
AAWTH
ABAZT
ABQJQ
ABVLG
ACGFO
ACGFS
ACIWK
ACNCT
AENEX
AETIX
AGQYO
AGSQL
AHBIQ
AI.
AIBXA
AKJIK
AKQYR
ALLEH
ALMA_UNASSIGNED_HOLDINGS
ASUFR
ATWAV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CS3
DU5
EBS
EJD
HZ~
H~9
IAAWW
IBMZZ
ICLAB
IDIHD
IFIPE
IFJZH
IPLJI
JAVBF
LAI
M43
MS~
O9-
OCL
P2P
RIA
RIE
RNS
TAE
TN5
VH1
VJK
AAYXX
CITATION
7SP
8FD
L7M
RIG
ID FETCH-LOGICAL-c357t-859da47b9bb41b7dc30456c9d1890cacf9fa06c3db71118e2ce5d16b0b21dcc03
IEDL.DBID RIE
ISICitedReferencesCount 27
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000418391100008&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 0018-9316
IngestDate Mon Jun 30 06:43:27 EDT 2025
Sat Nov 29 04:03:07 EST 2025
Tue Nov 18 22:35:33 EST 2025
Tue Aug 26 16:43:23 EDT 2025
IsPeerReviewed true
IsScholarly true
Issue 4
Language English
License https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c357t-859da47b9bb41b7dc30456c9d1890cacf9fa06c3db71118e2ce5d16b0b21dcc03
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0003-3382-8296
PQID 1977239782
PQPubID 85473
PageCount 13
ParticipantIDs proquest_journals_1977239782
ieee_primary_7990599
crossref_citationtrail_10_1109_TBC_2017_2722239
crossref_primary_10_1109_TBC_2017_2722239
PublicationCentury 2000
PublicationDate 2017-Dec.
2017-12-00
20171201
PublicationDateYYYYMMDD 2017-12-01
PublicationDate_xml – month: 12
  year: 2017
  text: 2017-Dec.
PublicationDecade 2010
PublicationPlace New York
PublicationPlace_xml – name: New York
PublicationTitle IEEE transactions on broadcasting
PublicationTitleAbbrev TBC
PublicationYear 2017
Publisher IEEE
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml – name: IEEE
– name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References ref13
ref12
ref14
wiegand (ref2) 2003; 13
ref11
lee (ref15) 2014; 25
kim (ref7) 2012
ref1
ref17
ref16
ref19
ref18
(ref24) 2017
kim (ref8) 2012
bjontegaard (ref25) 2008
liou (ref10) 2012
choi (ref4) 2011
ref23
ref22
ref21
chang (ref20) 2012
yang (ref5) 2011
ref9
ref3
gweon (ref6) 2011
References_xml – ident: ref13
  doi: 10.1109/TCSVT.2014.2360031
– ident: ref17
  doi: 10.1109/TMM.2014.2356795
– year: 2011
  ident: ref4
  publication-title: Coding tree pruning based CU early termination
– ident: ref22
  doi: 10.1109/TCE.2013.6490261
– ident: ref9
  doi: 10.1109/PCS.2012.6213262
– ident: ref1
  doi: 10.1109/TCSVT.2012.2221191
– ident: ref23
  doi: 10.1109/TBC.2015.2505406
– volume: 25
  start-page: 411
  year: 2014
  ident: ref15
  article-title: A fast CU size decision algorithm for HEVC
  publication-title: IEEE Trans Circuits Syst Video Technol
– year: 2011
  ident: ref5
  publication-title: Early SKIP Detection for HEVC
– ident: ref18
  doi: 10.1109/TBC.2014.2321682
– year: 2017
  ident: ref24
  publication-title: HEVC reference software version HM15 0
– ident: ref14
  doi: 10.1109/TCSVT.2014.2313892
– ident: ref11
  doi: 10.1109/TMM.2012.2231060
– volume: 13
  start-page: 560
  year: 2003
  ident: ref2
  article-title: overview of the h.264/avc video coding standard
  publication-title: IEEE Transactions on Circuits and Systems for Video Technology
  doi: 10.1109/TCSVT.2003.815165
– ident: ref12
  doi: 10.1109/TMM.2013.2291958
– ident: ref3
  doi: 10.1109/TCSVT.2012.2221255
– start-page: 449
  year: 2012
  ident: ref7
  article-title: Early determination of mode decision for HEVC
  publication-title: Proc Picture Coding Symp (PCS)
– start-page: 393
  year: 2012
  ident: ref20
  article-title: Speeding up the decision of quad-tree structures and coding modes for HEVC Coding units
  publication-title: Proc Int Comput Symp
– start-page: 261
  year: 2012
  ident: ref8
  article-title: Adaptive coding unit early termination algorithm for HEVC
  publication-title: Proc IEEE Int Conf Consum Electron (ICCE)
– year: 2012
  ident: ref10
  article-title: Fast coding unit decision algorithm by using temporal depth correlation for HEVC
  publication-title: Proc Comput Vis Graph Image Process (CVGIP)
– ident: ref19
  doi: 10.1109/ICASSP.2012.6288011
– ident: ref21
  doi: 10.1109/TIP.2014.2341927
– ident: ref16
  doi: 10.1109/CMSP.2011.167
– year: 2008
  ident: ref25
  publication-title: Improvements of the BD-PSNR Model
– year: 2011
  ident: ref6
  publication-title: Early Termination of CU Encoding to Reduce HEVC Complexity
SSID ssj0003002
Score 2.3171887
Snippet The latest video coding standard, high efficiency video coding (HEVC), aims to achieve better coding efficiency than the H.264/AVC standard. To improve the...
SourceID proquest
crossref
ieee
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 680
SubjectTerms Algorithms
Coding
Coding standards
coding unit
Computation
Computational complexity
Computer programs
Correlation
Cost analysis
Cost control
Costs
Delay
Delays
early termination
Encoding
HEVC encoder
mode decision
Motion simulation
Prediction algorithms
prediction unit
Quantization (signal)
Random access
rate-distortion cost
Video compression
Title A Fast HEVC Encoding Method Using Depth Information of Collocated CUs and RD Cost Characteristics of PU Modes
URI https://ieeexplore.ieee.org/document/7990599
https://www.proquest.com/docview/1977239782
Volume 63
WOSCitedRecordID wos000418391100008&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVIEE
  databaseName: IEEE Electronic Library (IEL)
  customDbUrl:
  eissn: 1557-9611
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0003002
  issn: 0018-9316
  databaseCode: RIE
  dateStart: 19630101
  isFulltext: true
  titleUrlDefault: https://ieeexplore.ieee.org/
  providerName: IEEE
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LS8QwEB5UPOjBt7i-mIMIgnWT7bZpjlp38aAi4oq3kldR0FZs9febpLW4KIK3UmZC6dfMTDOPD-BAxsSwPAoDYaODYKglC4SiUUCMMlrYkEB45rn7S3Z9nTw88JsZOO56YYwxvvjMnLhLn8vXpXp3R2V9Zk1nxPkszDIWN71andUNCWkmg1O7gUPapSQJ79-dpa6Gi50MmPOGfMoFeU6VH4bYe5fx8v-eawWW2igSTxvYV2HGFGuw-G224BrstEJP1Qse4lQfSLUOL6c4FlWNF6P7FEeFKp0LwytPJ42-jADPzWv9iG27klPDMkd3zlC6IiqN6aRCUWi8Pbd37VLp9OhnJ30zQce1Vm3AZDy6Sy-ClnkhUGHE6iCJuBZDJrmUQyqZVi6fGiuuacKJEirnuSCxcrOZra1MzECZSNNYEjmgWikSbsJcURZmC9CEcR4ngugBy4cqyiW1ry-MEyoENXlCetD_AiNT7Vhyx47xnPnfE8IzC1_m4Mta-Hpw1Gm8NiM5_pBdd3B1ci1SPdj9wjtr92yVURsKWxUbMm3_rrUDC27tpphlF-bqt3ezB_Pqo36q3vb95_gJrbzdFw
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1La9tAEB7ygrSHpE1a6ubRPZRCoYp3LUurPSaKjUsdE4IdchP7Eg00UoiU_v7urDciJqXQmxAzktCnnRntPD6AzyqllpdJHEkXHURDo3gkNUsiarU10oUE0jPPXU_5bJbd3IjLNfjW9cJYa33xmT3BQ5_LN7V-xK2yPnemMxFiHTaROSt0a3V2N6Z0ORucuSUcsy4pSUV_fpZjFRc_GXD0h2LFCXlWlRem2PuX8e7_Pdkb2AlxJDldAv8W1my1B6-fTRfcg4MgdNvckS9kpROk2Ye7UzKWTUsmo-ucjCpdoxMjF55QmvhCAnJu79ufJDQsoRqpS4I7DTWWURmSLxoiK0Ouzt1Zd6l8dfgzSl8uCLKtNe9gMR7N80kUuBciHSe8jbJEGDnkSig1ZIobjRnVVAvDMkG11KUoJU01Tmd21jKzA20Tw1JF1YAZrWn8HjaqurIfgNg4LdNMUjPg5VAnpWLu9cVpxqRktsxoD_pPYBQ6DCZHfoxfhf9BoaJw8BUIXxHg68HXTuN-OZTjH7L7CFcnF5DqweET3kVYtU3BXDDsVFzQ9PHvWp9gezK_mBbT77MfB_AK77MsbTmEjfbh0R7Blv7d3jYPx_7T_ANZruBg
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+Fast+HEVC+Encoding+Method+Using+Depth+Information+of+Collocated+CUs+and+RD+Cost+Characteristics+of+PU+Modes&rft.jtitle=IEEE+transactions+on+broadcasting&rft.au=Tai%2C+Kuang-Han&rft.au=Hsieh%2C+Min-Yuan&rft.au=Chen%2C+Mei-Juan&rft.au=Chen%2C+Chia-Yen&rft.date=2017-12-01&rft.issn=0018-9316&rft.eissn=1557-9611&rft.volume=63&rft.issue=4&rft.spage=680&rft.epage=692&rft_id=info:doi/10.1109%2FTBC.2017.2722239&rft.externalDBID=n%2Fa&rft.externalDocID=10_1109_TBC_2017_2722239
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0018-9316&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0018-9316&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0018-9316&client=summon