Frame Interpolation for Cloud-Based Mobile Video Streaming

Cloud-based High Definition (HD) video streaming is becoming popular day by day. On one hand, it is important for both end users and large storage servers to store their huge amount of data at different locations and servers. On the other hand, it is becoming a big challenge for network service prov...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on multimedia Vol. 18; no. 5; pp. 831 - 839
Main Authors: Usman, Muhammad, Xiangjian He, Kin-Man Lam, Min Xu, Bokhari, Syed Mohsin Matloob, Jinjun Chen
Format: Journal Article
Language:English
Published: Piscataway IEEE 01.05.2016
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:
Algorithms
Block Matching Algorithm
Blocking
Cloud computing
Error Concealment
Errors
Frames
H.265/HEVC
High Definition
High definition video
Intra Frame
Media
Motion Vectors
Networks
Packet loss
Packet Loss Rate
Packet Retransmission
Quality of Experience
Quantization Parameter
Searching
Servers
Streaming media
Video transmission
Error Concealment (EC)
packet loss rate
Quantization Parameters (QPs)
Block Matching Algorithm (BMA)
Quality of Experience (QoE)
Motion Vectors (MVs)
High Definition (HD)
H.265/HEVC
Intra-frame
packet retransmission
ISSN:1520-9210, 1941-0077
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract Cloud-based High Definition (HD) video streaming is becoming popular day by day. On one hand, it is important for both end users and large storage servers to store their huge amount of data at different locations and servers. On the other hand, it is becoming a big challenge for network service providers to provide reliable connectivity to the network users. There have been many studies over cloud-based video streaming for Quality of Experience (QoE) for services like YouTube. Packet losses and bit errors are very common in transmission networks, which affect the user feedback over cloud-based media services. To cover up packet losses and bit errors, Error Concealment (EC) techniques are usually applied at the decoder/receiver side to estimate the lost information. This paper proposes a time-efficient and quality-oriented EC method. The proposed method considers H.265/HEVC based intra-encoded videos for the estimation of whole intra-frame loss. The main emphasis in the proposed approach is the recovery of Motion Vectors (MVs) of a lost frame in real-time. To boost-up the search process for the lost MVs, a bigger block size and searching in parallel are both considered. The simulation results clearly show that our proposed method outperforms the traditional Block Matching Algorithm (BMA) by approximately 2.5 dB and Frame Copy (FC) by up to 12 dB at a packet loss rate of 1%, 3%, and 5% with different Quantization Parameters (QPs). The computational time of the proposed approach outperforms the BMA by approximately 1788 seconds.
AbstractList Cloud-based High Definition (HD) video streaming is becoming popular day by day. On one hand, it is important for both end users and large storage servers to store their huge amount of data at different locations and servers. On the other hand, it is becoming a big challenge for network service providers to provide reliable connectivity to the network users. There have been many studies over cloud-based video streaming for Quality of Experience (QoE) for services like YouTube. Packet losses and bit errors are very common in transmission networks, which affect the user feedback over cloud-based media services. To cover up packet losses and bit errors, Error Concealment (EC) techniques are usually applied at the decoder/receiver side to estimate the lost information. This paper proposes a time-efficient and quality-oriented EC method. The proposed method considers H.265/HEVC based intra-encoded videos for the estimation of whole intra-frame loss. The main emphasis in the proposed approach is the recovery of Motion Vectors (MVs) of a lost frame in real-time. To boost-up the search process for the lost MVs, a bigger block size and searching in parallel are both considered. The simulation results clearly show that our proposed method outperforms the traditional Block Matching Algorithm (BMA) by approximately 2.5 dB and Frame Copy (FC) by up to 12 dB at a packet loss rate of 1%, 3%, and 5% with different Quantization Parameters (QPs). The computational time of the proposed approach outperforms the BMA by approximately 1788 seconds.
Author Usman, Muhammad
Jinjun Chen
Min Xu
Xiangjian He
Kin-Man Lam
Bokhari, Syed Mohsin Matloob
Author_xml – sequence: 1
  givenname: Muhammad
  surname: Usman
  fullname: Usman, Muhammad
  email: Muhammad.Usman-2@student.uts.edu.au
  organization: Global Big Data Technol. Center, Sch. of Comput. & Commun., Sydney, NSW, Australia
– sequence: 2
  surname: Xiangjian He
  fullname: Xiangjian He
  email: Xiangjian.He@uts.edu.au
  organization: Global Big Data Technol. Center, Sch. of Comput. & Commun., Sydney, NSW, Australia
– sequence: 3
  surname: Kin-Man Lam
  fullname: Kin-Man Lam
  email: enkmlam@polyu.edu.hk
  organization: Dept. of Electron. & Inf. Eng., Hong Kong Polytech. Univ., Hong Kong, China
– sequence: 4
  surname: Min Xu
  fullname: Min Xu
  email: Min.Xu@uts.edu.au
  organization: Global Big Data Technol. Center, Sch. of Comput. & Commun., Sydney, NSW, Australia
– sequence: 5
  givenname: Syed Mohsin Matloob
  surname: Bokhari
  fullname: Bokhari, Syed Mohsin Matloob
  email: Mohsin.Bokhari@uetpeshawar.edu.pk
  organization: Dept. of Electron. Eng., Univ. of Eng. & Technol., Peshawar, Pakistan
– sequence: 6
  surname: Jinjun Chen
  fullname: Jinjun Chen
  email: Jinjun.Chen@uts.edu.au
  organization: Global Big Data Technol. Center, Sch. of Comput. & Commun., Sydney, NSW, Australia
BookMark eNp9kDFPwzAQRi1UJNrCjsQSiYUl5ezEdsIGFQWkVgwUVstJzshVEhc7Gfj3pLRi6MB03_C9u9ObkFHrWiTkksKMUshv16vVjAEVM8YTyQBOyJjmKY0BpBwNmTOIc0bhjExC2ADQlIMck7uF1w1GL22Hfutq3VnXRsb5aF67voofdMAqWrnC1hh92Apd9NZ51I1tP8_JqdF1wIvDnJL3xeN6_hwvX59e5vfLuExy6GItTVVlQ0RDU1kUvGKlNsJoKDOjq6xAZphMBBMyociSiiE3Os-5RANSYDIlN_u9W---egydamwosa51i64PimZUgMhTlg_V66PqxvW-Hb5TVGaScuCUDS3Yt0rvQvBo1NbbRvtvRUHtZKpBptrJVAeZAyKOkNJ2v7I6r239H3i1By0i_t2RKUuk4MkP9SWCBg
CODEN ITMUF8
CitedBy_id crossref_primary_10_1007_s11042_020_10333_6
crossref_primary_10_1109_TIA_2020_2975488
crossref_primary_10_1109_JSAC_2019_2904349
crossref_primary_10_1109_TMM_2023_3289702
crossref_primary_10_1145_3556544
crossref_primary_10_1007_s11042_019_08176_x
crossref_primary_10_1155_2021_6356899
crossref_primary_10_1109_TBC_2020_3028323
crossref_primary_10_1109_TMM_2021_3052419
crossref_primary_10_1109_TMM_2023_3314971
crossref_primary_10_1109_ACCESS_2020_3006036
crossref_primary_10_1145_3331174
crossref_primary_10_1049_ipr2_70193
crossref_primary_10_1109_ACCESS_2018_2879338
crossref_primary_10_1109_TNSE_2023_3296511
crossref_primary_10_1109_TIP_2023_3327912
crossref_primary_10_1145_3323334
crossref_primary_10_1007_s11042_021_11005_9
crossref_primary_10_1016_j_sigpro_2018_02_030
crossref_primary_10_1109_JIOT_2018_2873085
crossref_primary_10_1016_j_ins_2016_08_059
crossref_primary_10_1109_TCC_2017_2734650
crossref_primary_10_1007_s11554_019_00923_5
crossref_primary_10_1109_TMC_2017_2739744
Cites_doi 10.1109/TCE.2012.6311331
10.1109/JSEN.2014.2366511
10.1109/TBC.2010.2086771
10.1109/TMM.2013.2281587
10.1109/TCSVT.2013.2283430
10.1109/TMM.2013.2281024
10.1007/s11227-010-0535-7
10.1109/TCE.2014.6852000
10.1109/JSYST.2013.2289556
10.1109/TMM.2014.2330314
10.1049/el.2014.1055
10.1145/1721654.1721672
10.1007/978-81-322-1097-9
10.1007/s11227-014-1167-0
10.1109/TCSVT.2011.2179453
10.1007/s11042-014-2206-9
10.1109/65.642357
10.1109/TPDS.2011.144
10.1109/TCSVT.2012.2221191
10.1007/s11554-012-0307-0
10.1109/TCSVT.2013.2255423
10.1109/TCSVT.2011.2130450
10.1017/CBO9780511921698
10.1109/PCS.2015.7170081
10.1109/TBC.2014.2321676
10.1016/j.jvcir.2010.12.002
10.1109/TCSVT.2006.877391
10.1109/MCOM.2012.6178831
10.1109/TPDS.2013.48
10.1109/TCSVT.2010.2087816
10.1109/TMM.2012.2184743
10.1109/TPDS.2014.2316827
ContentType Journal Article
Copyright Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2016
Copyright_xml – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2016
DBID 97E
RIA
RIE
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
F28
FR3
DOI 10.1109/TMM.2016.2537200
DatabaseName IEEE Xplore (IEEE)
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Electronic Library (IEL)
CrossRef
Computer and Information Systems Abstracts
Electronics & Communications Abstracts
Technology Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
ANTE: Abstracts in New Technology & Engineering
Engineering Research Database
DatabaseTitle CrossRef
Technology Research Database
Computer and Information Systems Abstracts – Academic
Electronics & Communications Abstracts
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts Professional
Engineering Research Database
ANTE: Abstracts in New Technology & Engineering
DatabaseTitleList Technology Research Database

Technology Research Database
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
Computer Science
EISSN 1941-0077
EndPage 839
ExternalDocumentID 4046972101
10_1109_TMM_2016_2537200
7423765
Genre orig-research
GroupedDBID -~X
0R~
29I
4.4
5GY
5VS
6IK
97E
AAJGR
AARMG
AASAJ
AAWTH
ABAZT
ABQJQ
ABVLG
ACGFO
ACGFS
ACIWK
AENEX
AETIX
AGQYO
AGSQL
AHBIQ
AI.
AIBXA
AKJIK
AKQYR
ALLEH
ALMA_UNASSIGNED_HOLDINGS
ATWAV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CS3
DU5
EBS
EJD
HZ~
H~9
IFIPE
IFJZH
IPLJI
JAVBF
LAI
M43
O9-
OCL
P2P
PQQKQ
RIA
RIE
RNS
TN5
VH1
ZY4
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
F28
FR3
ID FETCH-LOGICAL-c390t-a7fdd8390ef147bb5d2caf6fa0c8fad8be2f273626731e23d2e5fa9957ef076e3
IEDL.DBID RIE
ISICitedReferencesCount 34
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000374996200004&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 1520-9210
IngestDate Wed Oct 01 13:42:33 EDT 2025
Mon Jun 30 05:55:54 EDT 2025
Sat Nov 29 02:03:49 EST 2025
Tue Nov 18 22:28:52 EST 2025
Tue Aug 26 16:42:57 EDT 2025
IsDoiOpenAccess false
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 5
Keywords Error Concealment (EC)
packet loss rate
Quantization Parameters (QPs)
Block Matching Algorithm (BMA)
Quality of Experience (QoE)
Motion Vectors (MVs)
High Definition (HD)
H.265/HEVC
Intra-frame
packet retransmission
Language English
License https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c390t-a7fdd8390ef147bb5d2caf6fa0c8fad8be2f273626731e23d2e5fa9957ef076e3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
content type line 23
PQID 1787150512
PQPubID 75737
PageCount 9
ParticipantIDs crossref_citationtrail_10_1109_TMM_2016_2537200
ieee_primary_7423765
proquest_miscellaneous_1816069429
proquest_journals_1787150512
crossref_primary_10_1109_TMM_2016_2537200
PublicationCentury 2000
PublicationDate 2016-05-01
PublicationDateYYYYMMDD 2016-05-01
PublicationDate_xml – month: 05
  year: 2016
  text: 2016-05-01
  day: 01
PublicationDecade 2010
PublicationPlace Piscataway
PublicationPlace_xml – name: Piscataway
PublicationTitle IEEE transactions on multimedia
PublicationTitleAbbrev TMM
PublicationYear 2016
Publisher IEEE
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml – name: IEEE
– name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References ref13
ref34
ref12
ref15
ref14
ref30
ref33
ref11
ref32
ref10
ref2
ref17
ref16
ref19
ref18
he (ref6) 2014; 24
(ref1) 2015
ref24
ref23
ref26
ref25
ref20
ref22
ref21
ref28
ref27
ref29
ref8
ref7
ref9
ref4
ref3
ref5
wenger (ref35) 2012
choi (ref31) 2003; 3
References_xml – ident: ref19
  doi: 10.1109/TCE.2012.6311331
– ident: ref27
  doi: 10.1109/JSEN.2014.2366511
– ident: ref14
  doi: 10.1109/TBC.2010.2086771
– ident: ref23
  doi: 10.1109/TMM.2013.2281587
– year: 2012
  ident: ref35
– volume: 24
  start-page: 669
  year: 2014
  ident: ref6
  article-title: On the cost-QoE tradeoff for cloud-based video streaming under amazon EC2's pricing models
  publication-title: IEEE Trans Circuits Syst Video Technol
  doi: 10.1109/TCSVT.2013.2283430
– ident: ref30
  doi: 10.1109/TMM.2013.2281024
– ident: ref21
  doi: 10.1007/s11227-010-0535-7
– ident: ref15
  doi: 10.1109/TCE.2014.6852000
– volume: 3
  start-page: 371
  year: 2003
  ident: ref31
  article-title: Fast motion estimation with modified diamond search for variable motion block sizes
  publication-title: IEEE Int Conf Image Process
– ident: ref13
  doi: 10.1109/JSYST.2013.2289556
– ident: ref18
  doi: 10.1109/TMM.2014.2330314
– ident: ref20
  doi: 10.1049/el.2014.1055
– ident: ref2
  doi: 10.1145/1721654.1721672
– year: 2015
  ident: ref1
  article-title: Cisco Visual Networking Index: Forecast and Methodology, 2014-2019
– ident: ref32
  doi: 10.1007/978-81-322-1097-9
– ident: ref12
  doi: 10.1007/s11227-014-1167-0
– ident: ref29
  doi: 10.1109/TCSVT.2011.2179453
– ident: ref22
  doi: 10.1007/s11042-014-2206-9
– ident: ref10
  doi: 10.1109/65.642357
– ident: ref3
  doi: 10.1109/TPDS.2011.144
– ident: ref9
  doi: 10.1109/TCSVT.2012.2221191
– ident: ref34
  doi: 10.1007/s11554-012-0307-0
– ident: ref8
  doi: 10.1109/TCSVT.2013.2255423
– ident: ref24
  doi: 10.1109/TCSVT.2011.2130450
– ident: ref33
  doi: 10.1017/CBO9780511921698
– ident: ref16
  doi: 10.1109/PCS.2015.7170081
– ident: ref26
  doi: 10.1109/TBC.2014.2321676
– ident: ref17
  doi: 10.1016/j.jvcir.2010.12.002
– ident: ref11
  doi: 10.1109/TCSVT.2006.877391
– ident: ref5
  doi: 10.1109/MCOM.2012.6178831
– ident: ref4
  doi: 10.1109/TPDS.2013.48
– ident: ref28
  doi: 10.1109/TCSVT.2010.2087816
– ident: ref25
  doi: 10.1109/TMM.2012.2184743
– ident: ref7
  doi: 10.1109/TPDS.2014.2316827
SSID ssj0014507
Score 2.339958
Snippet Cloud-based High Definition (HD) video streaming is becoming popular day by day. On one hand, it is important for both end users and large storage servers to...
SourceID proquest
crossref
ieee
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 831
SubjectTerms Algorithms
Block Matching Algorithm
Blocking
Cloud computing
Error Concealment
Errors
Frames
H.265/HEVC
High Definition
High definition video
Intra Frame
Media
Motion Vectors
Networks
Packet loss
Packet Loss Rate
Packet Retransmission
Quality of Experience
Quantization Parameter
Searching
Servers
Streaming media
Video transmission
Title Frame Interpolation for Cloud-Based Mobile Video Streaming
URI https://ieeexplore.ieee.org/document/7423765
https://www.proquest.com/docview/1787150512
https://www.proquest.com/docview/1816069429
Volume 18
WOSCitedRecordID wos000374996200004&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVIEE
  databaseName: IEEE Electronic Library (IEL)
  customDbUrl:
  eissn: 1941-0077
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0014507
  issn: 1520-9210
  databaseCode: RIE
  dateStart: 19990101
  isFulltext: true
  titleUrlDefault: https://ieeexplore.ieee.org/
  providerName: IEEE
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LS8QwEB5UPOjB9YnriwheBOu2ybZpvOni4sEVDyreSppMQNCt6K6_30naLYoieCs0acNMJ_Ol880MwJHiZM0pmojch4r6FkWkhDWREVraxGhXJiFR-Fre3OSPj-p2Dk7aXBhEDOQzPPWXIZZvKzP1v8p6MnA40nmYlzKrc7XaiEE_DanR5I7iSNE5ZhaSjFXvbjTyHK7slKe-J0v8zQWFnio_NuLgXYad_61rFVYaFMnOa7WvwRyO16Ez69DAGoNdh-Uv5QY34GzomVis5hlWNQmOEWhlg-dqaqMLcmiWjaqSNgr28GSxYj5mrV9o8ibcDy_vBldR0zuBpKziSaSls5bAT4wu6cuyTC0nwWdOxyZ32uYlckfIhY4zUiTIheWYOq1UKtHFMkOxBQvjaozbwIRA5zIf8SOwolGo1PAsTzJjeT_jMu9CbybOwjSFxX1_i-ciHDBiVZACCq-AolFAF47bGa91UY0_xm54gbfjGll3YW-msaKxuvciod2HAC5hmC4ctrfJXnwQRI-xmtIYWrlP9uVq5_cn78KSf39NatyDhcnbFPdh0XxMnt7fDsJH9wkMnNOj
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1RaxQxEB5qK6gPrbaKp22N4Ivg9rLJZrPpmy09Kt4dPpzStyWbTKBQb6W98_c7ye4tiiL0bWGTJcxkMl92vpkBeGcEWbNCl5H7MFnhUWZGepc5abXPnQ1NnhKFp3o-r66uzJct-DDkwiBiIp_hSXxMsXzfunX8VTbWicOhHsCOKgrBu2ytIWZQqJQcTQ6JZ4ZuMpugJDfjxWwWWVzliVCxKwv_wwmlrip_HcXJv0z27reyp7Db40j2sVP8M9jC5T7sbXo0sN5k9-HJbwUHD-B0ErlYrGMath0NjhFsZec37dpnZ-TSPJu1DR0V7Nu1x5bFqLX9TpOfw9fJxeL8Muu7J5CcDV9lVgfvCf5wDHmhm0Z5QaIvg-WuCtZXDYpA2IUuNFrmKKQXqII1RmkMXJcoX8D2sl3iS2BSYghljPkRXLEojXKirPLSeVGUQlcjGG_EWbu-tHjscHFTpysGNzUpoI4KqHsFjOD9MONHV1bjP2MPosCHcb2sR3C40Vjd291dndP5QxCXUMwI3g6vyWJiGMQusV3TGFp5TPcV5tW_v_wGHl0uZtN6-mn--TU8jmvpKI6HsL26XeMRPHQ_V9d3t8dpA_4COWrW6g
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Frame+Interpolation+for+Cloud-Based+Mobile+Video+Streaming&rft.jtitle=IEEE+transactions+on+multimedia&rft.au=Usman%2C+Muhammad&rft.au=Xiangjian+He&rft.au=Kin-Man+Lam&rft.au=Min+Xu&rft.date=2016-05-01&rft.pub=IEEE&rft.issn=1520-9210&rft.volume=18&rft.issue=5&rft.spage=831&rft.epage=839&rft_id=info:doi/10.1109%2FTMM.2016.2537200&rft.externalDocID=7423765
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1520-9210&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1520-9210&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1520-9210&client=summon