Zobrazit v EDS

Towards 6DoF live video streaming system for immersive media.

Uloženo v:
Podrobná bibliografie
Název: Towards 6DoF live video streaming system for immersive media.
Autoři: Cai, Yangang, Gao, Xuesong, Chen, Weiqiang, Wang, Ronggang
Zdroj: Multimedia Tools & Applications; Oct2022, Vol. 81 Issue 25, p35875-35898, 24p
Témata: VIDEO coding, STREAMING video & television, SINGLE-degree-of-freedom systems, VIDEO codecs, BIT rate, TECHNOLOGICAL innovations, COMPUTATIONAL complexity
Abstrakt: Based on the three rotational degrees (video in three dimensions, on the X, Y and Z axes) of freedom provided by VR, the viewer is free to control the viewing point and has six degrees of freedom (6DoF). When watching a sports game, the audience is no longer limited by the position of the camera, and can freely choose the viewing angle and position just like watching in the real world, which can greatly improve the immersion of viewing. However, the major barrier that prevents 6DoF video live from being industrialized lies in the extremely high computational complexity, of which multi-view depth estimation and Depth Image Based Rendering (DIBR) is difficult to realize. And existing devices do not have hardware interfaces that support multi-views coding technology. Therefore, we need new technologies for depth estimation and virtual view synthesis, and we need to use existing hardware coding/decoding interfaces to reduce power consumption. In this paper, we provide a 6DoF live video system, which includes multi-view depth estimation technique based on unsupervised learning, virtual viewpoint real-time rendering technology and 6DoF video coding. Experimental results demonstrate that our proposed acceleration method can speed up the original depth estimation algorithm by more than 34x, and can speed up the original DIBR algorithm by more than 168x. With our 6DoF video coding method, experimental results show that the bit rate achieves an average of 70%, 64%, 33%, 60% and 66% bitrate saving for AVC, HEVC, AV1, AVS3, VVC codec standard respectively. [ABSTRACT FROM AUTHOR]
Copyright of Multimedia Tools & Applications is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Databáze: Complementary Index
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://resolver.ebscohost.com/openurl?sid=EBSCO:edb&genre=article&issn=13807501&ISBN=&volume=81&issue=25&date=20221015&spage=35875&pages=35875-35898&title=Multimedia Tools & Applications&atitle=Towards%206DoF%20live%20video%20streaming%20system%20for%20immersive%20media.&aulast=Cai%2C%20Yangang&id=DOI:10.1007/s11042-021-11589-2
    Name: Full Text Finder
    Category: fullText
    Text: Full Text Finder
    Icon: https://imageserver.ebscohost.com/branding/images/FTF.gif
    MouseOverText: Full Text Finder
  – Url: https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=EBSCO&SrcAuth=EBSCO&DestApp=WOS&ServiceName=TransferToWoS&DestLinkType=GeneralSearchSummary&Func=Links&author=Cai%20Y
    Name: ISI
    Category: fullText
    Text: Nájsť tento článok vo Web of Science
    Icon: https://imagesrvr.epnet.com/ls/20docs.gif
    MouseOverText: Nájsť tento článok vo Web of Science
Header DbId: edb
DbLabel: Complementary Index
An: 159304202
RelevancyScore: 938
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 937.590698242188
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Towards 6DoF live video streaming system for immersive media.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Cai%2C+Yangang%22">Cai, Yangang</searchLink><br /><searchLink fieldCode="AR" term="%22Gao%2C+Xuesong%22">Gao, Xuesong</searchLink><br /><searchLink fieldCode="AR" term="%22Chen%2C+Weiqiang%22">Chen, Weiqiang</searchLink><br /><searchLink fieldCode="AR" term="%22Wang%2C+Ronggang%22">Wang, Ronggang</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: Multimedia Tools & Applications; Oct2022, Vol. 81 Issue 25, p35875-35898, 24p
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22VIDEO+coding%22">VIDEO coding</searchLink><br /><searchLink fieldCode="DE" term="%22STREAMING+video+%26+television%22">STREAMING video & television</searchLink><br /><searchLink fieldCode="DE" term="%22SINGLE-degree-of-freedom+systems%22">SINGLE-degree-of-freedom systems</searchLink><br /><searchLink fieldCode="DE" term="%22VIDEO+codecs%22">VIDEO codecs</searchLink><br /><searchLink fieldCode="DE" term="%22BIT+rate%22">BIT rate</searchLink><br /><searchLink fieldCode="DE" term="%22TECHNOLOGICAL+innovations%22">TECHNOLOGICAL innovations</searchLink><br /><searchLink fieldCode="DE" term="%22COMPUTATIONAL+complexity%22">COMPUTATIONAL complexity</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Based on the three rotational degrees (video in three dimensions, on the X, Y and Z axes) of freedom provided by VR, the viewer is free to control the viewing point and has six degrees of freedom (6DoF). When watching a sports game, the audience is no longer limited by the position of the camera, and can freely choose the viewing angle and position just like watching in the real world, which can greatly improve the immersion of viewing. However, the major barrier that prevents 6DoF video live from being industrialized lies in the extremely high computational complexity, of which multi-view depth estimation and Depth Image Based Rendering (DIBR) is difficult to realize. And existing devices do not have hardware interfaces that support multi-views coding technology. Therefore, we need new technologies for depth estimation and virtual view synthesis, and we need to use existing hardware coding/decoding interfaces to reduce power consumption. In this paper, we provide a 6DoF live video system, which includes multi-view depth estimation technique based on unsupervised learning, virtual viewpoint real-time rendering technology and 6DoF video coding. Experimental results demonstrate that our proposed acceleration method can speed up the original depth estimation algorithm by more than 34x, and can speed up the original DIBR algorithm by more than 168x. With our 6DoF video coding method, experimental results show that the bit rate achieves an average of 70%, 64%, 33%, 60% and 66% bitrate saving for AVC, HEVC, AV1, AVS3, VVC codec standard respectively. [ABSTRACT FROM AUTHOR]
– Name: Abstract
  Label:
  Group: Ab
  Data: <i>Copyright of Multimedia Tools & Applications is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://erproxy.cvtisr.sk/sfx/access?url=https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edb&AN=159304202
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s11042-021-11589-2
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 24
        StartPage: 35875
    Subjects:
      – SubjectFull: VIDEO coding
        Type: general
      – SubjectFull: STREAMING video & television
        Type: general
      – SubjectFull: SINGLE-degree-of-freedom systems
        Type: general
      – SubjectFull: VIDEO codecs
        Type: general
      – SubjectFull: BIT rate
        Type: general
      – SubjectFull: TECHNOLOGICAL innovations
        Type: general
      – SubjectFull: COMPUTATIONAL complexity
        Type: general
    Titles:
      – TitleFull: Towards 6DoF live video streaming system for immersive media.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Cai, Yangang
      – PersonEntity:
          Name:
            NameFull: Gao, Xuesong
      – PersonEntity:
          Name:
            NameFull: Chen, Weiqiang
      – PersonEntity:
          Name:
            NameFull: Wang, Ronggang
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 15
              M: 10
              Text: Oct2022
              Type: published
              Y: 2022
          Identifiers:
            – Type: issn-print
              Value: 13807501
          Numbering:
            – Type: volume
              Value: 81
            – Type: issue
              Value: 25
          Titles:
            – TitleFull: Multimedia Tools & Applications
              Type: main
ResultId 1