Quality Assessment for Omnidirectional Video: A Spatio-Temporal Distortion Modeling Approach
Uložené v:
| Názov: | Quality Assessment for Omnidirectional Video: A Spatio-Temporal Distortion Modeling Approach |
|---|---|
| Autori: | Pan Gao, Pengwei Zhang, Aljosa Smolic |
| Prispievatelia: | Science Foundation Ireland (SFI), 15/RP/2776 |
| Zdroj: | IEEE Transactions on Multimedia. 24:1-16 |
| Informácie o vydavateľovi: | Institute of Electrical and Electronics Engineers (IEEE), 2022. |
| Rok vydania: | 2022 |
| Predmety: | Digital Engagement, Measurement, Multimedia & Creativity, Omnidirectional video, Information technology in education, Creative Technologies, Two dimensional displays, Distortion, Spatio-temporal distortion, 02 engineering and technology, Objective video quality assessment, Video recording, 0202 electrical engineering, electronic engineering, information engineering, Distortion measurement, Other, Quality assessment, Visualization |
| Popis: | Omnidirectional video, also known as 360-degree video, has become increasingly popular nowadays due to its ability to provide immersive and interactive visual experiences. However, the ultra high resolution and the spherical observation space brought by the large spherical viewing range make omnidi-rectional video distinctly different from traditional 2D video. To date, the video quality assessment (VQA) for omnidirectional video is still an open issue. The existing VQA metrics for omnidirectional video only consider the spatial characteristics of distortions, but the temporal changes of spatial distortions can also considerably influence human visual perception. In this paper, we propose a spatiotemporal modeling approach to evaluate the quality of the omnidirectional video. Firstly, we construct a spatiotemporal quality assessment unit to evaluate the average distortion in temporal dimension at the eye fixation level, based upon which the smoothed distortion value is recursively calculated and consolidated by the characteristics of temporal variations. Then, we give a detailed solution of how to to integrate the three existing spatial VQA metrics into our approach. Besides, the cross-format omnidirectional video distortion measurement is also investigated. Finally, the spatiotemporal distortion of the whole video sequence is obtained by pooling. Based on the modeling approach, a full reference objective quality assessment metric for omnidirectional video is derived, namely OV-PSNR. The experimental results show that our proposed OV-PSNR greatly improves the prediction performance of the existing VQA metrics for omnidirectional video. |
| Druh dokumentu: | Article |
| Popis súboru: | application/pdf |
| ISSN: | 1941-0077 1520-9210 |
| DOI: | 10.1109/tmm.2020.3044458 |
| Prístupová URL adresa: | http://www.tara.tcd.ie/bitstream/2262/95046/1/Quality%20Assessment%20for%20Omnidirectional%20Video%20-%20A%20Spatio-Temporal%20Distortion%20Modeling%20Approach.pdf http://www.tara.tcd.ie/handle/2262/95046 https://ieeexplore.ieee.org/document/9296376/ https://ieeexplore.ieee.org/document/9296376/keywords#keywords https://hdl.handle.net/2262/95046 |
| Rights: | IEEE Copyright |
| Prístupové číslo: | edsair.doi.dedup.....1a5c4c02a8c0817e76175295f77636ab |
| Databáza: | OpenAIRE |
Full Text Finder 
Nájsť tento článok vo Web of Science | Abstrakt: | Omnidirectional video, also known as 360-degree video, has become increasingly popular nowadays due to its ability to provide immersive and interactive visual experiences. However, the ultra high resolution and the spherical observation space brought by the large spherical viewing range make omnidi-rectional video distinctly different from traditional 2D video. To date, the video quality assessment (VQA) for omnidirectional video is still an open issue. The existing VQA metrics for omnidirectional video only consider the spatial characteristics of distortions, but the temporal changes of spatial distortions can also considerably influence human visual perception. In this paper, we propose a spatiotemporal modeling approach to evaluate the quality of the omnidirectional video. Firstly, we construct a spatiotemporal quality assessment unit to evaluate the average distortion in temporal dimension at the eye fixation level, based upon which the smoothed distortion value is recursively calculated and consolidated by the characteristics of temporal variations. Then, we give a detailed solution of how to to integrate the three existing spatial VQA metrics into our approach. Besides, the cross-format omnidirectional video distortion measurement is also investigated. Finally, the spatiotemporal distortion of the whole video sequence is obtained by pooling. Based on the modeling approach, a full reference objective quality assessment metric for omnidirectional video is derived, namely OV-PSNR. The experimental results show that our proposed OV-PSNR greatly improves the prediction performance of the existing VQA metrics for omnidirectional video. |
|---|---|
| ISSN: | 19410077 15209210 |
| DOI: | 10.1109/tmm.2020.3044458 |