Deep360Up: A Deep Learning-Based Approach for Automatic VR Image Upright Adjustment

Spherical VR cameras can capture high-quality immersive VR images with a 360° field of view. However, in practice, when the camera orientation is not straight, the acquired VR image appears tilted when displayed on a VR headset, which diminishes the quality of the VR experience. To overcome this pro...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Proceedings (IEEE Conference on Virtual Reality and 3D User Interfaces. Online) S. 1 - 8
Hauptverfasser: Jung, Raehyuk, Lee, Aiden Seung Joon, Ashtari, Amirsaman, Bazin, Jean-Charles
Format: Tagungsbericht
Sprache:Englisch
Veröffentlicht: IEEE 01.03.2019
Schlagworte:
Cameras
Computing methodologies-Computer graphics-Image manipulation-Image processing
Deep learning
Estimation
Headphones
Three-dimensional displays
Training
Upright adjustment
VR content
ISSN:2642-5254
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Spherical VR cameras can capture high-quality immersive VR images with a 360° field of view. However, in practice, when the camera orientation is not straight, the acquired VR image appears tilted when displayed on a VR headset, which diminishes the quality of the VR experience. To overcome this problem, we present a deep learning-based approach that can automatically estimate the orientation of a VR image and return its upright version. In contrast to existing methods, our approach does not require the presence of lines or horizon in the image, and thus can be applied on a wide range of scenes. Extensive experiments and comparisons with state-of-the-art methods have successfully confirmed the validity of our approach.
ISSN:2642-5254
DOI:10.1109/VR.2019.8798326