Joint Bit Allocation and Rate Control for Coding Multi-View Video Plus Depth Based 3D Video

In three-dimensional (3D) video coding, distortion in texture video and depth maps can all affect the quality of the synthesized virtual views. Therefore, under the total bitrate constraint, effective bit allocation between texture and depth information is very important for 3D video coding. In this...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:IEEE transactions on multimedia Ročník 15; číslo 8; s. 1843 - 1854
Hlavní autori: Shao, Feng, Jiang, Gangyi, Lin, Weisi, Yu, Mei, Dai, Qionghai
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: New York, NY IEEE 01.12.2013
Institute of Electrical and Electronics Engineers
Predmet:
3D video coding
Adaptation models
Applied sciences
Artificial intelligence
Bit allocation
Bit rate
Coding, codes
Computer science; control theory; systems
depth-image-based rendering
Distortion
Encoding
Exact sciences and technology
Information, signal and communications theory
Optimization
Pattern recognition. Digital image processing. Computational geometry
rate control
Rate-distortion
Rendering (computer graphics)
Resource management
Signal and communications theory
Systems, networks and services of telecommunications
Telecommunications
Telecommunications and information theory
Teletraffic
Three-dimensional displays
Transmission and modulation (techniques and equipments)
Video coding
view synthesis distortion
Video coding
Resource allocation
Video signal
Virtual view
Rate distortion theory
Image rendering
Bandwidth allocation
Modeling
Texture
Depth of field
Image reconstruction
Image quality
Multiple view
Bit allocation
Experimental result
Image coding
Optimal allocation
view synthesis distortion
depth-image-based rendering
Tridimensional image
3D video coding
rate control
Passband
Mathematical programming
ISSN:1520-9210, 1941-0077
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:In three-dimensional (3D) video coding, distortion in texture video and depth maps can all affect the quality of the synthesized virtual views. Therefore, under the total bitrate constraint, effective bit allocation between texture and depth information is very important for 3D video coding. In this paper, the major technical contribution is to formulate view synthesis quality for optimal resource allocation in 3D video coding, since such quality is what that matters most to the ultimate user (i.e., the viewer) of the system; to be more specific, a new joint bit allocation and rate control method for multi-view video plus depth (MVD) based 3D video coding is proposed accordingly. We firstly derive a view synthesis distortion model to characterize the effect of coding distortion of texture video and depth maps on the synthesized virtual views. Based on this model, we derive a rate-distortion model to characterize the relationship between the bitrate and the view synthesis distortion, and the optimal bitrate ratio between texture and depth is established adaptively by solving the associated optimization problem. Finally, the rate control algorithm is performed on view level, texture/depth level and frame level. Experimental results show that compared with other methods, the proposed bit allocation method obtains higher performance of view synthesis. Moreover, the proposed rate control method can accurately control the bitrate to satisfy the total bitrate constraint.
ISSN:1520-9210
1941-0077
DOI:10.1109/TMM.2013.2269897