Motion-Based Rate Adaptation in WebRTC Videoconferencing Using Scalable Video Coding

This paper proposes methods for rate adaptation by motion-based spatial and temporal resolution selection in both mesh-connected and selective-forwarding-unit (SFU) connected WebRTC videoconferencing using scalable video coding. In the mesh-connected case, the proposed motion-adaptive spatial/tempor...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on multimedia Vol. 21; no. 2; pp. 429 - 441
Main Authors: Bakar, Gonca, Kirmizioglu, Riza Arda, Tekalp, A. Murat
Format: Journal Article
Language:English
Published: Piscataway IEEE 01.02.2019
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:
Adaptation
Adaptive control
Coding
Encoding
Finite element method
Measurement
mesh-connection
motion-adaptive layer selection
Parameters
Peers
Quality assessment
scalable VP9 coding
selective forwarding unit
Spatial resolution
Static VAr compensators
Streaming media
Temporal resolution
Video teleconferencing
Videoconferencing
WebRTC
ISSN:1520-9210, 1941-0077
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper proposes methods for rate adaptation by motion-based spatial and temporal resolution selection in both mesh-connected and selective-forwarding-unit (SFU) connected WebRTC videoconferencing using scalable video coding. In the mesh-connected case, the proposed motion-adaptive spatial/temporal layer selection allows each peer to send video to different peers with different terminal types and network rates at different rates using a single encoder. In the SFU-connected case, motion-adaptive rate control is used both at peers to adapt to the network rate between the sending peer and SFU by spatio-temporal resolution adaptation and at the SFU by layer selection to adapt to the network rate between the SFU and receiving peer. Experimental results show that our proposed motion-based rate adaptation achieves better perceptual video quality with sufficiently high frame rates and lower quantization parameter for video with high motion; and high spatial resolution and lower quantization parameter for video with low motion compared to simple rate-distortion model-based layer selection that does not use motion complexity, at the same rate.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1520-9210
1941-0077
DOI:10.1109/TMM.2018.2856629