Reference frame selection for loss-resilient depth map coding in multiview video conferencing

Bruno Macchiavello; Camilo Dorea; Edson M. Hung; Gene Cheung; Wai-Tian Tan

doi:10.1117/12.909462

15 February 2012 Reference frame selection for loss-resilient depth map coding in multiview video conferencing

Bruno Macchiavello, Camilo Dorea, Edson M. Hung, Gene Cheung, Wai-Tian Tan

Proceedings Volume 8305, Visual Information Processing and Communication III; 83050C (2012) https://doi.org/10.1117/12.909462
Event: IS&T/SPIE Electronic Imaging, 2012, Burlingame, California, United States

Abstract

Multiview video in "texture-plus-depth" format enables decoder to synthesize freely chosen intermediate views for enhanced visual experience. Nevertheless, transmission of multiple texture and depth maps over bandwidthconstrained and loss-prone networks is challenging, especially for conferencing applications with stringent deadlines. In this paper, we examine the problem of loss-resilient coding of depth maps by exploiting two observations. First, different depth macroblocks have significantly different error sensitivities with respect to the reconstructed images. Second, unlike texture, the relative overhead of using reference pictures with large prediction distance is low for depth maps. This motivates our approach of assigning a weight to represent the varying error sensitivity of each macroblock and using such weights to guide selection of reference frames. Results show that (1) errors in depth maps in sequence with high motion yields significant drop in quality in reconstructed images, and (2) that the proposed scheme can efficiently maintain the quality of reconstructed images even at relatively high packet loss rates of 3-5%.

Citation Download Citation

Bruno Macchiavello, Camilo Dorea, Edson M. Hung, Gene Cheung, and Wai-Tian Tan "Reference frame selection for loss-resilient depth map coding in multiview video conferencing", Proc. SPIE 8305, Visual Information Processing and Communication III, 83050C (15 February 2012); https://doi.org/10.1117/12.909462

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available