Joint temporal-spatial quality enhancement for full frame-rate video playback

Shan Liu; JongWon Kim; C.-C. Jay Kuo

doi:10.1117/12.449770

7 December 2001 Joint temporal-spatial quality enhancement for full frame-rate video playback

Shan Liu, JongWon Kim, C.-C. Jay Kuo

Proceedings Volume 4472, Applications of Digital Image Processing XXIV; (2001) https://doi.org/10.1117/12.449770
Event: International Symposium on Optical Science and Technology, 2001, San Diego, CA, United States

Abstract

A joint temporal-spatial rate control scheme is investigated to optimize temporal and spatial rate-distortion (R-D) performances for full frame-rate video playback, where skipped frames are reconstructed via frame interpolation. The derived optimization problem is too complex to solve by using a straightforward Lagrangian multiplier method due to inter-frame coding dependency (e.g. I/P/B) and the frame-dependent reconstruction. To reduce the complexity, frames are adaptively grouped based on MAD (mean absolute difference) differentials, and iterative greedy search based on the R-D cost is applied to each group of frames to obtain a suboptimal solution. The performance of full frame-rate playback of the ITU-T H.263+/TMN8 codec is evaluated by reconstructing skipped frames with bidirectional motion-compensated interpolation. Experimental results show that the proposed solution has a gain of 0.2 - 1.0 dB over the traditional scheme with a fixed frame skip in average PSNR. Furthermore, the frame-by-frame PSNR variance is also reduced.

Citation Download Citation

Shan Liu, JongWon Kim, and C.-C. Jay Kuo "Joint temporal-spatial quality enhancement for full frame-rate video playback", Proc. SPIE 4472, Applications of Digital Image Processing XXIV, (7 December 2001); https://doi.org/10.1117/12.449770

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available