Edge preserving motion estimation with occlusions correction for assisted 2D to 3D conversion

Petr Pohl; Michael Sirotenko; Ekaterina Tolstaya; Victor Bucha

doi:10.1117/12.2039674

25 February 2014 Edge preserving motion estimation with occlusions correction for assisted 2D to 3D conversion

Petr Pohl, Michael Sirotenko, Ekaterina Tolstaya, Victor Bucha

Proceedings Volume 9019, Image Processing: Algorithms and Systems XII; 901906 (2014) https://doi.org/10.1117/12.2039674
Event: IS&T/SPIE Electronic Imaging, 2014, San Francisco, California, United States

Abstract

In this article we propose high quality motion estimation based on variational optical flow formulation with non-local regularization term. To improve motion in occlusion areas we introduce occlusion motion inpainting based on 3-frame motion clustering. Variational formulation of optical flow proved itself to be very successful, however a global optimization of cost function can be time consuming. To achieve acceptable computation times we adapted the algorithm that optimizes convex function in coarse-to-fine pyramid strategy and is suitable for modern GPU hardware implementation. We also introduced two simplifications of cost function that significantly decrease computation time with acceptable decrease of quality. For motion clustering based motion inpaitning in occlusion areas we introduce effective method of occlusion aware joint 3-frame motion clustering using RANSAC algorithm. Occlusion areas are inpainted by motion model taken from cluster that shows consistency in opposite direction. We tested our algorithm on Middlebury optical flow benchmark, where we scored around 20th position, but being one of the fastest method near the top. We also successfully used this algorithm in semi-automatic 2D to 3D conversion tool for spatio-temporal background inpainting, automatic adaptive key frame detection and key points tracking.

Citation Download Citation

Petr Pohl, Michael Sirotenko, Ekaterina Tolstaya, and Victor Bucha "Edge preserving motion estimation with occlusions correction for assisted 2D to 3D conversion", Proc. SPIE 9019, Image Processing: Algorithms and Systems XII, 901906 (25 February 2014); https://doi.org/10.1117/12.2039674

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available