Memory efficient belief propagation for high-definition real-time stereo matching systems

J. Pérez; P. Sánchez; M. Martínez

doi:10.1117/12.838352

4 February 2010 Memory efficient belief propagation for high-definition real-time stereo matching systems

J. Pérez, P. Sánchez, M. Martínez

Proceedings Volume 7526, Three-Dimensional Image Processing (3DIP) and Applications; 75260N (2010) https://doi.org/10.1117/12.838352
Event: IS&T/SPIE Electronic Imaging, 2010, San Jose, California, United States

Abstract

Tele-presence systems will enable participants to feel like they are physically together. In order to improve this feeling, these systems are starting to include depth estimation capabilities. A typical requirement for these systems includes high definition, good quality results and low latency. Benchmarks demonstrate that stereo-matching algorithms using Belief Propagation (BP) produce the best results. The execution time of the BP algorithm in a CPU cannot satisfy real-time requirements with high-definition images. GPU-based implementations of BP algorithms are only able to work in real-time with small-medium size images because the traffic with memory limits their applicability. The inherent parallelism of the BP algorithm makes FPGA-based solutions a good choice. However, even though the memory traffic of a commercial FPGA-based ASIC-prototyping board is high, it is still not enough to comply with realtime, high definition and good immersive feeling requirements. The work presented estimates depth maps in less than 40 milliseconds for high-definition images at 30fps with 80 disparity levels. The proposed double BP topology and the new data-cost estimation improve the overall classical BP performance while they reduce the memory traffic by about 21%. Moreover, the adaptive message compression method and message distribution in memory reduce the number of memory accesses by more than 70% with an almost negligible loss of performance. The total memory traffic reduction is about 90%, demonstrating sufficient quality to be classified within the first 40 positions in the Middlebury ranking.

Citation Download Citation

J. Pérez, P. Sánchez, and M. Martínez "Memory efficient belief propagation for high-definition real-time stereo matching systems", Proc. SPIE 7526, Three-Dimensional Image Processing (3DIP) and Applications, 75260N (4 February 2010); https://doi.org/10.1117/12.838352

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available