Advancing event camera-based 3D reconstructions: optimized projection for high-quality measurements

Christoph Freitag; Stefan Heist; Andreas Stark; Peter Kühmstedt; Gunther Notni; Christian Franke

doi:10.1117/12.3013188

7 June 2024 Advancing event camera-based 3D reconstructions: optimized projection for high-quality measurements

Christoph Freitag, Stefan Heist, Andreas Stark, Peter Kühmstedt, Gunther Notni, Christian Franke

Proceedings Volume 13038, Dimensional Optical Metrology and Inspection for Practical Applications XIII; 130380B (2024) https://doi.org/10.1117/12.3013188
Event: SPIE Defense + Commercial Sensing, 2024, National Harbor, Maryland, United States

Abstract

Conventional CCD or CMOS cameras create complete two-dimensional images of a scene. In contrast, event cameras generate signals at pixels and times where and when changes in brightness occur. Reported changes come in the form of a stream of events, which are digital packets containing the pixel’s location, a time stamp, and additional information, such as the direction of the change. While successive images of conventional frame-based cameras might be partially redundant, measurements of event cameras are sparse. They do not contain any static information, and thus adapt to the dynamics of an observed scene. Event cameras also offer high temporal precision without the need for the same high bandwidth that would be required for comparable high-speed frame-based cameras. We have developed a 3D measurement setup, which consists of a pair of event cameras in stereo configuration and a specialized projector. We designed the projector in a way that it probes the measurement volume by means of a horizontally moving, vertically oriented contrast edge, i.e., a sharp transition between two levels of illumination. We argue that our method of structured illumination is well adapted to the sparse sampling and radiometric properties of event cameras. We present 3D measurements, performed within ∼200 ms, with quantified uncertainties to demonstrate the abilities of our setup, which enabled us to reconstruct an entire scene with ∼55,000 3D points. At a working distance of ∼700 mm, we achieved a spatial uncertainty of ∼0.6 mm. These results are achieved through triangulation of temporally corresponding events without any smoothing or similar post-processing. Based on our work and previous research, we suggest areas of future investigation in the field of event-based 3D and 4D (3D + time) measurements.

Conference Presentation

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Christoph Freitag, Stefan Heist, Andreas Stark, Peter Kühmstedt, Gunther Notni, and Christian Franke "Advancing event camera-based 3D reconstructions: optimized projection for high-quality measurements", Proc. SPIE 13038, Dimensional Optical Metrology and Inspection for Practical Applications XIII, 130380B (7 June 2024); https://doi.org/10.1117/12.3013188

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available