Image-point cloud registration method based on image matching

Yang Ai; Xi Yang

doi:10.1117/12.3035585

16 August 2024 Image-point cloud registration method based on image matching

Yang Ai, Xi Yang

Proceedings Volume 13230, Third International Conference on Machine Vision, Automatic Identification, and Detection (MVAID 2024); 1323006 (2024) https://doi.org/10.1117/12.3035585
Event: Third International Conference on Machine Vision, Automatic Identification and Detection, 2024, Kunming, China

Abstract

Image-to-point cloud registration is the task of fusing 2D images with 3D point clouds, typically combining the rich texture information from images with the spatial information from point clouds for a more comprehensive scene representation. However, the feature discrepancy between different modalities often makes it challenging to accurately match. Addressing this issue, this paper proposes an image-matching-based algorithm for image-to-point cloud registration. Initially, for cross-modal issues, we use 3D visualization tools to screenshot the 3D models, reading the camera information of the screenshots to establish a correspondence between the 3D models and 2D images. By employing a pretrained image matching model, the algorithm extracts keypoints and matches images of the screenshots and images, establishing image keypoints pairing relationships. Then, using the camera projection model, it maps the 3D coordinates to image keypoints, obtaining image-to-point cloud keypoint pairing relationships and calculating the transformation matrix between the image and 3D point cloud using PnP-RANSAC. The proposed method, compared with the manual annotations method, proves to significantly improve efficiency and stability in real-world scenarios.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Yang Ai and Xi Yang "Image-point cloud registration method based on image matching", Proc. SPIE 13230, Third International Conference on Machine Vision, Automatic Identification, and Detection (MVAID 2024), 1323006 (16 August 2024); https://doi.org/10.1117/12.3035585

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

3D modeling

3D image processing

Image registration

Cameras

3D displays

Point clouds

Data modeling

Show All Keywords

Keywords/Phrases

Search In:

Publication Years