Visuo-tactile pose tracking method for in-hand robot manipulation tasks of quotidian objects

Camille Taglione; Carlos M. Mateo; Christophe Stolz

doi:10.1117/12.2690812

28 July 2023 Visuo-tactile pose tracking method for in-hand robot manipulation tasks of quotidian objects

Camille Taglione, Carlos M. Mateo, Christophe Stolz

Proceedings Volume 12749, Sixteenth International Conference on Quality Control by Artificial Vision; 127490I (2023) https://doi.org/10.1117/12.2690812
Event: Sixteenth International Conference on Quality Control by Artificial Vision, 2023, Albi, France

Abstract

After more than three decades of research in robot manipulation problems, we observed a considerable level of maturity in different related problems. Many high-performant objects pose tracking exists, one of the main problems for these methods is the robustness again occlusion during in-hand manipulation. This work presents a new multimodal perception approach in order to estimate the pose of an object during an in-hand manipulation. Here, we propose a novel learning-based approach to recover the pose of an object in hand by using a regression method. Particularly, we fuse the visual-based tactile information and depth visual information in order to overpass occlusion problems commonly presented during robot manipulation tasks. Our method is trained and evaluated using simulation. We compare the proposed method against different state-of-the-art approaches to show its robustness in hard scenarios. The recovered results show a reliable increment in performance, while they are obtained using a benchmark in order to obtain replicable and comparable results.

Citation Download Citation

Camille Taglione, Carlos M. Mateo, and Christophe Stolz "Visuo-tactile pose tracking method for in-hand robot manipulation tasks of quotidian objects", Proc. SPIE 12749, Sixteenth International Conference on Quality Control by Artificial Vision, 127490I (28 July 2023); https://doi.org/10.1117/12.2690812

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available