Mature tomato recognition and location algorithm based on binocular vision and deep learning

Guohua Gao; Ciyin Shuai; Shuangyou Wang

doi:10.1117/12.2667265

1 March 2023 Mature tomato recognition and location algorithm based on binocular vision and deep learning

Guohua Gao, Ciyin Shuai, Shuangyou Wang

Proceedings Volume 12588, International Conference on Artificial Intelligence, Virtual Reality, and Visualization (AIVRV 2022); 125880T (2023) https://doi.org/10.1117/12.2667265
Event: International Conference on Artificial Intelligence, Virtual Reality, and Visualization (AIVRV 2022), 2022, Chongqing, China

Abstract

This paper proposes a method combining binocular vision and deep learning to identify and locate ripe tomatoes in greenhouses. First, the CBAM attention mechanism module is added to the YOLO V3 model to improve the robustness of the YOLO V3 model to the greenhouse environment, and then the tomato results identified by the improved YOLOV3 CBAM are fused with the three-dimensional information obtained by the binocular stereo camera. to obtain the threedimensional position information of the tomato fruit. After testing, the model has an accuracy of 89.15% for tomato recognition, the AP is 86.17%, and the F1 value is 82%. The relative error of the tomato fruit positioning is less than 1.5%. Finally, the model was arranged in the greenhouse to test the tomato picking robot, which verifies the practicability of the method.

Citation Download Citation

Guohua Gao, Ciyin Shuai, and Shuangyou Wang "Mature tomato recognition and location algorithm based on binocular vision and deep learning", Proc. SPIE 12588, International Conference on Artificial Intelligence, Virtual Reality, and Visualization (AIVRV 2022), 125880T (1 March 2023); https://doi.org/10.1117/12.2667265

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available