Individual maize extraction from UAS imagery-based point clouds by 3D deep learning

Monica Herrero-Huerta; Seth Tolley; Mitchell R. Tuinstra; Yang Yang

doi:10.1117/12.2587100

12 April 2021 Individual maize extraction from UAS imagery-based point clouds by 3D deep learning

Monica Herrero-Huerta, Seth Tolley, Mitchell R. Tuinstra, Yang Yang

Proceedings Volume 11747, Autonomous Air and Ground Sensing Systems for Agricultural Optimization and Phenotyping VI; 1174704 (2021) https://doi.org/10.1117/12.2587100
Event: SPIE Defense + Commercial Sensing, 2021, Online Only

Abstract

Automated and cost-effective phenotyping pipelines are needed to efficiently characterize new lines and hybrids developed in plant breeding programs. In this study, we employ deep neural networks (DNNs) to model individual maize plants using 3D point cloud data derived from unmanned aerial systems (UAS) imagery by PointNet network. The experimental setup was performed at the Indiana Corn and Soybean Innovation Center at the Agronomy Center for Research and Education (ACRE) in West Lafayette, Indiana, USA. On June 17th, 2020 a flight was carried out over maize trials using a custom designed UAS platform with a Sony Alpha ILCE-7R photogrammetric sensor. RGB images were processed by a standard photogrammetric pipeline by Structure from Motion (SfM) to reconstruct the study field into a final scaled 3D point cloud. 50 individual maize plants were manually segmented from the point cloud to train the DNN and subsequently individual plants were extracted over a test trial with more than 5,000 plants. Moreover, to reduce overfitting in the fully-connected layers, we employed data augmentation not only in translation, but also in color intensity. Results show a successful rate for the extraction of the individual plants of 72.4%. Our test trial demonstrates the possibility of using deep learning to overcome the individual maize extraction challenge on the basis of UAS data.

Conference Presentation

Citation Download Citation

Monica Herrero-Huerta, Seth Tolley, Mitchell R. Tuinstra, and Yang Yang "Individual maize extraction from UAS imagery-based point clouds by 3D deep learning", Proc. SPIE 11747, Autonomous Air and Ground Sensing Systems for Agricultural Optimization and Phenotyping VI, 1174704 (12 April 2021); https://doi.org/10.1117/12.2587100

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available