UAV-based multi-sensor multi-platform integration for high throughput phenotyping

Radhika Ravi; Seyyed Meghdad Hasheminasab; Tian Zhou; Ali Masjedi; Karoll Quijano; John Evan Flatt; Melba Crawford; Ayman Habib

doi:10.1117/12.2519190

14 May 2019 UAV-based multi-sensor multi-platform integration for high throughput phenotyping

Radhika Ravi, Seyyed Meghdad Hasheminasab, Tian Zhou, Ali Masjedi, Karoll Quijano, John Evan Flatt, Melba Crawford, Ayman Habib

Author Affiliations +

Proceedings Volume 11008, Autonomous Air and Ground Sensing Systems for Agricultural Optimization and Phenotyping IV; 110080E (2019) https://doi.org/10.1117/12.2519190
Event: SPIE Defense + Commercial Sensing, 2019, Baltimore, MD, United States

Abstract

In recent days, phenotyping of various crops is gaining widespread popularity due to its ability to recognize variations in the effects of different genotypes of a particular crop in terms of its growth, yield, biomass, and so on. Such an application requires extensive data collection and analysis with a high spatial and temporal resolution, which can be attained using multiple sensors onboard Unmanned Aerial Vehicles (UAVs). In this study, we focus on harnessing information from a variety of sensors, such as RGB cameras, LiDAR units, and push-broom hyperspectral sensors – Short-wave Infrared (SWIR) and Visible Near Infrared (VNIR). The major challenge that needs to be overcome in this regard is to ensure an accurate integration of information captured across several days from the different sensor modalities. Moreover, the payload constraint for UAVs restrain us from mounting all the sensors simultaneously during a single flight mission, thus entailing the need for data capture from different sensors mounted on separate platforms that are flown individually over the agricultural field of interest. The first step towards integration of different data modalities is the generation of georeferenced products from each of the flight missions, which is accomplished with the help of Global Navigation Satellite Systems (GNSS) and Inertial Navigation Systems (INS) mounted on the UAVs that are time-synchronized with the onboard LiDAR units, cameras and/or hyperspectral sensors. Furthermore, an accurate georeferencing is achieved by developing robust calibration approaches dedicated towards accurate estimation of mounting parameters of the involved sensors. Finally, the geometric and spectral characteristics, such as canopy cover and leaf count, derived from the different sensors are used to devise a model to analyze the phenotypic traits of crops. The preliminary results indicate that the proposed calibration techniques can attain an accuracy of upto 3 cm.

Conference Presentation

Citation Download Citation

Radhika Ravi, Seyyed Meghdad Hasheminasab, Tian Zhou, Ali Masjedi, Karoll Quijano, John Evan Flatt, Melba Crawford, and Ayman Habib "UAV-based multi-sensor multi-platform integration for high throughput phenotyping", Proc. SPIE 11008, Autonomous Air and Ground Sensing Systems for Agricultural Optimization and Phenotyping IV, 110080E (14 May 2019); https://doi.org/10.1117/12.2519190

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available