Using foundational models to bridge the synthetic-measured gap

Jeremy Cavallo; Edmund Zelnio

doi:10.1117/12.3013455

7 June 2024 Using foundational models to bridge the synthetic-measured gap

Jeremy Cavallo, Edmund Zelnio

Author Affiliations +

Proceedings Volume 13032, Algorithms for Synthetic Aperture Radar Imagery XXXI; 130320I (2024) https://doi.org/10.1117/12.3013455
Event: SPIE Defense + Commercial Sensing, 2024, National Harbor, Maryland, United States

Abstract

Due to the differences in the statistical distributions of synthetic versus measured synthetic aperture (SAR) images, it is difficult to train a deep learning model on synthetic images to accurately classify measured images. This research utilizes the enormous computing power required to train foundational models. and approaches the problem from a transfer learning perspective. Since foundational models have been trained on 10’s of billions of images, they have feature extraction capabilities far beyond what is possible with standard computational restrictions and greatly reduced data availability. Therefore, we utilize the foundational model’s feature extraction capabilities and transfer them to the synthetic-measured gap problem. The hypothesis is that the very rich features resulting from the foundational models trained almost exclusively on EO images can be transferred to the SAR classification problem using synthetic SAR data for training while minimizing the need for measured SAR data.

Conference Presentation

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Jeremy Cavallo and Edmund Zelnio "Using foundational models to bridge the synthetic-measured gap", Proc. SPIE 13032, Algorithms for Synthetic Aperture Radar Imagery XXXI, 130320I (7 June 2024); https://doi.org/10.1117/12.3013455

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE