Study of fidelity of synthetic imagery for artificial intelligence (AI) and machine learning (ML) problems

S. Susan Young; Sanjeev Agarwal; Joseph P. Reynolds; Suya You

doi:10.1117/12.2618397

6 June 2022 Study of fidelity of synthetic imagery for artificial intelligence (AI) and machine learning (ML) problems

S. Susan Young, Sanjeev Agarwal, Joseph P. Reynolds, Suya You

Proceedings Volume 12113, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications IV; 121131R (2022) https://doi.org/10.1117/12.2618397
Event: SPIE Defense + Commercial Sensing, 2022, Orlando, Florida, United States

Conference Poster

Abstract

Many studies show that using synthetic data or mixed synthetic and real data might improve machine learning (ML) performance but it is difficult to draw generalizable conclusions. A contribution to this problem is the fact that the synthetic data from most vendors are improperly filtered and contain aliased (wrapped-around) high frequency information which they should not possess. Most vendors use spatial-domain, low-pass FIR filters to generate synthetic images at various ranges. Unfortunately, these FIR filters aim for interpolation with a desired frequency domain cutoff and spatial spacing (general non-integer scale factor and/or decimation). Hence, instead of a sharp cutoff at the desired low-band, they produce aliased data. This erroneous information in synthetic imagery could actually mislead an ML algorithm. In addition, most synthetic images do not account for a camera’s MTF (Modulation Transfer Function). A Fourier-based filtering can easily incorporate any MTF in the frequency domain based on Rayleigh resolution theory, properties of a camera lens and digital image properties. The spectral properties of images which are acquired with real sensors are studied and compared them with synthetic images from several vendors. We have also developed a metric that exhibits that the camera system’s MTF shows the same spectral property for real images at different ranges. The metric can help us to determine if a synthetic image generation engine violates this property and, hence, produces erroneous information.

Citation Download Citation

S. Susan Young, Sanjeev Agarwal, Joseph P. Reynolds, and Suya You "Study of fidelity of synthetic imagery for artificial intelligence (AI) and machine learning (ML) problems", Proc. SPIE 12113, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications IV, 121131R (6 June 2022); https://doi.org/10.1117/12.2618397

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available