Unsupervised change detection in multi-modal SAR images using CycleGAN

Luca Bergamasco; Francesca Bovolo

doi:10.1117/12.2637433

26 October 2022 Unsupervised change detection in multi-modal SAR images using CycleGAN

Luca Bergamasco, Francesca Bovolo

Proceedings Volume 12267, Image and Signal Processing for Remote Sensing XXVIII; 122670F (2022) https://doi.org/10.1117/12.2637433
Event: SPIE Remote Sensing, 2022, Berlin, Germany

Abstract

Many Change Detection (CD) methods exploit the bi-temporal multi-modal data derived by multiple sensors to find the changes effectively. State-of-the-Art CD methods define features with a common domain between the multi-modal data by normalizing input images or ad hoc feature extraction/selection methods. Deep Learning (DL) CD methods automatically learn features with a common domain during the training or adapt the features derived by multi-modal data. However, CD methods focusing on multi-sensor multi-frequency SAR data are still poorly investigated. We propose a DL CD method that exploits a Cycle Generative Adversarial Network (CycleGAN) to automatically learn and extract multi-scale feature maps in a domain common to the input multifrequency multi-sensor SAR data. The feature maps are learned, during unsupervised training, by generators that aim to transform the input data domain into the target one while preserving the semantic information and aligning the feature domain. We process the multi-sensor multi-frequency SAR data with the trained generators to produce bi-temporal multi-scale feature maps that are compared to enhance changes. A standard-deviation-based feature selection is applied to keep only the most informative comparisons and reject the ones with poor change information. The multi-scale comparisons are used for a detail preserving CD. Preliminary experimental results conducted on bi-temporal SAR data acquired by Cosmo-SkyMed and SAOCOM on the urban area of Milan, Italy, in January 2020 and August 2021 provided promising results.

Citation Download Citation

Luca Bergamasco and Francesca Bovolo "Unsupervised change detection in multi-modal SAR images using CycleGAN", Proc. SPIE 12267, Image and Signal Processing for Remote Sensing XXVIII, 122670F (26 October 2022); https://doi.org/10.1117/12.2637433

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
10 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Synthetic aperture radar

Feature extraction

Buildings

Backscatter

Image processing

Spatial resolution

Feature selection

Show All Keywords

Keywords/Phrases

Search In:

Publication Years