A multimodal fusion-based autoencoder for nondestructive evaluation of aircraft structures

Yanshuo Fan; Rakiba Rayhana; Yue Cao; Catalin Mandache; Zheng Liu

doi:10.1117/12.2658031

25 April 2023 A multimodal fusion-based autoencoder for nondestructive evaluation of aircraft structures

Yanshuo Fan, Rakiba Rayhana, Yue Cao, Catalin Mandache, Zheng Liu

Proceedings Volume 12489, NDE 4.0, Predictive Maintenance, Communication, and Energy Systems: The Digital Transformation of NDE; 124890M (2023) https://doi.org/10.1117/12.2658031
Event: SPIE Smart Structures + Nondestructive Evaluation, 2023, Long Beach, California, United States

Conference Poster

Abstract

The effects of the lightning strike on composite aircraft structures have been an active research area in the aviation industry, given the concern over safe aircraft operations. To maintain safe operations, civil and military regulators require effective approaches to assess and quantify the severity of lightning damage. Although x-rays are commonly used to determine material damage in aircraft structures, the technique requires access to both sides of the investigated part. This paper proposes a novel autoencoder model to check the feasibility of evaluating the damage to carbon fiber reinforced polymers (CFRP) panels from the outer surface of in-service aircraft structures. Two alternative techniques to x-ray, such as ultrasonic testing (UT) and infrared thermography (IR), nondestructive evaluation methods, are employed to develop the proposed model. The fusion model uses U-net as the backbone and spatial attention fusion as the fusion strategy while combining structural similarity index (SSIM) and perceptual losses as the loss function. Also, the log-Gabor filter is used in the model to obtain high-frequency edge information for fusion. The results are then compared against five state-of-the-art fusion methods, revealing that the proposed model performs better in quantifying the lightning damage to aircraft CFRP structures.

Citation Download Citation

Yanshuo Fan, Rakiba Rayhana, Yue Cao, Catalin Mandache, and Zheng Liu "A multimodal fusion-based autoencoder for nondestructive evaluation of aircraft structures", Proc. SPIE 12489, NDE 4.0, Predictive Maintenance, Communication, and Energy Systems: The Digital Transformation of NDE, 124890M (25 April 2023); https://doi.org/10.1117/12.2658031

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available