Automated visual inspection of friction stir welds: a deep learning approach

R. Hartl; J. Landgraf; J. Spahl; A. Bachmann; M. F. Zaeh

doi:10.1117/12.2525947

21 June 2019 Automated visual inspection of friction stir welds: a deep learning approach

R. Hartl, J. Landgraf, J. Spahl, A. Bachmann, M. F. Zaeh

Proceedings Volume 11059, Multimodal Sensing: Technologies and Applications; 1105909 (2019) https://doi.org/10.1117/12.2525947
Event: SPIE Optical Metrology, 2019, Munich, Germany

Abstract

Friction stir welding is a solid-state welding process. The technology is used in high precision applications such as aerospace. Thus, monitoring the weld quality is highly relevant for detecting inaccurate welds. Various studies have shown a significant dependence of the weld quality on the welding speed and the rotational speed of the tool. Frequently, an unsuitable setting of these parameters can be detected by visual examination of the resulting surface defects, such as increased flash formation or surface galling. The visual inspection for these defects is often conducted manually and is therefore associated with increased costs and personnel effort. In this work, a deep learning approach to automatically detect irregularities on the weld surface is introduced. For training and testing of the artificial neural networks, 112 welds with a total length of 18.4 m were produced. Color images of the welds were taken using a digital camera and images of the weld surface topography were made with a three-dimensional profilometer. The approach consisted of a two-step procedure. First, an object detector using a neural network localized the friction stir weld on the image. Second, a neural network classified the surface properties of the weld seam. The object detector localized the friction stir welds with an intersection over union up to 89.5%. The best result in classifying the surface properties was achieved by using the topography images. Thereby, a classification accuracy of 92. % was reached by the convolutional neural network DenseNet-121. The results are the basis for the future development of an inline quality monitoring and parameter control method for friction stir welding.

Citation Download Citation

R. Hartl, J. Landgraf, J. Spahl, A. Bachmann, and M. F. Zaeh "Automated visual inspection of friction stir welds: a deep learning approach", Proc. SPIE 11059, Multimodal Sensing: Technologies and Applications, 1105909 (21 June 2019); https://doi.org/10.1117/12.2525947

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available