Preprocessing high-definition images: interpretable feature extraction with pre-trained StyleGAN

Ke Zhang; Wenning Hao; Xiaohan Yu; Tianhao Shao; Qiuhui Shen

doi:10.1117/12.3008039

14 November 2023 Preprocessing high-definition images: interpretable feature extraction with pre-trained StyleGAN

Ke Zhang, Wenning Hao, Xiaohan Yu, Tianhao Shao, Qiuhui Shen

Proceedings Volume 12934, Third International Conference on Computer Graphics, Image, and Virtualization (ICCGIV 2023); 129340U (2023) https://doi.org/10.1117/12.3008039
Event: 2023 3rd International Conference on Computer Graphics, Image and Virtualization (ICCGIV 2023), 2023, Nanjing, China

Abstract

The interpretable image classifier VAE-FNN can extract high-level features for classification from complex image information and provide explanations that are consistent with human intuition. However, due to the insufficient reconstruction ability of VAE, there are still challenges in feature extraction and interpretable classification for highdefinition images. An image preprocessing method is proposed in this paper and a model named E2GAN that can extract low-dimensional interpretable features from high-definition images is constructed. The model is based on a pre-trained StyleGAN generator, and two mapping networks are trained, one for extracting the low-dimensional compressed encoding of the input image and the other for restoring it to the matrix representation required by the StyleGAN generator, which effectively improves the quality of feature extraction and image reconstruction. A discriminator is introduced to perform adversarial training with the mapping network, further improving the realism of the reconstructed image. The training algorithm of the E2GAN model is designed, and a decoupling loss for the low-dimensional encoding is added to further improve its semantic interpretability. Experiments on the CelebA-HQ dataset show that the E2GAN model can extract low-dimensional, semantically informative features from high-definition images, which can be used to train high-precision and interpretable fuzzy neural network classifiers.

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Ke Zhang, Wenning Hao, Xiaohan Yu, Tianhao Shao, and Qiuhui Shen "Preprocessing high-definition images: interpretable feature extraction with pre-trained StyleGAN", Proc. SPIE 12934, Third International Conference on Computer Graphics, Image, and Virtualization (ICCGIV 2023), 129340U (14 November 2023); https://doi.org/10.1117/12.3008039

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
11 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Image classification

Feature extraction

Fuzzy logic

Classification systems

Semantics

Artificial neural networks

Face image reconstruction

Keywords/Phrases

Search In:

Publication Years