15 November 2023 Image inpainting based on double joint predictive filtering and Wasserstein generative adversarial networks
Yuanchen Liu, Zhongliang Pan
Author Affiliations +
Abstract

Image inpainting is promising but challenging in computer vision tasks; it aims to fill in missing regions of corrupted images with semantically sensible content. By utilizing generative adversarial networks (GAN), state-of-the-art methods have achieved great improvements, but the ordinary GAN generally suffers from difficulties in training and unstable gradients, leading to unsatisfactory inpainting results. Image-level predictive filtering is a widely used restoration method that adaptively predicts the weights of pixels around a target pixel and then linearly combines these pixels to generate the image, but it cannot fill larger missing regions. Thus, we extend image-level predictive filtering to the deep feature level through an encoder–decoder network and embed adaptive channel attention and spatial attention modules in the encoder network. We use Wasserstein GAN instead of normal GAN due to its superior properties and then combine it with image-level predictive filtering and deep feature-level predictive filtering, which ultimately leads to a significant improvement in image inpainting. We validate our method on two public datasets: CelebA-HQ and Places2. Our method demonstrates good performance across four metrics: peak signal-to-noise ratio, L1, structural similarity index measure, and learned perceptual image patch similarity.

© 2023 SPIE and IS&T
Yuanchen Liu and Zhongliang Pan "Image inpainting based on double joint predictive filtering and Wasserstein generative adversarial networks," Journal of Electronic Imaging 32(6), 063008 (15 November 2023). https://doi.org/10.1117/1.JEI.32.6.063008
Received: 10 May 2023; Accepted: 31 October 2023; Published: 15 November 2023
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Image filtering

Tunable filters

Image restoration

Gallium nitride

Education and training

Semantics

Feature extraction

Back to Top