Paper
25 March 2024 Multi-view self-supervised product quantization for robust fabric image retrieval
Yudan Zhuo, Shangping Zhong, Kaizhi Chen
Author Affiliations +
Proceedings Volume 13089, Fifteenth International Conference on Graphics and Image Processing (ICGIP 2023); 1308917 (2024) https://doi.org/10.1117/12.3021129
Event: Fifteenth International Conference on Graphics and Image Processing (ICGIP 2023), 2023, Suzhou, China
Abstract
Currently, fabric image retrieval faces challenges such as the high cost of image annotation and its vulnerability to adversarial perturbations. To minimize manual supervision and enhance the robustness of the retrieval system, this study proposes a robust deep image retrieval algorithm using multi-view self-supervised product quantization for artificially generated fabric images. The method introduces a multi-view module, which includes two views enhanced by AutoAugment, an adversarial view and a high-frequency view of the unlabeled images. AutoAugment can generate more varied data variations, which allows the model to learn more about the different features and structures of the fabric texture; fabric images are usually of high complexity and diversity, and adding the adversarial sample into the model training can add more noise and variations, which is one of the best existing ways to defend against adversarial attacks; the high-frequency component can make the edges, details, and contrasts in the fabric image clearer. A robust cross quantized contrastive loss function is also designed to jointly learn codewords and deep visual descriptors by comparing multiple views, effectively increasing the model’s robustness and generalization. The method's effectiveness is demonstrated by experimental results on multiple datasets, which can significantly improve the robustness of the retrieval system compared to other state-of-the-art retrieval algorithms. Our method presents a new approach for fabric image retrieval and has great significance for improving its performance.
(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.
Yudan Zhuo, Shangping Zhong, and Kaizhi Chen "Multi-view self-supervised product quantization for robust fabric image retrieval", Proc. SPIE 13089, Fifteenth International Conference on Graphics and Image Processing (ICGIP 2023), 1308917 (25 March 2024); https://doi.org/10.1117/12.3021129
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
Back to Top