Advancing weakly supervised semantic segmentation using class activation map augmented with graph attention module

Xin Lin

doi:10.1117/12.3026286

9 February 2024 Advancing weakly supervised semantic segmentation using class activation map augmented with graph attention module

Xin Lin

Author Affiliations +

Proceedings Volume 13073, Third International Conference on High Performance Computing and Communication Engineering (HPCCE 2023); 1307319 (2024) https://doi.org/10.1117/12.3026286
Event: Third International Conference on High Performance Computing and Communication Engineering (HPCCE 2023), 2023, Changsha, China

Abstract

In the field of computer vision, Weakly Supervised Semantic Segmentation (WSSS) at the image level poses a significant research challenge. Existing WSSS methods primarily rely on class activation maps (CAM). Due to the disparity between fully-supervised and weakly-supervised approaches, CAM often yields imprecise and coarse semantic information in generating target masks. To address the issues of semantic coarseness and detail loss in image-level WSSS, this paper introduces a novel approach that utilizes pixel-level relationships to optimize and refine the features extracted by the network. Maintaining the foundation of image-level class label weak supervision for semantic segmentation, this study forgoes extensive modifications to the model structure in favor of incorporating a Graph Attention Module (GAM). This module, by constructing a weighted undirected graph with pixels as vertices and pixel affinity as edges, simulates the interactions among neighboring pixels in graph representation learning. Such an arrangement allows for the effective propagation and integration of relational information between pixels, thereby enhancing the overall representational quality of the image. By employing graph constraints to facilitate semantic dissemination, our method optimizes the network’s localization map, resulting in more precise CAMs and more accurate pseudo-labels for subsequent semantic segmentation network training. To evaluate our approach, we conducted quantity and quality experiments on the PASCAL VOC 2012 and MS COCO 2014 datasets. Compared to existing advanced weakly-supervised semantic segmentation methods, our approach shows notable improvements in performance.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Xin Lin "Advancing weakly supervised semantic segmentation using class activation map augmented with graph attention module", Proc. SPIE 13073, Third International Conference on High Performance Computing and Communication Engineering (HPCCE 2023), 1307319 (9 February 2024); https://doi.org/10.1117/12.3026286

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Content addressable memory

Semantics

Education and training

Image segmentation

Image classification

Image enhancement

RGB color model

Show All Keywords

Keywords/Phrases

Search In:

Publication Years