CONFERENCE PROCEEDINGS
Advanced Search
Home > Proceedings > Volume 12587 > Article
Paper
22 February 2023 Reference aware attention based medical image diagnosis
Qidan Dai, Wenhui Shen, Pike Xu, Heng Xiao, Xiao Qin
Author Affiliations +
Proceedings Volume 12587, Third International Seminar on Artificial Intelligence, Networking, and Information Technology (AINIT 2022); 1258719 (2023) https://doi.org/10.1117/12.2667605
Event: Third International Seminar on Artificial Intelligence, Networking, and Information Technology (AINIT 2022), 2022, Shanghai, China
Abstract
Given the excellent globality and parallelism, Transformer has been widely applied to image tasks. Visual Transformers demand modeling the spatial correlations among visual tokens. However, those existing methods either only emphasize the relative position between two tokens, or only concern on their contexts. Intuitively, a rational attention distribution should hinge on both. To this end, this paper proposes Reference Aware Attention (RAA). RAA decomposes inner-tokens dependency into three intuitive factors, in which reference bias is introduced to model how a reference token attends to a region. Experimental results suggest that RAA can effectively promote the performances of visual Transformers on various medical image diagnosis tasks.
© (2023) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Citation Download Citation
Qidan Dai, Wenhui Shen, Pike Xu, Heng Xiao, and Xiao Qin "Reference aware attention based medical image diagnosis", Proc. SPIE 12587, Third International Seminar on Artificial Intelligence, Networking, and Information Technology (AINIT 2022), 1258719 (22 February 2023); https://doi.org/10.1117/12.2667605
ACCESS THE FULL ARTICLE
ORGANIZATIONAL
Sign in with credentials provided by your organization.
INSTITUTIONAL
Select your institution to access the SPIE Digital Library.
SELECT YOUR INSTITUTION
PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.
PERSONAL SIGN IN
No SPIE Account? Create one
PURCHASE THIS CONTENT
SUBSCRIBE TO DIGITAL LIBRARY
50 downloads per 1-year subscription
Members: $195
Non-members: $335 ADD TO CART
25 downloads per 1 - year subscription
Members: $145
Non-members: $250 ADD TO CART
PURCHASE SINGLE ARTICLE
Includes PDF, HTML & Video, when available
Members: $17.00
Non-members: $21.00 ADD TO CART
PROCEEDINGS
 4 PAGES
DOWNLOAD PAPER SAVE TO MY LIBRARY
GET CITATION
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Transformers
Visualization
Medical imaging
RELATED CONTENT
Subscribe to Digital Library
Receive Erratum Email Alert
Back to Top