Machine learning of human responses to images

Miles N. Wernick; Yongyi Yang; Jovan G. Brankov; Liyang Wei; Nikolas P. Galatsanos; Issam El-Naqa

doi:10.1117/12.658072

2 February 2006 Machine learning of human responses to images

Miles N. Wernick, Yongyi Yang, Jovan G. Brankov, Liyang Wei, Nikolas P. Galatsanos, Issam El-Naqa

Proceedings Volume 6065, Computational Imaging IV; 60650S (2006) https://doi.org/10.1117/12.658072
Event: Electronic Imaging 2006, 2006, San Jose, California, United States

Abstract

The human user is an often ignored component of the imaging chain. In medical diagnostic tasks, the human observer plays the role of the decision-maker, forming opinions based on visual assessment of images. In content-based image retrieval, the human user is the ultimate judge of the relevance of images recalled from a database. We argue that data collected from human observers should be used in conjunction with machine-learning algorithms to model and optimize performance in tasks that involve humans. In essence, we treat the human observer as a nonlinear system to be identified. In this paper, we review our work in two applications of this general idea. In the first, a learning machine is trained to predict the accuracy of human observers in a lesion detection task for purposes of assessing image quality. In the second, a learning machine is trained to predict human users' perception of the similarity of two images for purposes of content-based image retrieval from a database. In both examples, it is shown that a nonlinear learning machine can accurately identify the nonlinear human system that maps images into numerical values, such as detection performance or image similarity.

Citation Download Citation

Miles N. Wernick, Yongyi Yang, Jovan G. Brankov, Liyang Wei, Nikolas P. Galatsanos, and Issam El-Naqa "Machine learning of human responses to images", Proc. SPIE 6065, Computational Imaging IV, 60650S (2 February 2006); https://doi.org/10.1117/12.658072

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available