"Can you see me now?" An objective metric for predicting intelligibility of compressed American Sign Language video

Francis M. Ciaramello; Sheila S. Hemami

doi:10.1117/12.707448

14 March 2007 "Can you see me now?" An objective metric for predicting intelligibility of compressed American Sign Language video

Francis M. Ciaramello, Sheila S. Hemami

Author Affiliations +

Proceedings Volume 6492, Human Vision and Electronic Imaging XII; 64920M (2007) https://doi.org/10.1117/12.707448
Event: Electronic Imaging 2007, 2007, San Jose, CA, United States

Abstract

For members of the Deaf Community in the United States, current communication tools include TTY/TTD services, video relay services, and text-based communication. With the growth of cellular technology, mobile sign language conversations are becoming a possibility. Proper coding techniques must be employed to compress American Sign Language (ASL) video for low-rate transmission while maintaining the quality of the conversation. In order to evaluate these techniques, an appropriate quality metric is needed. This paper demonstrates that traditional video quality metrics, such as PSNR, fail to predict subjective intelligibility scores. By considering the unique structure of ASL video, an appropriate objective metric is developed. Face and hand segmentation is performed using skin-color detection techniques. The distortions in the face and hand regions are optimally weighted and pooled across all frames to create an objective intelligibility score for a distorted sequence. The objective intelligibility metric performs significantly better than PSNR in terms of correlation with subjective responses.

Citation Download Citation

Francis M. Ciaramello and Sheila S. Hemami ""Can you see me now?" An objective metric for predicting intelligibility of compressed American Sign Language video", Proc. SPIE 6492, Human Vision and Electronic Imaging XII, 64920M (14 March 2007); https://doi.org/10.1117/12.707448

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available