A real-time driver monitoring system using a high sensitivity camera

Leyi Tan; Masashi Hakamata; Chen Cao; Keiichiro Kagawa; Norimichi Tsumura; Shoji Kawahito

doi:10.1117/12.2507181

21 February 2019 A real-time driver monitoring system using a high sensitivity camera

Leyi Tan, Masashi Hakamata, Chen Cao, Keiichiro Kagawa, Norimichi Tsumura, Shoji Kawahito

Proceedings Volume 10883, Three-Dimensional and Multidimensional Microscopy: Image Acquisition and Processing XXVI; 108831G (2019) https://doi.org/10.1117/12.2507181
Event: SPIE BiOS, 2019, San Francisco, California, United States

Abstract

Traffic accidents and mental stress are strongly correlated. Drivers under pressure are more easily to cause accidents. A system which could describe the mental state of a driver would be helpful to avoid such accidents. Multiple indices derived from analysis of heart rate variability (HRV) could be used in the estimation of mental state in humans; moreover, recent years, methods of non-contact heart rate estimation have been well studied and reached high accuracy. Based on both, we developed a real-time driver monitoring system which could not only estimate heart rate of the driver, but also indicate whether he is under pressure or not. This system delivers 2 outputs: heart rate(HR) and mental stress level (stress index). We utilized an 18-bit camera to grab frontal facial frames and independent component analysis (ICA) to extract haemoglobin signal from each frame. After temporal filtering and peak detection, R-R interval(RRI) will be obtained and HR measured. Mental stress estimation will start 30 seconds after we get the first RRI data, then a power spectrum analysis method will be applied to all of the HRV data within 30 seconds to generate powers of Low-Frequency and High-Frequency band data. The ratio of the powers in both bands, so called LF-HF ratio (LF/HF), will be delivered as a stress index to quantify the degree of mental stress. Finally, the validity of stress index is verified over arithmetic calculation and a number of driving-simulating scenarios.

Citation Download Citation

Leyi Tan, Masashi Hakamata, Chen Cao, Keiichiro Kagawa, Norimichi Tsumura, and Shoji Kawahito "A real-time driver monitoring system using a high sensitivity camera", Proc. SPIE 10883, Three-Dimensional and Multidimensional Microscopy: Image Acquisition and Processing XXVI, 108831G (21 February 2019); https://doi.org/10.1117/12.2507181

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available