Multimodal heartbeat rate estimation from the fusion of facial RGB and thermal videos

Anders S. Johansen; Jesper W. Henriksen; Mohammad A. Haque; Mohammad Naser Sabet Jahromi; Kamal Nasrollahi; Thomas B. Moeslund

doi:10.1117/12.2523385

15 March 2019 Multimodal heartbeat rate estimation from the fusion of facial RGB and thermal videos

Anders S. Johansen, Jesper W. Henriksen, Mohammad A. Haque, Mohammad Naser Sabet Jahromi, Kamal Nasrollahi, Thomas B. Moeslund

Author Affiliations +

Proceedings Volume 11041, Eleventh International Conference on Machine Vision (ICMV 2018); 110410R (2019) https://doi.org/10.1117/12.2523385
Event: Eleventh International Conference on Machine Vision (ICMV 2018), 2018, Munich, Germany

Abstract

Measuring Heartbeat Rate (HR) is an important tool for monitoring the health of a person. When the heart beats the influx of blood to the head causes slight involuntary movement and subtle skin color changes, which cannot be seen by the naked eye but can be tracked from facial videos using computer vision techniques and can be analyzed to estimate the HR. However, the current state of the art solutions encounter an increasing amount of complications when the subject has voluntary motion on the face or when the lighting conditions change in the video. Thus the accuracy of the HR estimation using computer vision is still inferior to that of a physical Electrocardiography (ECG) based system. The aim of this work is to improve the current non-invasive HR measurement by fusing the motion-based and color-based HR estimation methods and using them on multiple input modalities, e.g., RGB and thermal imaging. Our experiments indicate that late-fusion of the results of these methods (motion and color-based) applied to these different modalities, produces more accurate results compared to the existing solutions

Citation Download Citation

Anders S. Johansen, Jesper W. Henriksen, Mohammad A. Haque, Mohammad Naser Sabet Jahromi, Kamal Nasrollahi, and Thomas B. Moeslund "Multimodal heartbeat rate estimation from the fusion of facial RGB and thermal videos", Proc. SPIE 11041, Eleventh International Conference on Machine Vision (ICMV 2018), 110410R (15 March 2019); https://doi.org/10.1117/12.2523385

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

RGB color model

Video

Electrocardiography

Thermography

Head

Databases

Motion estimation

Show All Keywords

Keywords/Phrases

Search In:

Publication Years