English
Related papers

Related papers: MHAD: Multimodal Home Activity Dataset with Multi-…

200 papers

Video-based heart and respiratory rate measurements using facial videos are more useful and user-friendly than traditional contact-based sensors. However, most of the current deep learning approaches require ground-truth pulse and…

Image and Video Processing · Electrical Eng. & Systems 2024-01-12 Yusuke Akamatsu , Terumi Umematsu , Hitoshi Imaoka

Remote photoplethysmography (rPPG) enables non-contact heart rate measurement from facial videos, but its performance is significantly degraded by facial motions such as speaking and head shaking. To address this issue, we propose two…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Gan Pei , Junhao Ning , Boqiu Shen , Yan Zhu , Menghan Hu

Remote photoplethysmography (rPPG) is a non-contact technique for measuring cardiac signals from facial videos. High-quality rPPG pulse signals are urgently demanded in many fields, such as health monitoring and emotion recognition.…

Image and Video Processing · Electrical Eng. & Systems 2020-06-05 Rencheng Song , Huan Chen , Juan Cheng , Chang Li , Yu Liu , Xun Chen

This paper introduces EgoMAGIC (Medical Assistance, Guidance, Instruction, and Correction), an egocentric medical activity dataset collected as part of DARPA's Perceptually-enabled Task Guidance (PTG) program. This dataset comprises 3,355…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Brian VanVoorst , Nicholas Walczak , Christopher Gilleo , Charles Meissner , Fabio Felix , Iran Roman , Bea Steers , Claudio Silva , Yuhan Shen , Zijia Lu , Shih-Po Lee , Ehsan Elhamifar

The COVID-19 pandemic has underscored the need for low-cost, scalable approaches to measuring contactless vital signs, either during initial triage at a healthcare facility or virtual telemedicine visits. Remote photoplethysmography (rPPG)…

Image and Video Processing · Electrical Eng. & Systems 2024-11-26 Sandeep Nagar , Mark Hasegawa-Johnson , David G. Beiser , Narendra Ahuja

Heart rate (HR) is an important physiological signal that reflects the physical and emotional status of a person. Traditional HR measurements usually rely on contact monitors, which may cause inconvenience and discomfort. Recently, some…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Xuesong Niu , Shiguang Shan , Hu Han , Xilin Chen

Transforming static images into interactive experiences remains a challenging task in computer vision. Tackling this challenge holds the potential to elevate mobile user experiences, notably through interactive and AR/VR applications.…

Photoplethysmography (PPG) sensors allow for non-invasive and comfortable heart-rate (HR) monitoring, suitable for compact wrist-worn devices. Unfortunately, Motion Artifacts (MAs) severely impact the monitoring accuracy, causing high…

We show, for the first time, that neural networks trained only on synthetic data achieve state-of-the-art accuracy on the problem of 3D human pose and shape (HPS) estimation from real images. Previous synthetic datasets have been small,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Michael J. Black , Priyanka Patel , Joachim Tesch , Jinlong Yang

Unsupervised remote photoplethysmography (rPPG) promises to leverage unlabeled video data, but its potential is hindered by a critical challenge: training on low-quality "in-the-wild" videos severely degrades model performance. An essential…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Tianyang Dai , Ming Chang , Yan Chen , Yang Hu

Remote photoplethysmography (rPPG), enabling non-contact physiological monitoring through facial light reflection analysis, faces critical computational bottlenecks as deep learning introduces performance gains at the cost of prohibitive…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Kegang Wang , Jiankai Tang , Yuxuan Fan , Jiatong Ji , Yuanchun Shi , Yuntao Wang

Remote photoplethysmography (rPPG) is an important technique for perceiving human vital signs, which has received extensive attention. For a long time, researchers have focused on supervised methods that rely on large amounts of labeled…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Xin Liu , Yuting Zhang , Zitong Yu , Hao Lu , Huanjing Yue , Jingyu Yang

In recent years, considerable progress has been made in the non-contact based detection of the respiration rate from video sequences. Common techniques either directly assess the movement of the chest due to breathing or are based on…

Image and Video Processing · Electrical Eng. & Systems 2019-06-20 Fabian Schrumpf , Christoph Moench , Gerold Bausch , Mirco Fuchs

This document introduces the PHYTMO database, which contains data from physical therapies recorded with inertial sensors, including information from an optical reference system. PHYTMO includes the recording of 30 volunteers, aged between…

Signal Processing · Electrical Eng. & Systems 2024-01-24 Sara García-de-Villa , Ana Jiménez-Martín , Juan Jesús García-Domínguez

Remote photoplethysmography (rPPG) enables non-invasive extraction of blood volume pulse signals through imaging, transforming spatial-temporal data into time series signals. Advances in end-to-end rPPG approaches have focused on this…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Jitesh Joshi , Sos S. Agaian , Youngjun Cho

This paper considers the problem of casual heart rate tracking during intensive physical exercise using simultaneous 2 channel photoplethysmographic (PPG) and 3 dimensional (3D) acceleration signals recorded from wrist. This is a…

Information Theory · Computer Science 2016-09-13 Mahdi Boloursaz Mashhadi , Ehsan Asadi , Mohsen Eskandari , Shahrzad Kiani , Farrokh Marvasti

Advances in Deep Learning have recently made it possible to recover full 3D meshes of human poses from individual images. However, extension of this notion to videos for recovering temporally coherent poses still remains unexplored. A major…

Computer Vision and Pattern Recognition · Computer Science 2019-07-02 Jian Liu , Naveed Akhtar , Ajmal Mian

Predicting the status of Major Depressive Disorder (MDD) from objective, non-invasive methods is an active research field. Yet, extracting automatically objective, interpretable features for a detailed analysis of the patient state remains…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Fouad Boutaleb , Emery Pierson , Mohamed Daoudi , Clémence Nineuil , Ali Amad , Fabien D'Hondt

This paper introduces a simple yet effective strategy for exercise classification and muscle group activation prediction (MGAP). These tasks have significant implications for personal fitness, facilitating more affordable, accessible,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Manvik Pasula , Pramit Saha

Facial motion capture in mixed reality headsets enables real-time avatar animation, allowing users to convey non-verbal cues during virtual interactions. However, as facial motion data constitutes a behavioral biometric, its use raises…

Cryptography and Security · Computer Science 2025-07-16 Adriano Castro , Simon Hanisch , Matin Fallahi , Thorsten Strufe