English
Related papers

Related papers: PhysFormer++: Facial Video-based Physiological Mea…

200 papers

Remote photoplethysmography (rPPG) enables non-contact, continuous monitoring of physiological signals and offers a practical alternative to traditional health sensing methods. Although rPPG is promising for daily health monitoring, its…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Xulin Ma , Jiankai Tang , Zhang Jiang , Songqin Cheng , Yuanchun Shi , Dong LI , Xin Liu , Daniel McDuff , Xiaojing Liu , Yuntao Wang

Vital signs, such as heart rate (HR), heart rate variability (HRV), respiratory rate (RR), are important indicators for a person's health. Vital signs are traditionally measured with contact sensors, and may be inconvenient and cause…

Image and Video Processing · Electrical Eng. & Systems 2019-11-04 Mingliang Chen , Qiang Zhu , Harrison Zhang , Min Wu , Quanzeng Wang

Unsupervised remote photoplethysmography (rPPG) promises to leverage unlabeled video data, but its potential is hindered by a critical challenge: training on low-quality "in-the-wild" videos severely degrades model performance. An essential…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Tianyang Dai , Ming Chang , Yan Chen , Yang Hu

Multiple complex degradations are coupled in low-quality video faces in the real world. Therefore, blind video face restoration is a highly challenging ill-posed problem, requiring not only hallucinating high-fidelity details but also…

Multimedia · Computer Science 2024-04-23 Kepeng Xu , Li Xu , Gang He , Wenxin Yu , Yunsong Li

Remote estimation of vital signs enables health monitoring for situations in which contact-based devices are either not available, too intrusive, or too expensive. In this paper, we present a modular, interpretable pipeline for pulse signal…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Vineet R. Shenoy , Shaoju Wu , Armand Comas , Tim K. Marks , Suhas Lohit , Hassan Mansour

This report introduces VitalLens 2.0, a new deep learning model for estimating physiological signals from face video. This new model demonstrates a significant leap in accuracy for remote photoplethysmography (rPPG), enabling the robust…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Philipp V. Rouast

With a surge in online medical advising remote monitoring of patient vitals is required. This can be facilitated with the Remote Photoplethysmography (rPPG) techniques that compute vital signs from facial videos. It involves processing…

Artificial Intelligence · Computer Science 2022-08-23 Amtul Haq Ayesha , Donghao Qiao , Farhana Zulkernine

Photoplethysmography (PPG) signals, typically acquired from wearable devices, hold significant potential for continuous fitness-health monitoring. In particular, heart conditions that manifest in rare and subtle deviating heart patterns may…

Machine Learning · Computer Science 2023-07-14 Ramin Ghorbani , Marcel J. T. Reinders , David M. J. Tax

Remote photoplethysmography (rPPG) based on traditional frame-based cameras often struggles with motion artifacts and limited temporal resolution. To address these limitations, we introduce EMPD (Event-based Multimodal Physiological…

Signal Processing · Electrical Eng. & Systems 2026-03-31 Qian Feng , Pengfei Li , Rongshan Gao , Jiale Xu , Rui Gong , Yidi Li

Remote photoplethysmography (rPPG) enables non-contact physiological measurement from facial videos; however, its practical deployment is often hindered by substantial performance degradation under domain shift. While recent deep…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Ba-Thinh Nguyen , Thi-Duyen Ngo , Thanh-Trung Huynh , Thanh-Ha Le , Huy-Hieu Pham

Most modern approaches in temporal action localization divide this problem into two parts: (i) short-term feature extraction and (ii) long-range temporal boundary localization. Due to the high GPU memory cost caused by processing long…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Feng Cheng , Gedas Bertasius

Remote Photoplethysmography (rPPG), or the remote monitoring of a subject's heart rate using a camera, has seen a shift from handcrafted techniques to deep learning models. While current solutions offer substantial performance gains, we…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Nathan Vance , Jeremy Speth , Benjamin Sporrer , Patrick Flynn

Dynamic scene reconstruction is a long-term challenge in 3D vision. Recent methods extend 3D Gaussian Splatting to dynamic scenes via additional deformation fields and apply explicit constraints like motion flow to guide the deformation.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 DaDong Jiang , Zhihui Ke , Xiaobo Zhou , Zhi Hou , Xianghui Yang , Wenbo Hu , Tie Qiu , Chunchao Guo

Remote photoplethysmography (rPPG) enables non-contact heart rate measurement from facial videos, but its performance is significantly degraded by facial motions such as speaking and head shaking. To address this issue, we propose two…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Gan Pei , Junhao Ning , Boqiu Shen , Yan Zhu , Menghan Hu

Photoplethysmography (PPG) has become a ubiquitous physiological signal; however, current generative models still struggle to preserve realistic waveform morphology and learn a latent structure that captures cardiac and respiratory…

Signal Processing · Electrical Eng. & Systems 2026-05-25 Fatemeh Ghasemi Balouei , Nathan Willemsen , Mahesh Banavar , Bahman Moraffah

Camera-based contactless photoplethysmography refers to a set of popular techniques for contactless physiological measurement. The current state-of-the-art neural models are typically trained in a supervised manner using videos accompanied…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Xin Liu , Yuntao Wang , Sinan Xie , Xiaoyu Zhang , Zixian Ma , Daniel McDuff , Shwetak Patel

Remote photoplethysmography (rPPG) can remotely extract physiological signals from RGB video, which has many advantages in detecting heart rate, such as low cost and no invasion to patients. The existing rPPG model is usually based on the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Taixi Chen , Yiu-ming Cheung

Camera-based monitoring of vital signs, also known as imaging photoplethysmography (iPPG), has seen applications in driver-monitoring, perfusion assessment in surgical settings, affective computing, and more. iPPG involves sensing the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Vineet R Shenoy , Suhas Lohit , Hassan Mansour , Rama Chellappa , Tim K. Marks

In recent years, due to the widespread use of internet videos, remote photoplethysmography (rPPG) has gained more and more attention in the fields of affective computing. Restoring blood volume pulse (BVP) signals from facial videos is a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Kegang Wang , Yantao Wei , Jiankai Tang , Yuntao Wang , Mingwen Tong , Jie Gao , Yujian Ma , Zhongjin Zhao

Automated surgical step recognition is an important task that can significantly improve patient safety and decision-making during surgeries. Existing state-of-the-art methods for surgical step recognition either rely on separate,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-22 Nisarg A. Shah , Shameema Sikder , S. Swaroop Vedula , Vishal M. Patel