English
Related papers

Related papers: PhysFormer++: Facial Video-based Physiological Mea…

200 papers

Video photoplethysmography (vPPG) is an emerging method for non-invasive and convenient measurement of physiological signals, utilizing two primary approaches: remote video PPG (rPPG) and contact video PPG (cPPG). Monitoring vitals in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Ke Liu , Jiankai Tang , Zhang Jiang , Yuntao Wang , Xiaojing Liu , Dong Li , Yuanchun Shi

Camera-based physiological signal estimation provides a non-contact and convenient means to monitor Heart Rate (HR). However, the presence of vital signals in facial videos raises significant privacy concerns, as they can reveal sensitive…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Tianwen Zhou , Akshay Paruchuri , Josef Spjut , Kaan Akşit

Recent advancements in data-driven approaches for remote photoplethysmography (rPPG) have significantly improved the accuracy of remote heart rate estimation. However, the performance of such approaches worsens considerably under video…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Joaquim Comas , Adria Ruiz , Federico Sukno

This work introduces a novel DeepFake detection framework based on physiological measurement. In particular, we consider information related to the heart rate using remote photoplethysmography (rPPG). rPPG methods analyze video sequences…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Javier Hernandez-Ortega , Ruben Tolosana , Julian Fierrez , Aythami Morales

Remote physiological sensing using camera-based technologies offers transformative potential for non-invasive vital sign monitoring across healthcare and human-computer interaction domains. Although deep learning approaches have advanced…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Jitesh Joshi , Youngjun Cho

Spatio-temporal sensor data in real-world systems is often sparse, noisy, and irregular, making latent field reconstruction fundamentally underconstrained. Under extreme sparsity, multiple physically plausible fields may remain consistent…

Machine Learning · Computer Science 2026-05-20 Ankit Bhardwaj , Ananth Balashankar , Lakshminarayanan Subramanian

Recent advances in supervised deep learning techniques have demonstrated the possibility to remotely measure human physiological vital signs (e.g., photoplethysmograph, heart rate) just from facial videos. However, the performance of these…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Yuxuan Ou , Yuzhe Zhang , Yuntang Wang , Shwetak Patel , Daniel McDuf , Yuzhe Yang , Xin Liu

Previous methods for dynamic facial expression in the wild are mainly based on Convolutional Neural Networks (CNNs), whose local operations ignore the long-range dependencies in videos. To solve this problem, we propose the spatio-temporal…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Fuyan Ma , Bin Sun , Shutao Li

With the emergence of GAN, face forgery technologies have been heavily abused. Achieving accurate face forgery detection is imminent. Inspired by remote photoplethysmography (rPPG) that PPG signal corresponds to the periodic change of skin…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Jiahao Liang , Weihong Deng

Inspired by the performance and scalability of autoregressive large language models (LLMs), transformer-based models have seen recent success in the visual domain. This study investigates a transformer adaptation for video prediction with a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Dean L Slack , G Thomas Hudson , Thomas Winterbottom , Noura Al Moubayed

Subtle periodic signals such as blood volume pulse and respiration can be extracted from RGB video, enabling remote health monitoring at low cost. Advancements in remote pulse estimation -- or remote photoplethysmography (rPPG) -- are…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Jeremy Speth , Nathan Vance , Patrick Flynn , Adam Czajka

Exploiting photoplethysmography signals (PPG) for non-invasive blood pressure (BP) measurement is interesting for various reasons. First, PPG can easily be measured using fingerclip sensors. Second, camera-based approaches allow to derive…

Machine Learning · Computer Science 2021-04-20 Fabian Schrumpf , Patrick Frenzel , Christoph Aust , Georg Osterhoff , Mirco Fuchs

Age estimation is a challenging task that has numerous applications. In this paper, we propose a new direction for age classification that utilizes a video-based model to address challenges such as occlusions, low-resolution, and lighting…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Abid Ali , Ashish Marisetty , Francois Bremond

While transformers have shown great potential on video recognition with their strong capability of capturing long-range dependencies, they often suffer high computational costs induced by the self-attention to the huge number of 3D tokens.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Yuxuan Liang , Pan Zhou , Roger Zimmermann , Shuicheng Yan

Depression is a mental illness that may be harmful to an individual's health. The detection of mental health disorders in the early stages and a precise diagnosis are critical to avoid social, physiological, or psychological side effects.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Constantino Álvarez Casado , Manuel Lage Cañellas , Miguel Bordallo López

In the first half of the 20th century, a first pulse oximeter was available to measure blood flow changes in the peripheral vascular net. However, it was not until recent times the PhotoPlethysmoGraphic (PPG) signal used to monitor many…

Signal Processing · Electrical Eng. & Systems 2020-12-21 Javier de Pedro-Carracedo , David Fuentes-Jimenez , Ana M. Ugena , Ana P. Gonzalez-Marcos

Skeleton-based action recognition, which classifies human actions based on the coordinates of joints and their connectivity within skeleton data, is widely utilized in various scenarios. While Graph Convolutional Networks (GCNs) have been…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Jeonghyeok Do , Munchurl Kim

Photoplethysmography (PPG) devices are widely used for monitoring cardiovascular function. However, these devices require skin contact, which restrict their use to at-rest short-term monitoring using single-point measurements.…

Efficient video action recognition remains a challenging problem. One large model after another takes the place of the state-of-the-art on the Kinetics dataset, but real-world efficiency evaluations are often lacking. In this work, we fill…

Computer Vision and Pattern Recognition · Computer Science 2021-11-19 Raivo Koot , Haiping Lu

Photoplethysmography (PPG) is a non-invasive technology that measures changes in blood volume in the microvascular bed of tissue. It is commonly used in medical devices such as pulse oximeters and wrist worn heart rate monitors to monitor…