English
Related papers

Related papers: rPPG-MAE: Self-supervised Pre-training with Masked…

200 papers

Modern natural language processing (NLP) methods employ self-supervised pretraining objectives such as masked language modeling to boost the performance of various application tasks. These pretraining methods are frequently extended with…

Computation and Language · Computer Science 2021-02-26 Nils Rethmeier , Isabelle Augenstein

Deep learning techniques have achieved great success in remote sensing image change detection. Most of them are supervised techniques, which usually require large amounts of training data and are limited to a particular application.…

Image and Video Processing · Electrical Eng. & Systems 2021-10-11 Yuxing Chen , Lorenzo Bruzzone

The fast evolution and widespread of deepfake techniques in real-world scenarios require stronger generalization abilities of face forgery detectors. Some works capture the features that are unrelated to method-specific artifacts, such as…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Hanqing Zhao , Wenbo Zhou , Dongdong Chen , Weiming Zhang , Nenghai Yu

Emotion recognition from facial videos enables non-contact inference of human emotional states. Although facial expressions are widely used cues, they cannot fully reflect intrinsic affective states. Remote photoplethysmography (rPPG)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Xiwen Luo , Jia Li , Rencheng Song , Yu Liu , Juan Cheng

In recent years, due to the widespread use of internet videos, remote photoplethysmography (rPPG) has gained more and more attention in the fields of affective computing. Restoring blood volume pulse (BVP) signals from facial videos is a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Kegang Wang , Yantao Wei , Jiankai Tang , Yuntao Wang , Mingwen Tong , Jie Gao , Yujian Ma , Zhongjin Zhao

Multi-channel photoplethysmography (PPG) sensors have found widespread adoption in wearable devices for monitoring cardiac health. Channels thereby serve different functions -- whereas green is commonly used for metrics such as heart rate…

Signal Processing · Electrical Eng. & Systems 2024-12-24 Manuel Meier , Berken Utku Demirel , Christian Holz

Unobservable physiological signals enhance biometric authentication systems. Photoplethysmography (PPG) signals are convenient owning to its ease of measurement and are usually well protected against remote adversaries in authentication.…

Cryptography and Security · Computer Science 2022-03-03 Lin Li , Chao Chen , Lei Pan , Jun Zhang , Yang Xiang

With the growing percentage of elderly people and care home admissions, there is an urgent need for the development of fall detection and fall prevention technologies. This work presents, for the first time, the use of machine learning…

Signal Processing · Electrical Eng. & Systems 2024-11-20 Robbie Maccay , Roshan Weerasekera

The COVID-19 pandemic has underscored the need for low-cost, scalable approaches to measuring contactless vital signs, either during initial triage at a healthcare facility or virtual telemedicine visits. Remote photoplethysmography (rPPG)…

Image and Video Processing · Electrical Eng. & Systems 2024-11-26 Sandeep Nagar , Mark Hasegawa-Johnson , David G. Beiser , Narendra Ahuja

Heart rate is a physiological signal that provides information about an individual's health and affective state. Remote photoplethysmography (rPPG) allows the estimation of this signal from video recordings of a person's face. Classical…

Machine Learning · Computer Science 2025-03-18 Bhargav Acharya , William Saakyan , Barbara Hammer , Hanna Drimalla

Remote photoplethysmography (rPPG) allows for noncontact monitoring of blood volume changes from a camera by detecting minor fluctuations in reflected light. Prior applications of rPPG focused on face videos. In this paper we explored the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Lu Niu , Jeremy Speth , Nathan Vance , Benjamin Sporrer , Adam Czajka , Patrick Flynn

The computer vision domain has greatly benefited from an abundance of data across many modalities to improve on various visual tasks. Recently, there has been a lot of focus on self-supervised pre-training methods through Masked…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Pîrvu Mihai-Cristian , Marius Leordeanu

We introduce a pretraining technique called Selfie, which stands for SELFie supervised Image Embedding. Selfie generalizes the concept of masked language modeling of BERT (Devlin et al., 2019) to continuous data, such as images, by making…

Machine Learning · Computer Science 2019-07-30 Trieu H. Trinh , Minh-Thang Luong , Quoc V. Le

Photoplethsmography (PPG)-based individual identification aiming at recognizing humans via intrinsic cardiovascular activities has raised extensive attention due to its high security and resistance to mimicry. However, this kind of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Riling Wei , Hanjie Chen , Kelu Yao , Chuanguang Yang , Jun Wang , Chao Li

Imaging Photoplethysmography (iPPG), an optical procedure which recovers a human's blood volume pulse (BVP) waveform using pixel readout from a camera, is an exciting research field with many researchers performing clinical studies of iPPG…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Vineet R. Shenoy , Cheng Peng , Rama Chellappa , Yu Sun

The development of continual learning (CL) methods, which aim to learn new tasks in a sequential manner from the training data acquired continuously, has gained great attention in remote sensing (RS). The existing CL methods in RS, while…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Lars Möllenbrok , Behnood Rasti , Begüm Demir

Learning-based image harmonization techniques are usually trained to undo synthetic random global transformations applied to a masked foreground in a single ground truth photo. This simulated data does not model many of the important…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Ke Wang , Michaël Gharbi , He Zhang , Zhihao Xia , Eli Shechtman

Remote Sensing Change Detection (RS-CD) aims to detect relevant changes from Multi-Temporal Remote Sensing Images (MT-RSIs), which aids in various RS applications such as land cover, land use, human development analysis, and disaster…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Wele Gedara Chaminda Bandara , Vishal M. Patel

Facial remote photoplethysmography (rPPG) methods estimate physiological signals by modeling subtle color changes on the 3D facial surface over time. However, existing methods fail to explicitly align their receptive fields with the 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Sam Cantrill , David Ahmedt-Aristizabal , Lars Petersson , Hanna Suominen , Mohammad Ali Armin

Masked Autoencoders (MAE) based on a reconstruction task have risen to be a promising paradigm for self-supervised learning (SSL) and achieve state-of-the-art performance across different benchmark datasets. However, despite its impressive…

Machine Learning · Computer Science 2023-03-28 Qi Zhang , Yifei Wang , Yisen Wang