English
Related papers

Related papers: rPPG-MAE: Self-supervised Pre-training with Masked…

200 papers

Modeling effective representations using multiple views that positively influence each other is challenging, and the existing methods perform poorly on Electroencephalogram (EEG) signals for sleep-staging tasks. In this paper, we propose a…

This paper briefly introduces the solutions developed by our team, HFUT-VUT, for Track 1 of self-supervised heart rate measurement in the 3rd Vision-based Remote Physiological Signal Sensing (RePSS) Challenge hosted at IJCAI 2024. The goal…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Wei Qian , Qi Li , Kun Li , Xinke Wang , Xiao Sun , Meng Wang , Dan Guo

Depression is a mental illness that may be harmful to an individual's health. The detection of mental health disorders in the early stages and a precise diagnosis are critical to avoid social, physiological, or psychological side effects.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Constantino Álvarez Casado , Manuel Lage Cañellas , Miguel Bordallo López

Imaging photoplethysmography (iPPG) can be used for heart rate monitoring during driving, which is expected to reduce traffic accidents by continuously assessing drivers' physical condition. Deep learning-based iPPG methods using…

Image and Video Processing · Electrical Eng. & Systems 2024-11-05 Yuqi Tu , Shakith Fernando , Mark van Gastel

Purpose. Photoplethysmography (PPG) is a non-invasive technique that measures changes in blood flow volume through optical means. Previous research has established the feasibility of PPG peak detection based on the crossover of moving…

Signal Processing · Electrical Eng. & Systems 2023-12-18 Cesar Abascal Machado , Victor O. Costa , Cesar Augusto Prior , Cesar Ramos Rodrigues

Masked Autoencoders (MAE) have demonstrated promising performance in self-supervised learning for both 2D and 3D computer vision. Nevertheless, existing MAE-based methods still have certain drawbacks. Firstly, the functional decoupling…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Yang Liu , Chen Chen , Can Wang , Xulin King , Mengyuan Liu

Masked Autoencoders (MAE) have been popular paradigms for large-scale vision representation pre-training. However, MAE solely reconstructs the low-level RGB signals after the decoder and lacks supervision upon high-level semantics for the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Peng Gao , Renrui Zhang , Rongyao Fang , Ziyi Lin , Hongyang Li , Hongsheng Li , Qiao Yu

Objective: Acquiring fully sampled training data is challenging for many MRI applications. We present a self-supervised image reconstruction method, termed ReSiDe, capable of recovering images solely from undersampled data. Materials and…

Image and Video Processing · Electrical Eng. & Systems 2024-11-26 Muhammad Shafique , Sizhuo Liu , Philip Schniter , Rizwan Ahmad

Numerous real-world applications have been driven by the recent algorithmic advancement of artificial intelligence (AI). Healthcare is no exception and AI technologies have great potential to revolutionize the industry. Non-contact…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Xin Liu , Shwetak Patel , Daniel McDuff

Photoplethysmography (PPG) refers to the measurement of variations in blood volume using light and is a feature of most wearable devices. The PPG signals provide insight into the body's circulatory system and can be employed to extract…

Signal Processing · Electrical Eng. & Systems 2024-01-17 Yuyang Miao , Harry J. Davies , Danilo P. Mandic

Self-supervised learning (SSL) offers a promising approach for learning electroencephalography (EEG) representations from unlabeled data, reducing the need for expensive annotations for clinical applications like sleep staging and seizure…

Self-Supervised Learning (SSL) enables us to pre-train foundation models without costly labeled data. Among SSL methods, Contrastive Learning (CL) methods are better at obtaining accurate semantic representations in noise interference.…

Image and Video Processing · Electrical Eng. & Systems 2026-02-06 Hengtong Shen , Haiyan Gu , Haitao Li , Yi Yang , Agen Qiu

Remote Photoplethysmography (rPPG) is a non-contact method that uses facial video to predict changes in blood volume, enabling physiological metrics measurement. Traditional rPPG models often struggle with poor generalization capacity in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Yiping Xie , Zitong Yu , Bingjie Wu , Weicheng Xie , Linlin Shen

Contrastive learning methods have significantly narrowed the gap between supervised and unsupervised learning on computer vision tasks. In this paper, we explore their application to geo-located datasets, e.g. remote sensing, where…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Kumar Ayush , Burak Uzkent , Chenlin Meng , Kumar Tanmay , Marshall Burke , David Lobell , Stefano Ermon

Biophysical signals such as Electrocardiogram (ECG) and Photoplethysmogram (PPG) are key to the sensing of vital parameters for wellbeing. Coincidentally, ECG and PPG are signals, which provide a "different window" into the same phenomena,…

Signal Processing · Electrical Eng. & Systems 2022-02-02 Abhinandan Panda , Srinivas Pinisetty , Partha Roop

This study evaluates remote Photopletismography (rPPG) algorithms, Spatial Subspace Rotation (2SR), Chrominance-based method (CHROM), Plane-Orthogonal-to-Skin (POS), and Principal Component Analysis (PCA), applied to selected…

Image and Video Processing · Electrical Eng. & Systems 2026-05-26 Đorđe D. Nešković , Nadica Miljković

Respiratory ailments such as asthma, chronic obstructive pulmonary disease (COPD), pneumonia, and lung cancer are life-threatening. Respiration rate (RR) is a vital indicator of the wellness of a patient. Continuous monitoring of RR can…

Masked Autoencoders (MAEs) have emerged as a dominant strategy for self-supervised representation learning in natural images, where models are pre-trained to reconstruct masked patches with a pixel-wise mean squared error (MSE) between…

Image and Video Processing · Electrical Eng. & Systems 2025-07-16 Chetan Madan , Aarjav Satia , Soumen Basu , Pankaj Gupta , Usha Dutta , Chetan Arora

Wearable photoplethysmography (PPG) is embedded in billions of devices, yet its optical waveform is easily corrupted by motion, perfusion loss, and ambient light, jeopardizing downstream cardiometric analytics. Existing signal-quality…

Signal Processing · Electrical Eng. & Systems 2025-09-18 Wei Shao , Ruoyu Zhang , Zequan Liang , Ehsan Kourkchi , Setareh Rafatirad , Houman Homayoun

Remote photoplethysmography (rPPG) enables non-contact heart rate measurement from facial videos, but its performance is significantly degraded by facial motions such as speaking and head shaking. To address this issue, we propose two…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Gan Pei , Junhao Ning , Boqiu Shen , Yan Zhu , Menghan Hu