中文
相关论文

相关论文: rPPG-MAE: Self-supervised Pre-training with Masked…

200 篇论文

Remote photoplethysmography (rPPG) is an attractive method for noninvasive, convenient and concomitant measurement of physiological vital signals. Public benchmark datasets have served a valuable role in the development of this technology…

计算机视觉与模式识别 · 计算机科学 2023-05-02 Jiankai Tang , Kequan Chen , Yuntao Wang , Yuanchun Shi , Shwetak Patel , Daniel McDuff , Xin Liu

In this paper, we propose a novel contrastive learning based deep learning framework for patient similarity search using physiological signals. We use a contrastive learning based approach to learn similar embeddings of patients with…

信号处理 · 电气工程与系统科学 2023-08-07 Subangkar Karmaker Shanto , Shoumik Saha , Atif Hasan Rahman , Mohammad Mehedy Masud , Mohammed Eunus Ali

Remote physiological measurements, e.g., remote photoplethysmography (rPPG) based heart rate (HR), heart rate variability (HRV) and respiration frequency (RF) measuring, are playing more and more important roles under the application…

计算机视觉与模式识别 · 计算机科学 2020-07-17 Xuesong Niu , Zitong Yu , Hu Han , Xiaobai Li , Shiguang Shan , Guoying Zhao

Masked autoencoder (MAE) is a promising self-supervised pre-training technique that can improve the representation learning of a neural network without human intervention. However, applying MAE directly to volumetric medical images poses…

计算机视觉与模式识别 · 计算机科学 2023-08-24 Jia-Xin Zhuang , Luyang Luo , Hao Chen

We propose an end-to-end framework to measure people's vital signs including Heart Rate (HR), Heart Rate Variability (HRV), Oxygen Saturation (SpO2) and Blood Pressure (BP) based on the rPPG methodology from the video of a user's face…

计算机视觉与模式识别 · 计算机科学 2022-12-23 Donghao Qiao , Amtul Haq Ayesha , Farhana Zulkernine , Raihan Masroor , Nauman Jaffar

Masked AutoEncoder (MAE) has revolutionized the field of self-supervised learning with its simple yet effective masking and reconstruction strategies. However, despite achieving state-of-the-art performance across various downstream vision…

计算机视觉与模式识别 · 计算机科学 2023-12-11 Xiaoyu Yue , Lei Bai , Meng Wei , Jiangmiao Pang , Xihui Liu , Luping Zhou , Wanli Ouyang

Remote photoplethysmography (rPPG) based physiological measurement is an emerging yet crucial vision task, whose challenge lies in exploring accurate rPPG prediction from facial videos accompanied by noises of illumination variations,…

计算机视觉与模式识别 · 计算机科学 2023-08-16 Wei Qian , Dan Guo , Kun Li , Xilan Tian , Meng Wang

Deep learning in medical imaging has the potential to minimize the risk of diagnostic errors, reduce radiologist workload, and accelerate diagnosis. Training such deep learning models requires large and accurate datasets, with annotations…

计算机视觉与模式识别 · 计算机科学 2023-11-28 Daniel Wolf , Tristan Payer , Catharina Silvia Lisson , Christoph Gerhard Lisson , Meinrad Beer , Michael Götz , Timo Ropinski

Pre-training strategies based on self-supervised learning (SSL) have proven to be effective pretext tasks for many downstream tasks in computer vision. Due to the significant disparity between medical and natural images, the application of…

Recent studies demonstrated that the average heart rate (HR) can be measured from facial videos based on non-contact remote photoplethysmography (rPPG). However for many medical applications (e.g., atrial fibrillation (AF) detection)…

计算机视觉与模式识别 · 计算机科学 2019-08-01 Zitong Yu , Xiaobai Li , Guoying Zhao

Self-supervised learning has been a powerful training paradigm to facilitate representation learning. In this study, we design a masked autoencoder (MAE) to guide deep learning models to learn electroencephalography (EEG) signal…

人机交互 · 计算机科学 2024-09-04 Yifei Zhou , Sitong Liu

Remote photoplethysmography (rPPG) technique extracts blood volume pulse (BVP) signals from subtle pixel changes in video frames. This study introduces rFaceNet, an advanced rPPG method that enhances the extraction of facial BVP signals…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Dali Zhu , Wenli Zhang , Hualin Zeng , Xiaohao Liu , Long Yang , Jiaqi Zheng

Photoplethysmographic (PPG) measurements are susceptible to motion artifacts (MA) due to movement of the peripheral body parts. In this paper, we present a new approach to identify the MA corrupted PPG beats and then rectify the beat…

信号处理 · 电气工程与系统科学 2018-07-17 Monalisa Singha Roy , Rajarshi Gupta , Jayanta K. Chandra , Kaushik Das Sharma , Arunansu Talukdar

Recent contrastive methods show significant improvement in self-supervised learning in several domains. In particular, contrastive methods are most effective where data augmentation can be easily constructed e.g. in computer vision.…

机器学习 · 计算机科学 2021-12-09 Konstantinos Kallidromitis , Denis Gudovskiy , Kazuki Kozuka , Iku Ohama , Luca Rigazio

Non-contact facial video-based heart rate estimation using remote photoplethysmography (rPPG) has shown great potential in many applications (e.g., remote health care) and achieved creditable results in constrained scenarios. However,…

计算机视觉与模式识别 · 计算机科学 2022-01-27 Jiaqi Kang , Su Yang , Weishan Zhang

Remote photoplethysmography (rPPG) holds great promise for continuous heart-rate monitoring of drivers in intelligent vehicles. However, its performance is severely degraded by the highly dynamic illumination changes. A critical yet…

计算机视觉与模式识别 · 计算机科学 2026-05-07 Jieying Wang , Xinqi Cai , Caifeng Shan , Wenjin Wang

Photoplethysmography (PPG) is widely used in wearable health monitoring, but its reliability is often degraded by noise and motion artifacts, limiting downstream applications such as heart rate (HR) estimation. This paper presents a deep…

机器学习 · 计算机科学 2025-10-14 I Chiu , Yu-Tung Liu , Kuan-Chen Wang , Hung-Yu Wei , Yu Tsao

Respiratory ailments afflict a wide range of people and manifests itself through conditions like asthma and sleep apnea. Continuous monitoring of chronic respiratory ailments is seldom used outside the intensive care ward due to the large…

The vast amount of unlabeled multi-temporal and multi-sensor remote sensing data acquired by the many Earth Observation satellites present a challenge for change detection. Recently, many generative model-based methods have been proposed…

图像与视频处理 · 电气工程与系统科学 2022-02-16 Yuxing Chen , Lorenzo Bruzzone

Self-supervised learning has emerged as a powerful way to pre-train generalizable machine learning models on large amounts of unlabeled data. It is particularly compelling in the music domain, where obtaining labeled data is time-consuming,…

声音 · 计算机科学 2024-04-16 Gabriel Meseguer-Brocal , Dorian Desblancs , Romain Hennequin