English
Related papers

Related papers: Joint Spatial-Temporal Modeling and Contrastive Le…

200 papers

Many remote photoplethysmography (rPPG) estimation models have achieved promising performance in the training domain but often fail to accurately estimate physiological signals or heart rates (HR) in the target domains. Domain…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Pei-Kai Huang , Tzu-Hsien Chen , Ya-Ting Chan , Kuan-Wen Chen , Chiou-Ting Hsu

Video-based heart and respiratory rate measurements using facial videos are more useful and user-friendly than traditional contact-based sensors. However, most of the current deep learning approaches require ground-truth pulse and…

Image and Video Processing · Electrical Eng. & Systems 2024-01-12 Yusuke Akamatsu , Terumi Umematsu , Hitoshi Imaoka

Facial video-based remote physiological measurement aims to estimate remote photoplethysmography (rPPG) signals from human face videos and then measure multiple vital signs (e.g. heart rate, respiration frequency) from rPPG signals. Recent…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Zijie Yue , Miaojing Shi , Shuai Ding

Manual annotation of large-scale point cloud dataset for varying tasks such as 3D object classification, segmentation and detection is often laborious owing to the irregular structure of point clouds. Self-supervised learning, which…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Mohamed Afham , Isuru Dissanayake , Dinithi Dissanayake , Amaya Dharmasiri , Kanchana Thilakarathna , Ranga Rodrigo

Accurate and robust weather forecasting remains a fundamental challenge due to the inherent spatio-temporal complexity of atmospheric systems. In this paper, we propose a novel self-supervised learning framework that leverages…

Machine Learning · Computer Science 2025-11-04 Yao Liu

Self-supervised learning (SSL) has become a powerful paradigm for learning from large, unlabeled datasets, particularly in computer vision (CV). However, applying SSL to multispectral remote sensing (RS) images presents unique challenges…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Tom Burgert , Leonard Hackel , Paolo Rota , Begüm Demir

With the progress of sensor technology in wearables, the collection and analysis of PPG signals are gaining more interest. Using Machine Learning, the cardiac rhythm corresponding to PPG signals can be used to predict different tasks such…

Signal Processing · Electrical Eng. & Systems 2022-12-20 Ramin Ghorbani , Marcel J. T. Reinders , David M. J. Tax

To date, research on sensor-equipped mobile devices has primarily focused on the purely supervised task of human activity recognition (walking, running, etc), demonstrating limited success in inferring high-level health outcomes from…

Machine Learning · Computer Science 2020-11-10 Dimitris Spathis , Ignacio Perez-Pozuelo , Soren Brage , Nicholas J. Wareham , Cecilia Mascolo

Adversarial attacks pose significant challenges for vision models in critical fields like healthcare, where reliability is essential. Although adversarial training has been well studied in natural images, its application to biomedical and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Hashmat Shadab Malik , Shahina Kunhimon , Muzammal Naseer , Fahad Shahbaz Khan , Salman Khan

Deep learning models are modern tools for spatio-temporal graph (STG) forecasting. Though successful, we argue that data scarcity is a key factor limiting their recent improvements. Meanwhile, contrastive learning has been an effective…

Machine Learning · Computer Science 2022-11-04 Xu Liu , Yuxuan Liang , Chao Huang , Yu Zheng , Bryan Hooi , Roger Zimmermann

We propose a self-supervised learning method to jointly reason about spatial and temporal context for video recognition. Recent self-supervised approaches have used spatial context [9, 34] as well as temporal coherency [32] but a…

Computer Vision and Pattern Recognition · Computer Science 2018-08-24 Unaiza Ahsan , Rishi Madhok , Irfan Essa

We present an automatic method to describe clinically useful information about scanning, and to guide image interpretation in ultrasound (US) videos of the fetal heart. Our method is able to jointly predict the visibility, viewing plane,…

Computer Vision and Pattern Recognition · Computer Science 2017-07-04 Weilin Huang , Christopher P. Bridge , J. Alison Noble , Andrew Zisserman

Learning representations from electrocardiogram (ECG) signals can serve as a fundamental step for different machine learning-based ECG tasks. In order to extract general ECG representations that can be adapted to various downstream tasks,…

Machine Learning · Computer Science 2022-09-22 Wenrui Zhang , Shijia Geng , Shenda Hong

The vast amount of unlabeled multi-temporal and multi-sensor remote sensing data acquired by the many Earth Observation satellites present a challenge for change detection. Recently, many generative model-based methods have been proposed…

Image and Video Processing · Electrical Eng. & Systems 2022-02-16 Yuxing Chen , Lorenzo Bruzzone

We propose a self-supervised method to learn feature representations from videos. A standard approach in traditional self-supervised methods uses positive-negative data pairs to train with contrastive learning strategy. In such a case,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Li Tao , Xueting Wang , Toshihiko Yamasaki

The self-supervised pretraining paradigm has achieved great success in learning 3D action representations for skeleton-based action recognition using contrastive learning. However, learning effective representations for skeleton-based…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Qiushuo Cheng , Jingjing Liu , Catherine Morgan , Alan Whone , Majid Mirmehdi

Smartphone-based heart rate (HR) monitoring apps using finger-over-camera photoplethysmography (PPG) face significant challenges in performance evaluation and device compatibility due to device variability and fragmentation. Manual testing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Ming-Zher Poh , Jonathan Wang , Jonathan Hsu , Lawrence Cai , Eric Teasley , James A. Taylor , Jameson K. Rogers , Anupam Pathak , Shwetak Patel

Image super-resolution (SR) aims to learn a mapping from low-resolution (LR) to high-resolution (HR) using paired HR-LR training images. Conventional SR methods typically gather the paired training data by synthesizing LR images from HR…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Zeshuai Deng , Zhuokun Chen , Shuaicheng Niu , Thomas H. Li , Bohan Zhuang , Mingkui Tan

Self-supervised pre-training of deep learning models with contrastive learning is a widely used technique in image analysis. Current findings indicate a strong potential for contrastive pre-training on medical images. However, further…

Image and Video Processing · Electrical Eng. & Systems 2024-10-21 Daniel Wolf , Tristan Payer , Catharina Silvia Lisson , Christoph Gerhard Lisson , Meinrad Beer , Michael Götz , Timo Ropinski

Recently, there have been efforts to improve the performance in sign language recognition by designing self-supervised learning methods. However, these methods capture limited information from sign pose data in a frame-wise learning manner,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Weichao Zhao , Wengang Zhou , Hezhen Hu , Min Wang , Houqiang Li