English
Related papers

Related papers: Benchmarking Video Foundation Models for Remote Pa…

200 papers

Foundation models in computational pathology promise to unlock the development of new clinical decision support systems and models for precision medicine. However, there is a mismatch between most clinical analysis, which is defined at the…

Facial video-based remote physiological measurement aims to estimate remote photoplethysmography (rPPG) signals from human face videos and then measure multiple vital signs (e.g. heart rate, respiration frequency) from rPPG signals. Recent…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Zijie Yue , Miaojing Shi , Shuai Ding

Inpatient falls are a serious safety issue in hospitals and healthcare facilities. Recent advances in video analytics for patient monitoring provide a non-intrusive avenue to reduce this risk through continuous activity monitoring. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Ziqing Wang , Mohammad Ali Armin , Simon Denman , Lars Petersson , David Ahmedt-Aristizabal

Foundation models are increasingly developed in computational pathology (CPath) given their promise in facilitating many downstream tasks. While recent studies have evaluated task performance across models, less is known about the structure…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Vaibhav Mishra , William Lotter

Medical video segmentation gains increasing attention in clinical practice due to the redundant dynamic references in video frames. However, traditional convolutional neural networks have a limited receptive field and transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Yijun Yang , Zhaohu Xing , Lequan Yu , Chunwang Huang , Huazhu Fu , Lei Zhu

Visual Attention Models (VAMs) predict the location of an image or video regions that are most likely to attract human attention. Although saliency detection is well explored for 2D image and video content, there are only few attempts made…

Image and Video Processing · Electrical Eng. & Systems 2018-03-14 Amin Banitalebi-Dehkordi , Eleni Nasiopoulos , Mahsa T. Pourazad , Panos Nasiopoulos

Medical image segmentation is crucial for clinical diagnosis. The Segmentation Anything Model (SAM) serves as a powerful foundation model for visual segmentation and can be adapted for medical image segmentation. However, medical imaging…

Image and Video Processing · Electrical Eng. & Systems 2024-11-07 Yuxi Liu , Guibo Luo , Yuesheng Zhu

Objective: To pre-train fair and unbiased patient representations from Electronic Health Records (EHRs) using a novel weighted loss function that reduces bias and improves fairness in deep representation learning models. Methods: We defined…

Machine Learning · Computer Science 2023-06-07 Sonish Sivarajkumar , Yufei Huang , Yanshan Wang

In this work, we discuss evaluating video foundation models in a fair and robust manner. Unlike language or image foundation models, many video foundation models are evaluated with differing parameters (such as sampling rate, number of…

Recent studies have demonstrated that analysis of laboratory-quality voice recordings can be used to accurately differentiate people diagnosed with Parkinson's disease (PD) from healthy controls (HC). These findings could help facilitate…

Applications · Statistics 2019-05-22 Siddharth Arora , Ladan Baghai-Ravary , Athanasios Tsanas

Parkinson's disease (PD) severity diagnosis is crucial for early detecting potential patients and adopting tailored interventions. Diagnosing PD based on facial expression is grounded in PD patients' "masked face" symptom and gains growing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Yintao Zhou , Wei Huang , Zhengyu Li , Jing Huang , Meng Pang

Diagnosis of Parkinson's disease (PD) is commonly based on medical observations and assessment of clinical signs, including the characterization of a variety of motor symptoms. However, traditional diagnostic approaches may suffer from…

Machine Learning · Computer Science 2020-10-14 Jie Mei , Christian Desrosiers , Johannes Frasnelli

Foundation models (FMs) have shown great promise in medical image analysis by improving generalization across diverse downstream tasks. In ophthalmology, several FMs have recently emerged, but there is still no clear answer to fundamental…

Parkinson's disease (PD) is a neurodegenerative condition characterized by notable motor and non-motor manifestations. The assessment tool known as the Unified Parkinson's Disease Rating Scale (UPDRS) plays a crucial role in evaluating the…

Sound · Computer Science 2025-02-14 Arman Mohammadigilani , Hani Attar , Hamidreza Ehsani Chimeh , Mostafa Karami

Vision foundation models trained on discretely sampled images achieve strong performance on classification benchmarks, yet whether their representations encode the continuous processes underlying their training data remains unclear. This…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Pritika Vig , Ren-Chin Wu , William Lotter

Recent learning-based approaches have made astonishing advances in calibrated medical imaging like computerized tomography (CT), yet they struggle to generalize in uncalibrated modalities -- notably magnetic resonance (MR) imaging, where…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Peirong Liu , Oula Puonti , Xiaoling Hu , Karthik Gopinath , Annabel Sorby-Adams , Daniel C. Alexander , W. Taylor Kimberly , Juan E. Iglesias

Purpose: Visually Guided Reaching (VGR) on the Kinarm robot yields sensitive kinematic biomarkers but requires 40-64 reaches, imposing time and fatigue burdens. We evaluate whether time-series foundation models can replace unrecorded trials…

Robotics · Computer Science 2025-11-04 Faranak Akbarifar , Nooshin Maghsoodi , Sean P Dukelow , Stephen Scott , Parvin Mousavi

We present an artificial intelligence system to remotely assess the motor performance of individuals with Parkinson's disease (PD). Participants performed a motor task (i.e., tapping fingers) in front of a webcam, and data from 250 global…

Remote photoplethysmography (rPPG), which aims at measuring heart activities and physiological signals from facial video without any contact, has great potential in many applications (e.g., remote healthcare and affective computing). Recent…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Zitong Yu , Yuming Shen , Jingang Shi , Hengshuang Zhao , Philip Torr , Guoying Zhao

Automated driving has made remarkable progress, yet situations still arise where human intervention is necessary. Teleoperation provides a scalable solution to address such cases, enabling remote operators to support vehicles without being…

Human-Computer Interaction · Computer Science 2026-05-14 Ines Trautmannsheimer , Richard Grauberger , Frank Diermeyer