English
Related papers

Related papers: A Vector-Quantized Foundation Model for Patient Be…

200 papers

While ubiquitous wearable sensors capture a wealth of behavioral and physiological information, effectively transforming these signals into personalized health insights is challenging. Specifically, converting low-level sensor data into…

Recent advances in remote health monitoring systems have significantly benefited patients and played a crucial role in improving their quality of life. However, while physiological health-focused solutions have demonstrated increasing…

Machine Learning · Computer Science 2023-03-28 Shayan Fazeli , Lionel Levine , Mehrab Beikzadeh , Baharan Mirzasoleiman , Bita Zadeh , Tara Peris , Majid Sarrafzadeh

As foundation models increasingly permeate sensitive domains such as healthcare, finance, and mental health, ensuring their behavior meets desired outcomes and social expectations becomes critical. Given the complexities of these…

Robotics · Computer Science 2024-12-30 Rebecca Ramnauth , Dražen Brščić , Brian Scassellati

Wearable medical sensors (WMSs) are revolutionizing smart healthcare by enabling continuous, real-time monitoring of user physiological signals, especially in the field of consumer healthcare. The integration of WMSs and modern machine…

Machine Learning · Computer Science 2024-10-22 Chia-Hao Li , Niraj K. Jha

Privacy data protection in the medical field poses challenges to data sharing, limiting the ability to integrate data across hospitals for training high-precision auxiliary diagnostic models. Traditional centralized training methods are…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Tian Bowen , Xu Zhengyang , Yin Zhihao , Wang Jingying , Yue Yutao

Federated foundation models represent a new paradigm to jointly fine-tune pre-trained foundation models across clients. It is still a challenge to fine-tune foundation models for a small group of new users or specialized scenarios, which…

Machine Learning · Computer Science 2025-09-17 Yiyuan Yang , Guodong Long , Qinghua Lu , Liming Zhu , Jing Jiang

Foundation models, often pre-trained with large-scale data, have achieved paramount success in jump-starting various vision and language applications. Recent advances further enable adapting foundation models in downstream tasks efficiently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Dequan Wang , Xiaosong Wang , Lilong Wang , Mengzhang Li , Qian Da , Xiaoqiang Liu , Xiangyu Gao , Jun Shen , Junjun He , Tian Shen , Qi Duan , Jie Zhao , Kang Li , Yu Qiao , Shaoting Zhang

The present study explores the interpretability of latent spaces produced by time series foundation models, focusing on their potential for visual analysis tasks. Specifically, we evaluate the MOMENT family of models, a set of…

Tracking biosignals is crucial for monitoring wellness and preempting the development of severe medical conditions. Today, wearable devices can conveniently record various biosignals, creating the opportunity to monitor health status…

Machine Learning · Computer Science 2024-03-07 Salar Abbaspourazad , Oussama Elachqar , Andrew C. Miller , Saba Emrani , Udhyakumar Nallasamy , Ian Shapiro

Mobile health has emerged as a major success for tracking individual health status, due to the popularity and power of smartphones and wearable devices. This has also brought great challenges in handling heterogeneous, multi-resolution data…

Methodology · Statistics 2024-05-31 Jiuchen Zhang , Fei Xue , Qi Xu , Jung-Ah Lee , Annie Qu

Forecasting tasks using large datasets gathering thousands of heterogeneous time series is a crucial statistical problem in numerous sectors. The main challenge is to model a rich variety of time series, leverage any available external…

Machine Learning · Computer Science 2024-04-18 Etienne David , Jean Bellot , Sylvain Le Corff

Successfully training Variational Autoencoders (VAEs) with a hierarchy of discrete latent variables remains an area of active research. Vector-Quantised VAEs are a powerful approach to discrete VAEs, but naive hierarchical extensions can be…

Machine Learning · Statistics 2021-02-05 Matthew Willetts , Xenia Miscouridou , Stephen Roberts , Chris Holmes

Domain-specific foundation models for healthcare have expanded rapidly in recent years, yet foundation models for critical care time series remain relatively underexplored due to the limited size and availability of datasets. In this work,…

Machine Learning · Computer Science 2025-09-25 Katja Naasunnguaq Jagd , Rachael DeVries , Ole Winther

With the increasing use of smartphones in our daily lives, these devices have become capable of performing many complex tasks. Concerning the need for continuous monitoring of vital signs, especially for the elderly or those with certain…

Signal Processing · Electrical Eng. & Systems 2024-03-29 Taha Samavati , Mahdi Farvardin , Aboozar Ghaffari

Foundation models for computational pathology are expected to facilitate the development of high-performing, generalisable deep learning systems. However, in addition to biologically relevant features, current foundation models also capture…

Smart-home sensor data holds significant potential for several applications, including healthcare monitoring and assistive technologies. Existing approaches, however, face critical limitations. Supervised models require impractical amounts…

Artificial Intelligence · Computer Science 2026-02-03 Michele Fiori , Gabriele Civitarese , Flora D. Salim , Claudio Bettini

Increased use of sensor signals from wearable devices as rich sources of physiological data has sparked growing interest in developing health monitoring systems to identify changes in an individual's health profile. Indeed, machine learning…

Machine Learning · Computer Science 2022-10-17 Magda Amiridi , Gregory Darnell , Sean Jewell

Large-scale longitudinal molecular profiling is now firmly established in biomedical research, prompted by the need to uncover coordinated biomarker trajectories reflecting the dynamics of underlying biological mechanisms and characterise…

Methodology · Statistics 2026-03-24 Salima Jaoua , Daniel Temko , Hélène Ruffieux

Foundation models, first introduced in 2021, refer to large-scale pretrained models (e.g., large language models (LLMs) and vision-language models (VLMs)) that learn from extensive unlabeled datasets through unsupervised methods, enabling…

Foundation models hold promise for transforming AI in healthcare by providing modular components that are easily adaptable to downstream healthcare tasks, making AI development more scalable and cost-effective. Structured EHR foundation…