English
Related papers

Related papers: Wearable Foundation Models Should Go Beyond Static…

200 papers

Increased use of sensor signals from wearable devices as rich sources of physiological data has sparked growing interest in developing health monitoring systems to identify changes in an individual's health profile. Indeed, machine learning…

Machine Learning · Computer Science 2022-10-17 Magda Amiridi , Gregory Darnell , Sean Jewell

Foundation models (FMs) have emerged as a powerful paradigm, enabling a diverse range of data analytics and knowledge discovery tasks across scientific fields. Inspired by the success of FMs, particularly large language models, researchers…

Machine Learning · Computer Science 2025-11-27 Sean Bin Yang , Ying Sun , Yunyao Cheng , Yan Lin , Kristian Torp , Jilin Hu

Foundation models have revolutionized artificial intelligence, setting new benchmarks in performance and enabling transformative capabilities across a wide range of vision and language tasks. However, despite the prevalence of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Adam Goodge , Wee Siong Ng , Bryan Hooi , See Kiong Ng

Due to the increase in computational resources and accessibility of data, an increase in large, deep learning models trained on copious amounts of multi-modal data using self-supervised or semi-supervised learning have emerged. These…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Madeline Chantry Schiappa , Shehreen Azad , Sachidanand VS , Yunhao Ge , Ondrej Miksik , Yogesh S. Rawat , Vibhav Vineet

Physical function monitoring (PFM) plays a crucial role in healthcare especially for the elderly. Traditional assessment methods such as the Short Physical Performance Battery (SPPB) have failed to capture the full dynamic characteristics…

Signal Processing · Electrical Eng. & Systems 2024-04-25 Junjie Zhang , Zheming Zhang , Huachen Xiang , Yangquan Tan , Linnan Huo , Fengyi Wang

Foundation models are deep neural networks (such as GPT-5, Gemini~3, and Opus~4) trained on large datasets that can perform diverse downstream tasks -- text and code generation, question answering, summarization, image classification, and…

Machine Learning · Computer Science 2026-05-01 Logan G Wright , Tianyu Wang , Tatsuhiro Onodera , Peter L. McMahon

Computational pathology, which involves analyzing whole slide images for automated cancer diagnosis, relies on multiple instance learning, where performance depends heavily on the feature extractor and aggregator. Recent Pathology…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Conghao Xiong , Hao Chen , Joseph J. Y. Sung

Modern Foundation Models (FMs) are typically trained on corpora spanning a wide range of different data modalities, topics and downstream tasks. Utilizing these models can be very computationally expensive and is out of reach for most…

Machine Learning · Computer Science 2025-06-09 Andrey Zhmoginov , Jihwan Lee , Mark Sandler

Foundation models (FMs) are large-scale deep learning models trained on massive datasets, often using self-supervised learning techniques. These models serve as a versatile base for a wide range of downstream tasks, including those in…

Machine Learning · Computer Science 2025-01-17 Wasif Khan , Seowung Leem , Kyle B. See , Joshua K. Wong , Shaoting Zhang , Ruogu Fang

Brain foundation models (BFMs) have emerged as a transformative paradigm in computational neuroscience, offering a revolutionary framework for processing diverse neural signals across different brain-related tasks. These models leverage…

Machine Learning · Computer Science 2025-07-22 Xinliang Zhou , Chenyu Liu , Zhisheng Chen , Kun Wang , Yi Ding , Ziyu Jia , Qingsong Wen

Large language models (LLMs) show promise for health applications when combined with behavioral sensing data. Traditional approaches convert sensor data into text prompts, but this process is prone to errors, computationally expensive, and…

Foundational models are trained on extensive datasets to capture the general trends of a domain. However, in medical imaging, the scarcity of data makes pre-training for every domain, modality, or task challenging. Instead of building…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Mohammad Areeb Qazi , Munachiso S Nwadike , Ibrahim Almakky , Mohammad Yaqub , Numan Saeed

While initial applications of artificial intelligence (AI) in wireless communications over the past decade have demonstrated considerable potential using specialized models for targeted communication tasks, the revolutionary demands of…

Information Theory · Computer Science 2026-03-26 Jian Xiao , Ji Wang , Kunrui Cao , Xingwang Li , Zhao Chen , Chau Yuen

Graph foundation models (GFM) aim to acquire transferable knowledge by pre-training on diverse graphs, which can be adapted to various downstream tasks. However, domain shift in graphs is inherently two-dimensional: graphs differ not only…

Computation and Language · Computer Science 2026-03-12 Xingtong Yu , Shenghua Ye , Ruijuan Liang , Chang Zhou , Hong Cheng , Xinming Zhang , Yuan Fang

Sensor-based Human Activity Recognition (HAR) underpins many ubiquitous and wearable computing applications, yet current models remain limited by scarce labels, sensor heterogeneity, and weak generalization across users, devices, and…

Signal Processing · Electrical Eng. & Systems 2026-04-10 Sizhen Bian , Mengxi Liu , Lala Shakti Swarup Ray , Bo Zhou , Bin Guo , Zhiwen Yu , Thomas Ploetz , Paul Lukowicz , Siyu Yuan , Vitor Fortes Rey

Food security remains a global concern as population grows and climate change intensifies, demanding innovative solutions for sustainable agricultural productivity. Recent advances in foundation models have demonstrated remarkable…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Vishal Nedungadi , Xingguo Xiong , Aike Potze , Ron Van Bree , Tao Lin , Marc Rußwurm , Ioannis N. Athanasiadis

Artificial intelligence (AI) plays an important role in the dynamic landscape of wireless communications, solving challenges unattainable by traditional approaches. This paper discusses the evolution of wireless AI, emphasizing the…

Networking and Internet Architecture · Computer Science 2025-11-21 Jaron Fontaine , Adnan Shahid , Eli De Poorter

Evaluating foundation models under appropriate adaptation settings is essential for understanding the quality and transferability of the learned representations. Recent EEG foundation models have demonstrated promising transfer capabilities…

Machine Learning · Computer Science 2026-05-28 Aditya Kommineni , Emily Zhou , Kleanthis Avramidis , Tiantian Feng , Shrikanth Narayanan

Foundation models constitute a significant advancement in computer vision: after a single, albeit costly, training phase, they can address a wide array of tasks. In the field of Earth observation, over 75 remote sensing vision foundation…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Pierre Adorni , Minh-Tan Pham , Stéphane May , Sébastien Lefèvre

Electronic health records (EHRs) provide a powerful basis for predicting the onset of health outcomes. Yet EHRs primarily capture in-clinic events and miss aspects of daily behavior and lifestyle containing rich health information. Consumer…