English
Related papers

Related papers: Pretraining on Sleep Data Improves non-Sleep Biosi…

200 papers

Bed-based pressure-sensitive mats (PSMs) offer a non-intrusive way of monitoring patients during sleep. We focus on four-way sleep position classification using data collected from a PSM placed under a mattress in a sleep clinic. Sleep…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Olivier Papillon , Rafik Goubran , James Green , Julien Larivière-Chartier , Caitlin Higginson , Frank Knoefel , Rébecca Robillard

Objective: To develop multisensor-wearable-device sleep monitoring algorithms that are robust to health disruptions affecting sleep patterns. Methods: We develop an unsupervised transfer learning algorithm based on a multivariate hidden…

Graphs are a central representation in biomedical research, capturing molecular interaction networks, gene regulatory circuits, cell--cell communication maps, and knowledge graphs. Despite their importance, currently there is not a broadly…

Machine Learning · Computer Science 2026-04-09 Sakib Mostafa , Lei Xing , Md. Tauhidul Islam

Multi-task learning and self-training are two common ways to improve a machine learning model's performance in settings with limited training data. Drawing heavily on ideas from those two approaches, we suggest transductive auxiliary task…

Computation and Language · Computer Science 2019-09-24 Johannes Bjerva , Katharina Kann , Isabelle Augenstein

ECG foundation models are increasingly popular due to their adaptability across various tasks. However, their clinical applicability is often limited by performance gaps compared to task-specific models, even after pre-training on large ECG…

Machine Learning · Computer Science 2026-01-30 Ya Zhou , Yujie Yang , Xiaohan Fan , Wei Zhao

In recent years, domains such as natural language processing and image recognition have popularized the paradigm of using large datasets to pretrain representations that can be effectively transferred to downstream tasks. In this work we…

Machine Learning · Computer Science 2023-10-26 David Brandfonbrener , Ofir Nachum , Joan Bruna

Polysomnography (PSG) signals are essential for studying sleep processes and diagnosing sleep disorders. Analyzing PSG data through deep neural networks (DNNs) for automated sleep monitoring has become increasingly feasible. However, the…

Machine Learning · Computer Science 2025-04-21 Yifei Wang , Qi Liu , Fuli Min , Honghao Wang

Preterm newborns undergo various stresses that may materialize as learning problems at school-age. Sleep staging of the Electroencephalogram (EEG), followed by prediction of their brain-age from these sleep states can quantify deviations…

Machine Learning · Statistics 2018-09-20 Kirubin Pillay , Maarten De Vos

For most natural language processing tasks, the dominant practice is to finetune large pretrained transformer models (e.g., BERT) using smaller downstream datasets. Despite the success of this approach, it remains unclear to what extent…

Computation and Language · Computer Science 2023-05-29 Kundan Krishna , Saurabh Garg , Jeffrey P. Bigham , Zachary C. Lipton

Pre-training has shown success in different areas of machine learning, such as Computer Vision, Natural Language Processing (NLP), and medical imaging. However, it has not been fully explored for clinical data analysis. An immense amount of…

Machine Learning · Computer Science 2023-07-18 Chantal Pellegrini , Nassir Navab , Anees Kazi

Decoding information from bio-signals such as EEG, using machine learning has been a challenge due to the small data-sets and difficulty to obtain labels. We propose a reconstruction-based self-supervised learning model, the masked…

Signal Processing · Electrical Eng. & Systems 2022-11-07 Hsiang-Yun Sherry Chien , Hanlin Goh , Christopher M. Sandino , Joseph Y. Cheng

Understanding neural activity and information representation is crucial for advancing knowledge of brain function and cognition. Neural activity, measured through techniques like electrophysiology and neuroimaging, reflects various aspects…

Neurons and Cognition · Quantitative Biology 2024-07-22 Fengyu Yang , Chao Feng , Daniel Wang , Tianye Wang , Ziyao Zeng , Zhiyang Xu , Hyoungseob Park , Pengliang Ji , Hanbin Zhao , Yuanning Li , Alex Wong

EEG-based emotion recognition is hampered by profound dataset heterogeneity (channel/subject variability), hindering generalizable models. Existing approaches struggle to transfer knowledge effectively. We propose 'One Model for All', a…

Machine Learning · Computer Science 2025-11-12 Xiang Li , You Li , Yazhou Zhang

Artificial intelligence is a key enabler for next-generation wireless communication and sensing. Yet, today's learning-based wireless techniques do not generalize well: most models are task-specific, environment-dependent, and limited to…

Signal Processing · Electrical Eng. & Systems 2026-02-05 Vahid Yazdnian , Yasaman Ghasempour

Recent advances in deep learning have led to the development of models approaching the human level of accuracy. However, healthcare remains an area lacking in widespread adoption. The safety-critical nature of healthcare results in a…

Signal Processing · Electrical Eng. & Systems 2023-02-07 Irfan Al-Hussaini , Cassie S. Mitchell

The visual world offers a critical axis for advancing foundation models beyond language. Despite growing interest in this direction, the design space for native multimodal models remains opaque. We provide empirical clarity through…

Large pretrained visual foundation models exhibit impressive general capabilities. However, the extensive prior knowledge inherent in these models can sometimes be a double-edged sword when adapting them to downstream tasks in specific…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Qinghe Ma , Jian Zhang , Zekun Li , Lei Qi , Qian Yu , Yinghuan Shi

Recent self-supervised pre-training methods for electroencephalogram (EEG) have shown promising results. However, the pre-trained models typically require full fine-tuning on each downstream task individually to achieve good performance. In…

Machine Learning · Computer Science 2026-04-30 Sicheng Dai , Kai Chen , Hongwang Xiao , Shan Yu , Qiwei Ye

Until recently, human behavioral data from reading has mainly been of interest to researchers to understand human cognition. However, these human language processing signals can also be beneficial in machine learning-based natural language…

Computation and Language · Computer Science 2021-08-11 Nora Hollenstein , Cedric Renggli , Benjamin Glaus , Maria Barrett , Marius Troendle , Nicolas Langer , Ce Zhang

The classification of sleep stages plays a crucial role in understanding and diagnosing sleep pathophysiology. Sleep stage scoring relies heavily on visual inspection by an expert that is time consuming and subjective procedure. Recently,…

Signal Processing · Electrical Eng. & Systems 2022-12-12 Aref Einizade , Samaneh Nasiri , Sepideh Hajipour Sardouie , Gari Clifford