English
Related papers

Related papers: Pretraining on Sleep Data Improves non-Sleep Biosi…

200 papers

The last decade has witnessed a notable surge in deep learning applications for the analysis of electroencephalography (EEG) data, thanks to its demonstrated superiority over conventional statistical techniques. However, even deep learning…

Signal Processing · Electrical Eng. & Systems 2024-11-28 Federico Del Pup , Andrea Zanola , Louis Fabrice Tshimanga , Alessandra Bertoldo , Manfredo Atzori

We propose a pre-training strategy called Multi-modal Multi-task Masked Autoencoders (MultiMAE). It differs from standard Masked Autoencoding in two key aspects: I) it can optionally accept additional modalities of information in the input…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Roman Bachmann , David Mizrahi , Andrei Atanov , Amir Zamir

Electroencephalography (EEG) foundation models have recently emerged as a promising paradigm for brain-computer interfaces (BCIs), aiming to learn transferable neural representations from large-scale heterogeneous recordings. Despite rapid…

Machine Learning · Computer Science 2026-02-06 Dingkun Liu , Yuheng Chen , Zhu Chen , Zhenyao Cui , Yaozhi Wen , Jiayu An , Jingwei Luo , Dongrui Wu

Self-supervised learning has emerged as a powerful tool for pretraining deep networks on unlabeled data, prior to transfer learning of target tasks with limited annotation. The relevance between the pretraining pretext and target tasks is…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Tianwei Zhang , Dong Wei , Mengmeng Zhu , Shi Gu , Yefeng Zheng

Understanding the sleep quality and architecture is essential to human being's health, which is usually represented using multiple sleep stages. A standard sleep stage determination requires Electroencephalography (EEG) signals during the…

Signal Processing · Electrical Eng. & Systems 2019-09-26 Yuezhou Zhang , Zhicheng Yang , Ke Lan , Xiaoli Liu , Zhengbo Zhang , Peiyao Li , Desen Cao , Jiewen Zheng , Jianli Pan

Sleep staging is a clinically important task for diagnosing various sleep disorders, but remains challenging to deploy at scale because it because it is both labor-intensive and time-consuming. Supervised deep learning-based approaches can…

Signal Processing · Electrical Eng. & Systems 2024-04-25 Sayeri Lala , Hanlin Goh , Christopher Sandino

Datasets for biosignals, such as electroencephalogram (EEG) and electrocardiogram (ECG), often have noisy labels and have limited number of subjects (<100). To handle these challenges, we propose a self-supervised approach based on…

Machine Learning · Computer Science 2020-07-10 Joseph Y. Cheng , Hanlin Goh , Kaan Dogrusoz , Oncel Tuzel , Erdrin Azemi

Foundational models, pretrained on a large scale, have demonstrated substantial success across non-medical domains. However, training these models typically requires large, comprehensive datasets, which contrasts with the smaller and more…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Raphael Schäfer , Till Nicke , Henning Höfener , Annkristin Lange , Dorit Merhof , Friedrich Feuerhake , Volkmar Schulz , Johannes Lotz , Fabian Kiessling

Sleep quality is central to human health, yet reliable and scalable sleep assessment remains an unmet challenge in both clinical and home-care settings. Manual scoring is labor-intensive and impractical for long-term monitoring, whereas…

Signal Processing · Electrical Eng. & Systems 2025-11-18 Shengwei Guo , Guobing Sun

Sleep staging is essential for diagnosing sleep disorders and assessing neurological health. Existing automatic methods typically extract features from complex polysomnography (PSG) signals and train domain-specific models, which often lack…

Signal Processing · Electrical Eng. & Systems 2025-09-30 Jianheng Zhou , Chenyu Liu , Jinan Zhou , Yi Ding , Yang Liu , Haoran Luo , Ziyu Jia , Xinliang Zhou

Sleep disorder diagnosis relies on the analysis of polysomnography (PSG) records. As a preliminary step of this examination, sleep stages are systematically determined. In practice, sleep stage classification relies on the visual inspection…

Machine Learning · Statistics 2021-06-21 Antoine Guillot , Valentin Thorey

One of the common human diseases is sleep disorders. The classification of sleep stages plays a fundamental role in diagnosing sleep disorders, monitoring treatment effectiveness, and understanding the relationship between sleep stages and…

Signal Processing · Electrical Eng. & Systems 2023-10-09 Hassan Ardeshir , Mohammad Araghi

Brain imaging plays a crucial role in the diagnosis and treatment of various neurological disorders, providing valuable insights into the structure and function of the brain. Techniques such as magnetic resonance imaging (MRI) and computed…

Image and Video Processing · Electrical Eng. & Systems 2025-01-23 Fatima Haimour , Rizik Al-Sayyed , Waleed Mahafza , Omar S. Al-Kadi

A reliable foundation model of functional neuroimages is critical to promote clinical applications where the performance of current AI models is significantly impeded by a limited sample size. To that end, tremendous efforts have been made…

Machine Learning · Computer Science 2025-10-23 Ziquan Wei , Tingting Dan , Guorong Wu

Large-scale brain imaging datasets provide unprecedented opportunities for developing domain foundation models through pretraining. However, unlike natural image datasets in computer vision, these neuroimaging data often exhibit high…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Yanteng Zhang , Songheng Li , Zeyu Shen , Qizhen Lan , Lipei Zhang , Yang Liu , Vince Calhoun

Sleep studies are important for diagnosing sleep disorders such as insomnia, narcolepsy or sleep apnea. They rely on manual scoring of sleep stages from raw polisomnography signals, which is a tedious visual task requiring the workload of…

Computer Vision and Pattern Recognition · Computer Science 2017-10-03 Albert Vilamala , Kristoffer H. Madsen , Lars K. Hansen

Pre-training models on Imagenet or other massive datasets of real images has led to major advances in computer vision, albeit accompanied with shortcomings related to curation cost, privacy, usage rights, and ethical issues. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Samarth Mishra , Rameswar Panda , Cheng Perng Phoo , Chun-Fu Chen , Leonid Karlinsky , Kate Saenko , Venkatesh Saligrama , Rogerio S. Feris

Sleep has a profound influence on the physiology of body systems and biological processes. Molecular studies have shown circadian-regulated shifts in protein expression patterns across human tissues, further emphasizing the unique…

Quantitative Methods · Quantitative Biology 2021-02-11 Nitai Bar , Jonathan A. Sobel , Thomas Penzel , Yosi Shamay , Joachim A. Behar

Recent advancements for large-scale pre-training with neural signals such as electroencephalogram (EEG) have shown promising results, significantly boosting the development of brain-computer interfaces (BCIs) and healthcare. However, these…

Signal Processing · Electrical Eng. & Systems 2025-03-21 Wei-Bang Jiang , Yansen Wang , Bao-Liang Lu , Dongsheng Li

Neural networks often obtain sub-optimal representations during training, which degrade robustness as well as classification performances. This is a severe problem in applying deep learning to bio-medical domains, since models are…

Signal Processing · Electrical Eng. & Systems 2020-09-14 Taeheon Lee , Jeonghwan Hwang , Honggu Lee