English
Related papers

Related papers: Systematic review of self-supervised foundation mo…

200 papers

Electroencephalography (EEG) signals provide critical insights for applications in disease diagnosis and healthcare. However, the scarcity of labeled EEG data poses a significant challenge. Foundation models offer a promising solution by…

Machine Learning · Computer Science 2025-02-25 Limin Wang , Toyotaro Suzumura , Hiroki Kanezashi

Foundation models for time series are emerging as powerful general-purpose backbones, yet their potential for domain-specific biomedical signals such as electroencephalography (EEG) remains rather unexplored. In this work, we investigate…

Machine Learning · Computer Science 2025-11-03 Théo Gnassounou , Yessin Moakher , Shifeng Xie , Vasilii Feofanov , Ievgen Redko

Electroencephalography (EEG) plays a crucial role in brain-computer interfaces (BCIs) and neurological diagnostics, but its real-world deployment faces challenges due to noise artifacts, missing data, and high annotation costs. We introduce…

Signal Processing · Electrical Eng. & Systems 2025-10-24 Meghna Roy Chowdhury , Yi Ding , Shreyas Sen

Electroencephalogram (EEG) signals are pivotal in providing insights into spontaneous brain activity, highlighting their significant importance in neuroscience research. However, the exploration of versatile EEG models is constrained by…

Signal Processing · Electrical Eng. & Systems 2025-09-01 Tongtian Yue , Xuange Gao , Shuning Xue , Yepeng Tang , Longteng Guo , Jie Jiang , Jing Liu

Foundation models (FMs), powered by self-supervised learning (SSL), have redefined the capabilities of artificial intelligence, demonstrating exceptional performance in domains like natural language processing and computer vision. These…

Machine Learning · Computer Science 2025-06-23 Hamdi Altaheri , Fakhri Karray , Md. Milon Islam , S M Taslim Uddin Raju , Amir-Hossein Karimi

Large-scale foundation models for EEG signals offer a promising path to generalizable brain-computer interface (BCI) applications, but they often suffer from misalignment between pretraining objectives and downstream tasks, as well as…

Machine Learning · Computer Science 2025-10-03 Suli Wang , Yangshen Deng , Zhenghua Bao , Xinyu Zhan , Yiqun Duan

Electroencephalography (EEG) is one of the most common signals used to capture the electrical activity of the brain, and the decoding of EEG, to acquire the user intents, has been at the forefront of brain-computer/machine interfaces…

Machine Learning · Computer Science 2025-07-04 Haodong Zhang , Hongqi Li

Clinical EEG interpretation requires reasoning over full EEG sessions and integrating signal patterns with clinical context. Existing EEG foundation models are largely designed for short-window decoding and do not incorporate clinical…

Artificial Intelligence · Computer Science 2026-05-12 Peng Cao , Ali Mirzazadeh , Jong Woo Lee , Aleksandar Videnovic , Dina Katabi

Evaluating foundation models under appropriate adaptation settings is essential for understanding the quality and transferability of the learned representations. Recent EEG foundation models have demonstrated promising transfer capabilities…

Machine Learning · Computer Science 2026-05-28 Aditya Kommineni , Emily Zhou , Kleanthis Avramidis , Tiantian Feng , Shrikanth Narayanan

To handle the scarcity and heterogeneity of electroencephalography (EEG) data for Brain-Computer Interface (BCI) tasks, and to harness the power of large publicly available data sets, we propose Neuro-GPT, a foundation model consisting of…

Machine Learning · Computer Science 2024-03-05 Wenhui Cui , Woojae Jeong , Philipp Thölke , Takfarinas Medani , Karim Jerbi , Anand A. Joshi , Richard M. Leahy

Pretraining for electroencephalogram (EEG) foundation models has predominantly relied on self-supervised masked reconstruction, a paradigm largely adapted from and inspired by the success of vision and language foundation models. However,…

Machine Learning · Computer Science 2026-03-06 Chenqi Li , Yu Liu , Shuo Zhang , Timothy Denison , Tingting Zhu

While foundation models excel in text, image, and video domains, the critical biological signals, particularly electroencephalography(EEG), remain underexplored. EEG benefits neurological research with its high temporal resolution,…

Signal Processing · Electrical Eng. & Systems 2025-05-13 Wei Xiong , Junming Lin , Jiangtong Li , Jie Li , Changjun Jiang

Electroencephalography (EEG) is a widely used non-invasive technique for measuring brain activity in brain-computer interface (BCI) applications. Supervised EEG decoding models often struggle to generalize across tasks, subjects, and…

Artificial Intelligence · Computer Science 2026-05-29 Ayse Betul Yuce , Sebastian Stober

Electrocardiogram (ECG) is widely used in healthcare applications, such as arrhythmia detection and sleep monitoring, making accurate ECG analysis critically essential. Traditional deep learning models for ECG are task-specific, with…

Signal Processing · Electrical Eng. & Systems 2025-10-14 Yu Han , Vittorio Murino , Xiaofeng Liu , Xiang Zhang , Cheng Ding

Electroencephalography (EEG) is a non-invasive technique to measure and record brain electrical activity, widely used in various BCI and healthcare applications. Early EEG decoding methods rely on supervised learning, limited by specific…

Signal Processing · Electrical Eng. & Systems 2025-11-07 Jiquan Wang , Sha Zhao , Zhiling Luo , Yangxuan Zhou , Haiteng Jiang , Shijian Li , Tao Li , Gang Pan

In this study, we introduce an innovative EEG signal reconstruction sub-module designed to enhance the performance of deep learning models on EEG eye-tracking tasks. This sub-module can integrate with all Encoder-Classifier-based deep…

Human-Computer Interaction · Computer Science 2024-08-13 Weigeng Li , Neng Zhou , Xiaodong Qu

Electroencephalography (EEG) reflects the brain's functional state, making it a crucial tool for diverse detection applications like seizure detection and sleep stage classification. While deep learning-based approaches have recently shown…

Machine Learning · Computer Science 2025-10-07 Kerui Wu , Ziyue Zhao , Bülent Yener

Current deep learning models for electroencephalography (EEG) are often task-specific and depend on large labeled datasets, limiting their adaptability. Although emerging foundation models aim for broader applicability, their rigid…

Foundation models have transformed AI by reducing reliance on task-specific data through large-scale pretraining. While successful in language and vision, their adoption in EEG has lagged due to the heterogeneity of public datasets, which…

Foundation models pre-trained through masked reconstruction on large-scale EEG data have emerged as a promising paradigm for learning generalizable neural representations across diverse brain-computer interface applications. However, a…

Artificial Intelligence · Computer Science 2026-05-19 Yang Shao , Peiliang Gong , Qun Dai , Daoqiang Zhang