English
Related papers

Related papers: Systematic review of self-supervised foundation mo…

200 papers

Self-supervised learning (SSL) is a machine learning approach where the data itself provides supervision, eliminating the need for external labels. The model is forced to learn about the data structure or context by solving a pretext task.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Markus Marks , Manuel Knott , Neehar Kondapaneni , Elijah Cole , Thijs Defraeye , Fernando Perez-Cruz , Pietro Perona

We introduce a unified benchmarking framework focused on evaluating EEG-based foundation models in clinical applications. The benchmark spans 11 well-defined diagnostic tasks across 14 publicly available EEG datasets, including epilepsy,…

Machine Learning · Computer Science 2025-12-11 Ard Kastrati , Josua Bürki , Jonas Lauer , Cheng Xuan , Raffaele Iaquinto , Roger Wattenhofer

Multimodal language modeling has enabled breakthroughs for representation learning, yet remains unexplored in the realm of functional brain data for clinical phenotyping. This paper pioneers EEG-language models (ELMs) trained on clinical…

Signal Processing · Electrical Eng. & Systems 2025-08-12 Sam Gijsen , Kerstin Ritter

Recent advances in deep learning have had a methodological and practical impact on brain-computer interface research. Among the various deep network architectures, convolutional neural networks have been well suited for…

Signal Processing · Electrical Eng. & Systems 2020-03-06 Wonjun Ko , Eunjin Jeon , Seungwoo Jeong , Heung-Il Suk

In the domain of cardiovascular healthcare, the Electrocardiogram (ECG) serves as a critical, non-invasive diagnostic tool. Although recent strides in self-supervised learning (SSL) have been promising for ECG representation learning, these…

Signal Processing · Electrical Eng. & Systems 2023-09-15 Che Liu , Zhongwei Wan , Sibo Cheng , Mi Zhang , Rossella Arcucci

Event-related potential (ERP), a specialized paradigm of electroencephalographic (EEG), reflects neurological responses to external stimuli or events, generally associated with the brain's processing of specific cognitive tasks. ERP plays a…

Neural and Evolutionary Computing · Computer Science 2026-04-21 Yihe Wang , Zhiqiao Kang , Bohan Chen , Yu Zhang , Xiang Zhang

Source-free domain adaptation (SFDA) provides a practical solution to cross-subject EEG decoding by adapting source-pretrained models to unlabeled target domains without accessing source data. However, existing SFDA methods rely solely on…

Signal Processing · Electrical Eng. & Systems 2026-05-05 Peiliang Gong , Han Zhang , Zhen Jiang , Chenyu Liu , Ziyu Jia , Xinliang Zhou , Daoqiang Zhang , Xiaoli Li

Electroencephalogram (EEG) decoding aims to identify the perceptual, semantic, and cognitive content of neural processing based on non-invasively measured brain activity. Traditional EEG decoding methods have achieved moderate success when…

Signal Processing · Electrical Eng. & Systems 2022-03-09 Xun Chen , Chang Li , Aiping Liu , Martin J. McKeown , Ruobing Qian , Z. Jane Wang

The proliferation of digital interactions across diverse domains, such as healthcare, e-commerce, gaming, and finance, has resulted in the generation of vast volumes of event stream (ES) data. ES data comprises continuous sequences of…

Machine Learning · Computer Science 2026-01-06 Levente Zólyomi , Tianze Wang , Sofiane Ennadir , Oleg Smirnov , Lele Cao

Large EEG Foundation Models (FMs) have shown great potential for decoding EEG signals across diverse cognitive tasks. However, existing EEG-FM studies exhibit three critical limitations: opaque supervised baseline tuning, unverified…

Machine Learning · Computer Science 2026-05-28 Xianheng Wang , Yige Yang , Damien Coyle

In this study, we demonstrate the application of a hybrid Vision Transformer (ViT) model, pretrained on ImageNet, on an electroencephalogram (EEG) regression task. Despite being originally trained for image classification tasks, when…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Ruiqi Yang , Eric Modesitt

Self-supervised learning (SSL) for graph neural networks (GNNs) has attracted increasing attention from the graph machine learning community in recent years, owing to its capability to learn performant node embeddings without costly label…

Machine Learning · Computer Science 2023-03-01 Mingxuan Ju , Tong Zhao , Qianlong Wen , Wenhao Yu , Neil Shah , Yanfang Ye , Chuxu Zhang

The electrocardiogram (ECG) is one of the most commonly used non-invasive, convenient medical monitoring tools that assist in the clinical diagnosis of heart diseases. Recently, deep learning (DL) techniques, particularly self-supervised…

Machine Learning · Computer Science 2023-03-23 Jun Li , Che Liu , Sibo Cheng , Rossella Arcucci , Shenda Hong

This paper introduces a novel cross-physiology translation task: synthesizing sleep electroencephalography (EEG) from respiration signals. To address the significant complexity gap between the two modalities, we propose a…

Machine Learning · Computer Science 2026-02-03 Kaiwen Zha , Chao Li , Hao He , Peng Cao , Tianhong Li , Ali Mirzazadeh , Ellen Zhang , Jong Woo Lee , Yoon Kim , Dina Katabi

The growing demand for accurate and equitable AI models in digital dermatology faces a significant challenge: the lack of diverse, high-quality labeled data. In this work, we investigate the potential of domain-specific foundation models…

Brain-computer interfaces (BCIs) enable direct communication between the brain and external devices. Recent EEG foundation models aim to learn generalized representations across diverse BCI paradigms. However, these approaches overlook…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Dingkun Liu , Zhu Chen , Jingwei Luo , Shijie Lian , Dongrui Wu

Timely access to laboratory values is critical for clinical decision-making, yet current approaches rely on invasive venous sampling and are intrinsically delayed. Electrocardiography (ECG), as a non-invasive and widely available signal,…

Machine Learning · Computer Science 2025-10-28 Yujie Xiao , Gongzhen Tang , Wenhui Liu , Jun Li , Guangkun Nie , Zhuoran Kan , Deyun Zhang , Qinghao Zhao , Shenda Hong

Automatic singing voice understanding tasks, such as singer identification, singing voice transcription, and singing technique classification, benefit from data-driven approaches that utilize deep learning techniques. These approaches work…

Sound · Computer Science 2023-09-06 Yuya Yamamoto

Deep learning based neural decoding from stereotactic electroencephalography (sEEG) would likely benefit from scaling up both dataset and model size. To achieve this, combining data across multiple subjects is crucial. However, in sEEG…

Electrocardiogram (ECG) foundation models represent a paradigm shift from task-specific pipelines to generalizable architectures pre-trained on large-scale unlabeled waveform data. This survey presents a unified and deployment-aware review…

Signal Processing · Electrical Eng. & Systems 2026-04-06 Mudassir Hasan Khan , Ahmad Nayfeh , Mudassir Masood , Ali Ahmad Al-Shaikhi , Muhammad Mahboob Ur Rahman , Tareq Y. Al-Naffouri