English
Related papers

Related papers: NeuroTTT: Bridging Pretraining-Downstream Task Mis…

200 papers

Current electroencephalogram (EEG) decoding models are typically trained on small numbers of subjects performing a single task. Here, we introduce a large-scale, code-submission-based competition comprising two challenges. First, the…

Electroencephalography (EEG) analysis stands at the forefront of neuroscience and artificial intelligence research, where foundation models are reshaping the traditional EEG analysis paradigm by leveraging their powerful representational…

Human-Computer Interaction · Computer Science 2025-08-25 Hongqi Li , Yitong Chen , Yujuan Wang , Weihang Ni , Haodong Zhang

High-resolution neural datasets enable foundation models for the next generation of brain-computer interfaces and neurological treatments. The community requires rigorous benchmarks to discriminate between competing modeling approaches, yet…

Self-supervised pretraining has been extensively studied in language and vision domains, where a unified model can be easily adapted to various downstream tasks by pretraining representations without explicit labels. When it comes to…

Machine Learning · Computer Science 2023-01-25 Yanchao Sun , Shuang Ma , Ratnesh Madaan , Rogerio Bonatti , Furong Huang , Ashish Kapoor

For multilingual sequence-to-sequence pretrained language models (multilingual Seq2Seq PLMs), e.g. mBART, the self-supervised pretraining task is trained on a wide range of monolingual languages, e.g. 25 languages from CommonCrawl, while…

Computation and Language · Computer Science 2022-09-22 Changtong Zan , Liang Ding , Li Shen , Yu Cao , Weifeng Liu , Dacheng Tao

Classification models for electroencephalogram (EEG) data show a large decrease in performance when evaluated on unseen test sub jects. We reduce this performance decrease using new regularization techniques during model training. We…

Machine Learning · Computer Science 2023-10-16 Niklas Smedemark-Margulies , Ye Wang , Toshiaki Koike-Akino , Jing Liu , Kieran Parsons , Yunus Bicer , Deniz Erdogmus

The development of EEG decoding algorithms confronts challenges such as data sparsity, subject variability, and the need for precise annotations, all of which are vital for advancing brain-computer interfaces and enhancing the diagnosis of…

Signal Processing · Electrical Eng. & Systems 2025-01-15 Zirui Wang , Zhenxi Song , Yi Guo , Yuxin Liu , Guoyang Xu , Min Zhang , Zhiguo Zhang

ECG foundation models are increasingly popular due to their adaptability across various tasks. However, their clinical applicability is often limited by performance gaps compared to task-specific models, even after pre-training on large ECG…

Machine Learning · Computer Science 2026-01-30 Ya Zhou , Yujie Yang , Xiaohan Fan , Wei Zhao

Large-scale EEG foundation models have shown strong generalization across a range of downstream tasks, but their training remains resource-intensive due to the volume and variable quality of EEG data. In this work, we introduce EEG-DLite, a…

Machine Learning · Computer Science 2026-01-27 Yuting Tang , Weibang Jiang , Shanglin Li , Yong Li , Chenyu Liu , Xinliang Zhou , Yi Ding , Cuntai Guan

Datasets in sleep science present challenges for machine learning algorithms due to differences in recording setups across clinics. We investigate two deep transfer learning strategies for overcoming the channel mismatch problem for cases…

Computer Vision and Pattern Recognition · Computer Science 2020-09-02 Alexander Neergaard Olesen , Poul Jennum , Emmanuel Mignot , Helge B. D. Sorensen

Speech Foundation Models encounter significant performance degradation when deployed in real-world scenarios involving acoustic domain shifts, such as background noise and speaker accents. Test-time adaptation (TTA) has recently emerged as…

Machine Learning · Computer Science 2026-02-24 Jiaheng Dong , Hong Jia , Soumyajit Chatterjee , Abhirup Ghosh , James Bailey , Ting Dang

Brain-computer interfaces (BCIs) enable direct communication between the brain and external devices, providing critical support for individuals with motor impairments. However, accurate motor imagery (MI) decoding from…

Machine Learning · Computer Science 2026-04-08 Panagiotis Andrikopoulos , Siamak Mehrkanoon

Objective: Tinnitus affects 10-15% of the population yet lacks objective diagnostic biomarkers. This study applied machine learning to EEG and fMRI data to identify neural signatures distinguishing tinnitus patients from healthy controls.…

Signal Processing · Electrical Eng. & Systems 2025-10-28 Kiana Kiashemshaki , Sina Samieirad , Sarvenaz Erfani , Aryan Jalaeianbanayan , Nasibeh Asadi Isakan , Hossein Najafzadeh

Monitoring the growth of subcortical regions of the fetal brain in ultrasound (US) images can help identify the presence of abnormal development. Manually segmenting these regions is a challenging task, but recent work has shown that it can…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Joshua Omolegan , Pak Hei Yeung , Madeleine K. Wyburd , Linde Hesse , Monique Haak , Intergrowth-21st Consortium , Ana I. L. Namburete , Nicola K. Dinsdale

Deep learning associated with neurological signals is poised to drive major advancements in diverse fields such as medical diagnostics, neurorehabilitation, and brain-computer interfaces. The challenge in harnessing the full potential of…

Signal Processing · Electrical Eng. & Systems 2024-07-08 Di Wu , Siyuan Li , Jie Yang , Mohamad Sawan

Self-supervised learning has emerged as a highly effective approach in the fields of natural language processing and computer vision. It is also applicable to brain signals such as electroencephalography (EEG) data, given the abundance of…

Signal Processing · Electrical Eng. & Systems 2024-01-22 Yuqi Chen , Kan Ren , Kaitao Song , Yansen Wang , Yifan Wang , Dongsheng Li , Lili Qiu

Neural network models have demonstrated impressive performance in predicting pathologies and outcomes from the 12-lead electrocardiogram (ECG). However, these models often need to be trained with large, labelled datasets, which are not…

Machine Learning · Computer Science 2022-04-12 Aniruddh Raghu , Divya Shanmugam , Eugene Pomerantsev , John Guttag , Collin M. Stultz

In diagnosing neurological disorders from electroencephalography (EEG) data, foundation models such as Transformers have been employed to capture temporal dynamics. Additionally, Graph Neural Networks (GNNs) are critical for representing…

Machine Learning · Computer Science 2025-02-19 Toyotaro Suzumura , Hiroki Kanezashi , Shotaro Akahori

Biological signals, such as electroencephalograms (EEG), play a crucial role in numerous clinical applications, exhibiting diverse data formats and quality profiles. Current deep learning models for biosignals are typically specialized for…

Signal Processing · Electrical Eng. & Systems 2023-05-18 Chaoqi Yang , M. Brandon Westover , Jimeng Sun

Normalization is a critical yet often overlooked component in the preprocessing pipeline for EEG deep learning applications. The rise of large-scale pretraining paradigms such as self-supervised learning (SSL) introduces a new set of tasks…

Signal Processing · Electrical Eng. & Systems 2025-07-01 Dung Truong , Arnaud Delorme