English
Related papers

Related papers: NeuroTTT: Bridging Pretraining-Downstream Task Mis…

200 papers

We exploit a self-supervised deep multi-task learning framework for electrocardiogram (ECG) -based emotion recognition. The proposed solution consists of two stages of learning a) learning ECG representations and b) learning to classify…

Signal Processing · Electrical Eng. & Systems 2020-08-11 Pritam Sarkar , Ali Etemad

Models initialized from self-supervised pretraining may suffer from poor alignment with downstream tasks, reducing the extent to which subsequent fine-tuning can adapt pretrained features toward downstream objectives. To mitigate this, we…

Machine Learning · Computer Science 2026-02-11 Gustav Wagner Zakarias , Lars Kai Hansen , Zheng-Hua Tan

In this study, we introduce an innovative EEG signal reconstruction sub-module designed to enhance the performance of deep learning models on EEG eye-tracking tasks. This sub-module can integrate with all Encoder-Classifier-based deep…

Human-Computer Interaction · Computer Science 2024-08-13 Weigeng Li , Neng Zhou , Xiaodong Qu

Electroencephalogram (EEG) signals are pivotal in providing insights into spontaneous brain activity, highlighting their significant importance in neuroscience research. However, the exploration of versatile EEG models is constrained by…

Signal Processing · Electrical Eng. & Systems 2025-09-01 Tongtian Yue , Xuange Gao , Shuning Xue , Yepeng Tang , Longteng Guo , Jie Jiang , Jing Liu

Deep neural networks for time series must capture complex temporal patterns, to effectively represent dynamic data. Self- and semi-supervised learning methods show promising results in pre-training large models, which -- when finetuned for…

Machine Learning · Computer Science 2025-08-15 Yuhan Xie , William Cappelletti , Mahsa Shoaran , Pascal Frossard

We introduce a two-stage multitask learning framework for analyzing Electroencephalography (EEG) signals that integrates denoising, dynamical modeling, and representation learning. In the first stage, a denoising autoencoder is trained to…

Machine Learning · Computer Science 2026-02-24 Sucheta Ghosh , Felix Dietrich , Zahra Monfared

In practical sleep stage classification, a key challenge is the variability of EEG data across different subjects and environments. Differences in physiology, age, health status, and recording conditions can lead to domain shifts between…

Signal Processing · Electrical Eng. & Systems 2025-01-08 Siyuan Zhao , Chenyu Liu , Yi Ding , Xinliang Zhou

Transfer learning for bio-signals has recently become an important technique to improve prediction performance on downstream tasks with small bio-signal datasets. Recent works have shown that pre-training a neural network model on a large…

Machine Learning · Computer Science 2024-12-19 Eloy Geenjaar , Lie Lu

Machine learning has achieved great success in electroencephalogram (EEG) based brain-computer interfaces (BCIs). Most existing BCI studies focused on improving the decoding accuracy, with only a few considering the adversarial security.…

Human-Computer Interaction · Computer Science 2024-11-05 Xiaoqing Chen , Ziwei Wang , Dongrui Wu

The increasing need for accurate and unified analysis of diverse biological signals, such as ECG and EEG, is paramount for comprehensive patient assessment, especially in synchronous monitoring. Despite advances in multi-sensor fusion, a…

Signal Processing · Electrical Eng. & Systems 2025-07-18 Mohammed Guhdar , Ramadhan J. Mstafa , Abdulhakeem O. Mohammed

Electroencephalography (EEG) signals provide critical insights for applications in disease diagnosis and healthcare. However, the scarcity of labeled EEG data poses a significant challenge. Foundation models offer a promising solution by…

Machine Learning · Computer Science 2025-02-25 Limin Wang , Toyotaro Suzumura , Hiroki Kanezashi

Electroencephalography foundation models (EEG-FMs) have advanced brain signal analysis, but the lack of standardized evaluation benchmarks impedes model comparison and scientific progress. Current evaluations rely on inconsistent protocols…

Signal Processing · Electrical Eng. & Systems 2026-02-16 Wei Xiong , Jiangtong Li , Jie Li , Kun Zhu , Changjun Jiang

Electroencephalography (EEG) is commonly used by physicians for the diagnosis of numerous neurological disorders. Due to the large volume of EEGs requiring interpretation and the specific expertise involved, artificial intelligence-based…

Electroencephalography (EEG) has wide-ranging applications, from clinical diagnosis to brain-computer interfaces (BCIs). With the increasing volume and variety of EEG data, there has been growing interest in establishing foundation models…

Machine Learning · Computer Science 2025-10-21 Zitao Fang , Chenxuan Li , Hongting Zhou , Shuyang Yu , Guodong Du , Ashwaq Qasem , Yang Lu , Jing Li , Junsong Zhang , Sim Kuan Goh

Although recent years have witnessed significant advancements in medical image segmentation, the pervasive issue of domain shift among medical images from diverse centres hinders the effective deployment of pre-trained models. Many…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Ziyang Chen , Yiwen Ye , Yongsheng Pan , Yong Xia

Self-supervised learning has produced impressive results in multimedia domains of audio, vision and speech. This paradigm is equally, if not more, relevant for the domain of biosignals, owing to the scarcity of labelled data in such…

Machine Learning · Computer Science 2024-03-07 Aditya Kommineni , Kleanthis Avramidis , Richard Leahy , Shrikanth Narayanan

Electroencephalography (EEG) foundation models have recently emerged as a promising paradigm for brain-computer interfaces (BCIs), aiming to learn transferable neural representations from large-scale heterogeneous recordings. Despite rapid…

Machine Learning · Computer Science 2026-02-06 Dingkun Liu , Yuheng Chen , Zhu Chen , Zhenyao Cui , Yaozhi Wen , Jiayu An , Jingwei Luo , Dongrui Wu

Continuous electroencephalography (EEG) is routinely used in neurocritical care to monitor seizures and other harmful brain activity, including rhythmic and periodic patterns that are clinically significant. Although deep learning methods…

Human-Computer Interaction · Computer Science 2026-01-05 Argha Kamal Samanta , Deepak Mewada , Monalisa Sarma , Debasis Samanta

Motivation: A perennial challenge for biomedical researchers and clinical practitioners is to stay abreast with the rapid growth of publications and medical notes. Natural language processing (NLP) has emerged as a promising direction for…

Computation and Language · Computer Science 2021-12-16 Robert Tinn , Hao Cheng , Yu Gu , Naoto Usuyama , Xiaodong Liu , Tristan Naumann , Jianfeng Gao , Hoifung Poon

Foundation models pre-trained through masked reconstruction on large-scale EEG data have emerged as a promising paradigm for learning generalizable neural representations across diverse brain-computer interface applications. However, a…

Artificial Intelligence · Computer Science 2026-05-19 Yang Shao , Peiliang Gong , Qun Dai , Daoqiang Zhang