English
Related papers

Related papers: EEG-Language Pretraining for Highly Label-Efficien…

200 papers

Clinical electroencephalography is routinely used to evaluate patients with diverse and often overlapping neurological conditions, yet interpretation remains manual, time-intensive, and variable across experts. While automated EEG analysis…

Human-Computer Interaction · Computer Science 2025-12-30 Argha Kamal Samanta , Deepak Mewada , Monalisa Sarma , Debasis Samanta

The current electroencephalogram (EEG) based deep learning models are typically designed for specific datasets and applications in brain-computer interaction (BCI), limiting the scale of the models and thus diminishing their perceptual…

Machine Learning · Computer Science 2024-06-06 Wei-Bang Jiang , Li-Ming Zhao , Bao-Liang Lu

The advent of large language models (LLMs) has opened new avenues for analyzing complex, unstructured data, particularly within the medical domain. Electronic Health Records (EHRs) contain a wealth of information in various formats,…

Information Retrieval · Computer Science 2025-06-10 Wu Hao Ran , Xi Xi , Furong Li , Jingyi Lu , Jian Jiang , Hui Huang , Yuzhuan Zhang , Shi Li

While recent multimodal large language models (MLLMs) have advanced automated ECG interpretation, they still face two key limitations: (1) insufficient multimodal synergy between time series signals and visual ECG representations, and (2)…

Computation and Language · Computer Science 2025-10-21 Xiang Lan , Feng Wu , Kai He , Qinghao Zhao , Shenda Hong , Mengling Feng

Electroencephalography (EEG), with its broad range of applications, necessitates models that can generalize effectively across various tasks and datasets. Large EEG Models (LEMs) address this by pretraining encoder-centric architectures on…

Machine Learning · Computer Science 2025-09-29 Chenyu Liu , Yuqiu Deng , Tianyu Liu , Jinan Zhou , Xinliang Zhou , Ziyu Jia , Yi Ding

Decoding human activity from EEG signals has long been a popular research topic. While recent studies have increasingly shifted focus from single-subject to cross-subject analysis, few have explored the model's ability to perform zero-shot…

Neural and Evolutionary Computing · Computer Science 2025-06-18 Yifei Liu , Hengwei Ye , Shuhang Li

Clinical electroencephalogram (EEG) reports encode domain-specific linguistic conventions that general-purpose language models (LMs) fail to capture. We introduce NeuroLex, a lightweight domain-adaptive language model trained purely on EEG…

Computation and Language · Computer Science 2025-11-18 Kang Yin , Hye-Bin Shin

The integration of multimodal Electronic Health Records (EHR) data has significantly improved clinical predictive capabilities. Leveraging clinical notes and multivariate time-series EHR, existing models often lack the medical context…

Artificial Intelligence · Computer Science 2024-02-13 Yinghao Zhu , Changyu Ren , Shiyun Xie , Shukai Liu , Hangyuan Ji , Zixiang Wang , Tao Sun , Long He , Zhoujun Li , Xi Zhu , Chengwei Pan

Electrocardiograms (ECGs) are widely used non-invasive measurements of cardiac activity and play a central role in clinical diagnosis. Recent multimodal approaches align ECG signals with clinical reports to incorporate diagnostic semantics,…

While electroencephalogram (EEG) has been a crucial tool for monitoring the brain and diagnosing neurological disorders (e.g., epilepsy), learning meaningful representations from raw EEG signals remains challenging due to limited…

Machine Learning · Computer Science 2025-09-03 Jia Hong Puah , Sim Kuan Goh , Ziwei Zhang , Zixuan Ye , Chow Khuen Chan , Kheng Seang Lim , Si Lei Fong , Kok Sin Woon , Cuntai Guan

In the fields of affective computing (AC) and brain-machine interface (BMI), the analysis of physiological and behavioral signals to discern individual emotional states has emerged as a critical research frontier. While deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Hongyu Chen , Weiming Zeng , Chengcheng Chen , Luhui Cai , Fei Wang , Yuhu Shi , Lei Wang , Wei Zhang , Yueyang Li , Hongjie Yan , Wai Ting Siok , Nizhuan Wang

Pretraining multimodal models on Electronic Health Records (EHRs) provides a means of learning representations that can transfer to downstream tasks with minimal supervision. Recent multimodal models induce soft local alignments between…

Machine Learning · Computer Science 2023-02-27 Denis Jered McInerney , Geoffrey Young , Jan-Willem van de Meent , Byron C. Wallace

Electroencephalography (EEG) foundation models have recently emerged as a promising paradigm for brain-computer interfaces (BCIs), aiming to learn transferable neural representations from large-scale heterogeneous recordings. Despite rapid…

Machine Learning · Computer Science 2026-02-06 Dingkun Liu , Yuheng Chen , Zhu Chen , Zhenyao Cui , Yaozhi Wen , Jiayu An , Jingwei Luo , Dongrui Wu

Transformer neural networks require a large amount of labeled data to train effectively. Such data is often scarce in electroencephalography, as annotations made by medical experts are costly. This is why self-supervised training, using…

Signal Processing · Electrical Eng. & Systems 2024-10-11 Tim Bary , Benoit Macq

Emotion recognition in conversations (ERC) is challenging due to the multimodal nature of the emotion expression. In this paper, we propose to pretrain a text-based recognition model from unsupervised speech transcripts with LLM guidance.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-22 Soumya Dutta , Sriram Ganapathy

Recent advances in electroencephalography (EEG) foundation models, which capture transferable EEG representations, have greatly accelerated the development of brain-computer interfaces (BCIs). However, existing approaches still struggle to…

Machine Learning · Computer Science 2026-03-24 Muyun Jiang , Shuailei Zhang , Zhenjie Yang , Mengjun Wu , Weibang Jiang , Zhiwei Guo , Wei Zhang , Rui Liu , Shangen Zhang , Yong Li , Yi Ding , Cuntai Guan

Electroencephalogram (EEG) signals play a crucial role in understanding brain activity and diagnosing neurological diseases. Because supervised EEG encoders are unable to learn robust EEG patterns and rely too heavily on expensive signal…

Machine Learning · Computer Science 2025-09-23 Junhong Lai , Jiyu Wei , Lin Yao , Yueming Wang

Biological signals, such as electroencephalograms (EEG), play a crucial role in numerous clinical applications, exhibiting diverse data formats and quality profiles. Current deep learning models for biosignals are typically specialized for…

Signal Processing · Electrical Eng. & Systems 2023-05-18 Chaoqi Yang , M. Brandon Westover , Jimeng Sun

Machine learning (ML) methods have the potential to automate clinical EEG analysis. They can be categorized into feature-based (with handcrafted features), and end-to-end approaches (with learned features). Previous studies on EEG pathology…

Electroencephalography (EEG) analysis stands at the forefront of neuroscience and artificial intelligence research, where foundation models are reshaping the traditional EEG analysis paradigm by leveraging their powerful representational…

Human-Computer Interaction · Computer Science 2025-08-25 Hongqi Li , Yitong Chen , Yujuan Wang , Weihang Ni , Haodong Zhang