English
Related papers

Related papers: WaveMind: Towards a Conversational EEG Foundation …

200 papers

Multimodal physiological signals, such as EEG, ECG, EOG, and EMG, are crucial for healthcare and brain-computer interfaces. While existing methods rely on specialized architectures and dataset-specific fusion strategies, they struggle to…

Signal Processing · Electrical Eng. & Systems 2026-03-18 Wei-Bang Jiang , Xi Fu , Yi Ding , Cuntai Guan

Electroencephalography (EEG) is one of the most common signals used to capture the electrical activity of the brain, and the decoding of EEG, to acquire the user intents, has been at the forefront of brain-computer/machine interfaces…

Machine Learning · Computer Science 2025-07-04 Haodong Zhang , Hongqi Li

Electroencephalography (EEG) is an objective tool for emotion recognition and shows promising performance. However, the label scarcity problem is a main challenge in this field, which limits the wide application of EEG-based emotion…

Signal Processing · Electrical Eng. & Systems 2024-09-02 Rushuang Zhou , Weishan Ye , Zhiguo Zhang , Yanyang Luo , Li Zhang , Linling Li , Gan Huang , Yining Dong , Yuan-Ting Zhang , Zhen Liang

The performance of speech emotion recognition (SER) is limited by the insufficient emotion information in unimodal systems and the feature alignment difficulties in multimodal systems. Recently, multimodal large language models (MLLMs) have…

Sound · Computer Science 2025-09-22 Yiqing Yang , Man-Wai Mak

Electroencephalography (EEG) has wide-ranging applications, from clinical diagnosis to brain-computer interfaces (BCIs). With the increasing volume and variety of EEG data, there has been growing interest in establishing foundation models…

Machine Learning · Computer Science 2025-10-21 Zitao Fang , Chenxuan Li , Hongting Zhou , Shuyang Yu , Guodong Du , Ashwaq Qasem , Yang Lu , Jing Li , Junsong Zhang , Sim Kuan Goh

A central challenge in electroencephalography (EEG) foundation modeling is learning transferable representations across recordings with diverse tasks, montages, references, and spectral characteristics. Existing masked modeling approaches…

Machine Learning · Computer Science 2026-05-26 Jamiyan Sukhbaatar , Satoshi Imamura , Toshihisa Tanaka

Generating clinical reports that summarize abnormal patterns, diagnostic findings, and clinical interpretations from long-term EEG recordings remains labor-intensive. We present CELM, the first clinical EEG-to-Language foundation model…

Machine Learning · Computer Science 2026-05-15 Jathurshan Pradeepkumar , Zheng Chen , Jimeng Sun

Recent self-supervised pre-training methods for electroencephalogram (EEG) have shown promising results. However, the pre-trained models typically require full fine-tuning on each downstream task individually to achieve good performance. In…

Machine Learning · Computer Science 2026-04-30 Sicheng Dai , Kai Chen , Hongwang Xiao , Shan Yu , Qiwei Ye

Decoding natural language from brain activity using non-invasive electroencephalography (EEG) remains a significant challenge in neuroscience and machine learning, particularly for open-vocabulary scenarios where traditional methods…

Machine Learning · Computer Science 2025-06-19 Mohamed Masry , Mohamed Amen , Mohamed Elzyat , Mohamed Hamed , Norhan Magdy , Maram Khaled

Reading comprehension, a fundamental cognitive ability essential for knowledge acquisition, is a complex skill, with a notable number of learners lacking proficiency in this domain. This study introduces innovative tasks for Brain-Computer…

Human-Computer Interaction · Computer Science 2024-01-30 Yuhong Zhang , Shilai Yang , Gert Cauwenberghs , Tzyy-Ping Jung

Brain-machine interfaces (BMIs), particularly those based on electroencephalography (EEG), offer promising solutions for assisting individuals with motor disabilities. However, challenges in reliably interpreting EEG signals for specific…

Signal Processing · Electrical Eng. & Systems 2025-04-23 Biplov Paneru , Bipul Thapa , Bishwash Paneru , Sanjog Chhetri Sapkota

Premise. Patterns of electrical brain activity recorded via electroencephalography (EEG) offer immense value for scientific and clinical investigations. The inability of supervised EEG encoders to learn robust EEG patterns and their…

Signal Processing · Electrical Eng. & Systems 2025-12-25 Gayal Kuruppu , Neeraj Wagh , Vaclav Kremen , Sandipan Pati , Gregory Worrell , Yogatheesan Varatharajah

Robotic arms are increasingly being used in collaborative environments, requiring an accurate understanding of human intentions to ensure both effectiveness and safety. Electroencephalogram (EEG) signals, which measure brain activity,…

Signal Processing · Electrical Eng. & Systems 2024-11-20 Byeong-Hoo Lee , Kang Yin

This thesis delves into the world of non-invasive electrophysiological brain signals like electroencephalography (EEG) and magnetoencephalography (MEG), focusing on modelling and decoding such data. The research aims to investigate what…

Signal Processing · Electrical Eng. & Systems 2025-10-30 Richard Csaky

Electrocardiogram (ECG) is the primary non-invasive diagnostic tool for monitoring cardiac conditions and is crucial in assisting clinicians. Recent studies have concentrated on classifying cardiac conditions using ECG data but have…

Computation and Language · Computer Science 2025-07-09 Zhongwei Wan , Che Liu , Xin Wang , Chaofan Tao , Hui Shen , Jing Xiong , Rossella Arcucci , Huaxiu Yao , Mi Zhang

Decoding neurophysiological signals into language is of great research interest within brain-computer interface (BCI) applications. Electroencephalography (EEG), known for its non-invasiveness, ease of use, and cost-effectiveness, has been…

Quantitative Methods · Quantitative Biology 2024-09-26 Yitian Tao , Yan Liang , Luoyu Wang , Yongqing Li , Qing Yang , Han Zhang

Speech Language Models (SLMs) have made significant progress in spoken language understanding. Yet it remains unclear whether they can fully perceive non lexical vocal cues alongside spoken words, and respond with empathy that aligns with…

Computation and Language · Computer Science 2026-03-06 Li Zhou , Lutong Yu , You Lyu , Yihang Lin , Zefeng Zhao , Junyi Ao , Yuhao Zhang , Benyou Wang , Haizhou Li

The increasing number of dispersed EEG dataset publications and the advancement of large-scale Electroencephalogram (EEG) models have increased the demand for practical tools to manage diverse EEG datasets. However, the inherent complexity…

Signal Processing · Electrical Eng. & Systems 2024-10-11 Chengxuan Qin , Rui Yang , Wenlong You , Zhige Chen , Longsheng Zhu , Mengjie Huang , Zidong Wang

Visual neural decoding aims to extract and interpret original visual experiences directly from human brain activity. Recent studies have demonstrated the feasibility of decoding visual semantic categories from electroencephalography (EEG)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Hongzhou Chen , Lianghua He , Yihang Liu , Longzhen Yang , Shaohua Shang , MengChu Zhou

Electrocardiogram (ECG) is widely used in healthcare applications, such as arrhythmia detection and sleep monitoring, making accurate ECG analysis critically essential. Traditional deep learning models for ECG are task-specific, with…

Signal Processing · Electrical Eng. & Systems 2025-10-14 Yu Han , Vittorio Murino , Xiaofeng Liu , Xiang Zhang , Cheng Ding