English
Related papers

Related papers: WaveMind: Towards a Conversational EEG Foundation …

200 papers

Multimodal large language models (MLLMs) have shown promising advancements in general visual and language understanding. However, the representation of multimodal information using MLLMs remains largely unexplored. In this work, we…

Computation and Language · Computer Science 2024-07-18 Ting Jiang , Minghui Song , Zihan Zhang , Haizhen Huang , Weiwei Deng , Feng Sun , Qi Zhang , Deqing Wang , Fuzhen Zhuang

Scalp electroencephalography (EEG) and intracranial EEG (iEEG) are vital for epilepsy diagnosis and treatment. Their unified analysis offers the potential to harness the complementary strengths of each modality but is challenging due to…

Neurons and Cognition · Quantitative Biology 2025-06-23 Runkai Zhang , Hua Yu , John Q. Gan , Haixian Wang

Deciphering language from brain activity is a crucial task in brain-computer interface (BCI) research. Non-invasive cerebral signaling techniques including electroencephalography (EEG) and magnetoencephalography (MEG) are becoming…

Computation and Language · Computer Science 2025-12-29 Yiqian Yang , Hyejeong Jo , Yiqun Duan , Qiang Zhang , Jinni Zhou , Xuming Hu , Won Hee Lee , Renjing Xu , Hui Xiong

Biological signals, such as electroencephalograms (EEG), play a crucial role in numerous clinical applications, exhibiting diverse data formats and quality profiles. Current deep learning models for biosignals are typically specialized for…

Signal Processing · Electrical Eng. & Systems 2023-05-18 Chaoqi Yang , M. Brandon Westover , Jimeng Sun

This study examines the efficacy of various neural network (NN) models in interpreting mental constructs via electroencephalogram (EEG) signals. Through the assessment of 16 prevalent NN models and their variants across four brain-computer…

Neurons and Cognition · Quantitative Biology 2023-09-26 Xia Chen , Xiangbin Teng , Han Chen , Yafeng Pan , Philipp Geyer

Electroencephalography (EEG) foundation models hold significant promise for universal Brain-Computer Interfaces (BCIs). However, existing approaches often rely on end-to-end fine-tuning and exhibit limited efficacy under frozen-probing…

Machine Learning · Computer Science 2026-03-20 Jiquan Wang , Sha Zhao , Yangxuan Zhou , Yiming Kang , Shijian Li , Gang Pan

Modeling effective representations using multiple views that positively influence each other is challenging, and the existing methods perform poorly on Electroencephalogram (EEG) signals for sleep-staging tasks. In this paper, we propose a…

Recently, many efforts have been made to explore how the brain processes speech using electroencephalographic (EEG) signals, where deep learning-based approaches were shown to be applicable in this field. In order to decode speech signals…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-24 Qiushi Zhu , Xiaoying Zhao , Jie Zhang , Yu Gu , Chao Weng , Yuchen Hu

Electroencephalography (EEG) is an essential technique for neuroscience research and brain-computer interface (BCI) applications. Recently, large-scale EEG foundation models have been developed, exhibiting robust generalization capabilities…

Signal Processing · Electrical Eng. & Systems 2025-10-15 Zhige Chen , Chengxuan Qin , Wenlong You , Rui Liu , Congying Chu , Rui Yang , Kay Chen Tan , Jibin Wu

Embodied multimodal large models (EMLMs) have gained significant attention in recent years due to their potential to bridge the gap between perception, cognition, and action in complex, real-world environments. This comprehensive review…

Robotics · Computer Science 2025-02-24 Shoubin Chen , Zehao Wu , Kai Zhang , Chunyu Li , Baiyang Zhang , Fei Ma , Fei Richard Yu , Qingquan Li

Electroencephalography (EEG) is a complex signal and can require several years of training to be correctly interpreted. Recently, deep learning (DL) has shown great promise in helping make sense of EEG signals due to its capacity to learn…

Machine Learning · Computer Science 2019-01-23 Yannick Roy , Hubert Banville , Isabela Albuquerque , Alexandre Gramfort , Tiago H. Falk , Jocelyn Faubert

Electroencephalography (EEG) and magnetoencephalography (MEG) measure neural activity non-invasively by capturing electromagnetic fields generated by dendritic currents. Although rooted in the same biophysics, EEG and MEG exhibit distinct…

Signal Processing · Electrical Eng. & Systems 2025-10-16 Qinfan Xiao , Ziyun Cui , Chi Zhang , Siqi Chen , Wen Wu , Andrew Thwaites , Alexandra Woolgar , Bowen Zhou , Chao Zhang

Brain Signals, such as Electroencephalography (EEG), and human languages have been widely explored independently for many downstream tasks, however, the connection between them has not been well explored. In this study, we explore the…

Neurons and Cognition · Quantitative Biology 2024-05-07 William Han , Jielin Qiu , Jiacheng Zhu , Mengdi Xu , Douglas Weber , Bo Li , Ding Zhao

The classification of harmful brain activities, such as seizures and periodic discharges, play a vital role in neurocritical care, enabling timely diagnosis and intervention. Electroencephalography (EEG) provides a non-invasive method for…

Machine Learning · Computer Science 2025-10-21 Shivraj Singh Bhatti , Aryan Yadav , Mitali Monga , Neeraj Kumar

The decoding of linguistic information from electroencephalography (EEG) signals remains an extremely challenging problem in brain-computer interface (BCI) research. In particular, sentence-level decoding from EEG is difficult due to the…

Artificial Intelligence · Computer Science 2026-05-19 Enrico Collautti , Xiaopeng Mao , Luca Tonin , Stefano Tortora , Sadasivan Puthusserypady

Multimodal Large Language Models (MLLMs) mimic human perception and reasoning system by integrating powerful Large Language Models (LLMs) with various modality encoders (e.g., vision, audio), positioning LLMs as the "brain" and various…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Jiaxing Huang , Jingyi Zhang

Clinical electroencephalogram (EEG) reports encode domain-specific linguistic conventions that general-purpose language models (LMs) fail to capture. We introduce NeuroLex, a lightweight domain-adaptive language model trained purely on EEG…

Computation and Language · Computer Science 2025-11-18 Kang Yin , Hye-Bin Shin

Recent advances in deep learning have had a methodological and practical impact on brain-computer interface research. Among the various deep network architectures, convolutional neural networks have been well suited for…

Signal Processing · Electrical Eng. & Systems 2020-03-06 Wonjun Ko , Eunjin Jeon , Seungwoo Jeong , Heung-Il Suk

Unvoiced electromyography (EMG) is an effective communication tool for individuals unable to produce vocal speech. However, most prior methods rely on paired voiced and unvoiced EMG signals, along with speech data, for EMG-to-text…

Computation and Language · Computer Science 2025-06-03 Payal Mohapatra , Akash Pandey , Xiaoyuan Zhang , Qi Zhu

This article addresses the issue of representing electroencephalographic (EEG) signals in an efficient way. While classical approaches use a fixed Gabor dictionary to analyze EEG signals, this article proposes a data-driven method to obtain…

Machine Learning · Computer Science 2013-03-22 Quentin Barthélemy , Cédric Gouy-Pailler , Yoann Isaac , Antoine Souloumiac , Anthony Larue , Jérôme I. Mars