English
Related papers

Related papers: ChineseEEG-2: An EEG Dataset for Multimodal Semant…

200 papers

Electroencephalography (EEG) recordings of brain activity taken while participants read or listen to language are widely used within the cognitive neuroscience and psycholinguistics communities as a tool to study language comprehension.…

Computation and Language · Computer Science 2019-11-05 Dan Schwartz , Tom Mitchell

Electroencephalography (EEG) is a critical tool in neuroscience and clinical practice for monitoring and analyzing brain activity. Traditional neural network models, such as EEGNet, have achieved considerable success in decoding EEG signals…

Neurons and Cognition · Quantitative Biology 2025-03-05 Chi-Sheng Chen , Samuel Yen-Chi Chen , Aidan Hung-Wen Tsai , Chun-Shu Wei

Deep Learning has revolutionized various fields, including Computer Vision, Natural Language Processing, as well as Biomedical research. Within the field of neuroscience, specifically in electrophysiological neuroimaging, researchers are…

Machine Learning · Computer Science 2022-04-14 Dung Truong , Manisha Sinha , Kannan Umadevi Venkataraju , Michael Milham , Arnaud Delorme

Remarkable progress on English instruction tuning has facilitated the efficacy and reliability of large language models (LLMs). However, there remains a noticeable gap in instruction tuning for Chinese, where the complex linguistic features…

Electroencephalography (EEG) signals are crucial for investigating brain function and cognitive processes. This study aims to address the challenges of efficiently recording and analyzing high-dimensional EEG signals while listening to…

Machine Learning · Computer Science 2024-08-23 Jingyi Wang , Zhiqun Wang , Guiran Liu

In conventional machine learning (ML) approaches applied to electroencephalography (EEG), this is often a limited focus, isolating specific brain activities occurring across disparate temporal scales (from transient spikes in milliseconds…

Quantitative Methods · Quantitative Biology 2024-02-06 Jonathan W. Kim , Ahmed Alaa , Danilo Bernardo

Large Language Models (LLMs) have demonstrated unparalleled effectiveness in various NLP tasks, and integrating LLMs with automatic speech recognition (ASR) is becoming a mainstream paradigm. Building upon this momentum, our research delves…

Electroencephalography (EEG) is a generally used neuroimaging approach in brain-computer interfaces due to its non-invasive characteristics and convenience, making it an effective tool for understanding human intentions. Therefore, recent…

Signal Processing · Electrical Eng. & Systems 2024-11-19 Sung-Jin Kim , Dae-Hyeok Lee , Hyeon-Taek Han

Recent promising results in auditory attention decoding (AAD) using scalp electroencephalography (EEG) have motivated the exploration of cEEGrid, a flexible and portable ear-EEG system. While prior cEEGrid-based studies have confirmed the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-23 Yuanming Zhang , Zeyan Song , Jing Lu , Fei Chen , Zhibin Lin

Current assistive hearing devices, such as hearing aids and cochlear implants, lack the ability to adapt to the listener's focus of auditory attention, limiting their effectiveness in complex acoustic environments like cocktail party…

Signal Processing · Electrical Eng. & Systems 2025-10-29 Simon Geirnaert , Simon L. Kappel , Preben Kidmose

All data modalities are not created equal, even when the signal they measure comes from the same source. In the case of the brain, two of the most important data modalities are the scalp electroencephalogram (EEG), and the intracranial…

Signal Processing · Electrical Eng. & Systems 2025-02-26 Francesco Stefano Carzaniga , Gary Tom Hoppeler , Michael Hersche , Kaspar Anton Schindler , Abbas Rahimi

In real-world applications of noninvasive electroencephalography (EEG), specialized decoders often show limited generalizability across diverse tasks under subject-independent settings. One central challenge is that task-relevant EEG…

Artificial Intelligence · Computer Science 2026-04-21 Zhiyuan Ma , Zeyuan Li , Zihao Qiu , Jinhao Li , Lingqin Meng , Xinche Zhang , Yixuan Liu , Xinke Shen , Sen Song

Recently, many efforts have been made to explore how the brain processes speech using electroencephalographic (EEG) signals, where deep learning-based approaches were shown to be applicable in this field. In order to decode speech signals…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-24 Qiushi Zhu , Xiaoying Zhao , Jie Zhang , Yu Gu , Chao Weng , Yuchen Hu

Electroencephalography (EEG) signal decoding is a key technology that translates brain activity into executable commands, laying the foundation for direct brain-machine interfacing and intelligent interaction. To address the inherent…

Machine Learning · Computer Science 2026-01-05 Xiangrui Cai , Shaocheng Ma , Lei Cao , Jie Li , Tianyu Liu , Yilin Dong

Audio Large Language Models (Audio LLMs) have demonstrated strong capabilities in integrating speech perception with language understanding. However, whether their internal representations align with human neural dynamics during…

Sound · Computer Science 2026-02-04 Haoyun Yang , Xin Xiao , Jiang Zhong , Yu Tian , Dong Xiaohua , Yu Mao , Hao Wu , Kaiwen Wei

The electroencephalography (EEG), which is one of the easiest modes of recording brain activations in a non-invasive manner, is often distorted due to recording artifacts which adversely impacts the stimulus-response analysis. The most…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-30 Jaswanth Reddy Katthi , Sriram Ganapathy

Speech decoding from EEG signals is a challenging task, where brain activity is modeled to estimate salient characteristics of acoustic stimuli. We propose FESDE, a novel framework for Fully-End-to-end Speech Decoding from EEG signals. Our…

Signal Processing · Electrical Eng. & Systems 2024-06-14 Jihwan Lee , Aditya Kommineni , Tiantian Feng , Kleanthis Avramidis , Xuan Shi , Sudarsana Kadiri , Shrikanth Narayanan

While Multimodal Large Language Models (MLLMs) show promising performance in automated electrocardiogram interpretation, it remains unclear whether they genuinely perform actual step-by-step reasoning or just rely on superficial visual…

Machine Learning · Computer Science 2026-03-17 Jungwoo Oh , Hyunseung Chung , Junhee Lee , Min-Gyu Kim , Hangyul Yoon , Ki Seong Lee , Youngchae Lee , Muhan Yeo , Edward Choi

Current electroencephalogram (EEG) decoding models are typically trained on small numbers of subjects performing a single task. Here, we introduce a large-scale, code-submission-based competition comprising two challenges. First, the…

Decoding the speech signal that a person is listening to from the human brain via electroencephalography (EEG) can help us understand how our auditory system works. Linear models have been used to reconstruct the EEG from speech or vice…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-18 Mohammad Jalilpour Monesi , Bernd Accou , Tom Francart , Hugo Van Hamme