English
Related papers

Related papers: EEG2TEXT: Open Vocabulary EEG-to-Text Decoding wit…

200 papers

Reconstructing visual stimuli from non-invasive electroencephalography (EEG) remains challenging due to its low spatial resolution and high noise, particularly under realistic low-density electrode configurations. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Emanuele Balloni , Emanuele Frontoni , Chiara Matti , Marina Paolanti , Roberto Pierdicca , Emiliano Santarnecchi

Brain-computer interfaces (BCIs) hold great potential for aiding individuals with speech impairments. Utilizing electroencephalography (EEG) to decode speech is particularly promising due to its non-invasive nature. However, recordings are…

Neurons and Cognition · Quantitative Biology 2024-07-11 Motoshige Sato , Kenichi Tomeoka , Ilya Horiguchi , Kai Arulkumaran , Ryota Kanai , Shuntaro Sasai

The reconstruction of 3D objects from brain signals has gained significant attention in brain-computer interface (BCI) research. Current research predominantly utilizes functional magnetic resonance imaging (fMRI) for 3D reconstruction…

Graphics · Computer Science 2025-05-06 Xia Deng , Shen Chen , Jiale Zhou , Lei Li

Electroencephalography (EEG) is a method of recording brain activity that shows significant promise in applications ranging from disease classification to emotion detection and brain-computer interfaces. Recent advances in deep learning…

Machine Learning · Computer Science 2026-01-15 Amarpal Sahota , Navid Mohammadi Foumani , Raul Santos-Rodriguez , Zahraa S. Abdallah

Reconstructing 3D visual stimuli from Electroencephalography (EEG) data holds significant potential for applications in Brain-Computer Interfaces (BCIs) and aiding individuals with communication disorders. Traditionally, efforts have…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Yuxiang Ge , Jionghao Cheng , Ruiquan Ge , Zhaojie Fang , Gangyong Jia , Xiang Wan , Nannan Li , Ahmed Elazab , Changmiao Wang

The translation of brain dynamics into natural language is pivotal for brain-computer interfaces (BCIs). With the swift advancement of large language models, such as ChatGPT, the need to bridge the gap between the brain and languages…

Human-Computer Interaction · Computer Science 2024-01-04 Yiqun Duan , Jinzhao Zhou , Zhen Wang , Yu-Kai Wang , Chin-Teng Lin

Electroencephalography (EEG) is a non-invasive technique for recording brain electrical activity, widely used in brain-computer interface (BCI) and healthcare. Recent EEG foundation models trained on large-scale datasets have shown improved…

Machine Learning · Computer Science 2025-09-29 Yi Ding , Muyun Jiang , Weibang Jiang , Shuailei Zhang , Xinliang Zhou , Chenyu Liu , Shanglin Li , Yong Li , Cuntai Guan

The remarkable success of large language models (LLMs) across various multi-modality applications is well established. However, integrating large language models with humans, or brain dynamics, remains relatively unexplored. In this paper,…

Signal Processing · Electrical Eng. & Systems 2024-09-04 Jinzhao Zhou , Yiqun Duan , Fred Chang , Thomas Do , Yu-Kai Wang , Chin-Teng Lin

Electroencephalography (EEG) is an invaluable tool in neuroscience, offering insights into brain activity with high temporal resolution. Recent advancements in machine learning and generative modeling have catalyzed the application of EEG…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yashvir Sabharwal , Balaji Rama

Decoding neural representations of visual stimuli from electroencephalography (EEG) offers valuable insights into brain activity and cognition. Recent advancements in deep learning have significantly enhanced the field of visual decoding of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Minsuk Choi , Hiroshi Ishikawa

Decoding speech from non-invasive brain signals, such as electroencephalography (EEG), has the potential to advance brain-computer interfaces (BCIs), with applications in silent communication and assistive technologies for individuals with…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-30 Terrance Yu-Hao Chen , Yulin Chen , Pontus Soederhaell , Sadrishya Agrawal , Kateryna Shapovalenko

Covert speech involves imagining speaking without audible sound or any movements. Decoding covert speech from electroencephalogram (EEG) is challenging due to a limited understanding of neural pronunciation mapping and the low…

Brain computer interface (BCI) research, as well as increasing portions of the field of neuroscience, have found success deploying large-scale artificial intelligence (AI) pre-training methods in conjunction with vast public repositories of…

Neurons and Cognition · Quantitative Biology 2025-06-03 Mattson Ogg , Rahul Hingorani , Diego Luna , Griffin W. Milsap , William G. Coon , Clara A. Scholl

We present a new large-scale electroencephalography (EEG) dataset as part of the THINGS initiative, comprising over 1.6 million visual stimulus trials collected from 20 participants, and totaling more than twice the size of the most popular…

Neurons and Cognition · Quantitative Biology 2025-08-28 Jonathan Xu , Ugo Bruzadin Nunes , Wangshu Jiang , Samuel Ryther , Jordan Pringle , Paul S. Scotti , Arnaud Delorme , Reese Kneeland

Electroencephalography (EEG) is one of the most common signals used to capture the electrical activity of the brain, and the decoding of EEG, to acquire the user intents, has been at the forefront of brain-computer/machine interfaces…

Machine Learning · Computer Science 2025-07-04 Haodong Zhang , Hongqi Li

During speech perception, a listener's electroencephalogram (EEG) reflects acoustic-level processing as well as higher-level cognitive factors such as speech comprehension and attention. However, decoding speech from EEG recordings is…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Mike Thornton , Danilo Mandic , Tobias Reichenbach

This work critically analyzes existing models for open-vocabulary EEG-to-Text translation. We identify a crucial limitation: previous studies often employed implicit teacher-forcing during evaluation, artificially inflating performance…

Computation and Language · Computer Science 2024-10-29 Hyejeong Jo , Yiqian Yang , Juhyeok Han , Yiqun Duan , Hui Xiong , Won Hee Lee

Electroencephalography (EEG) is a neuroimaging technique that records brain neural activity with high temporal resolution. Unlike other methods, EEG does not require prohibitively expensive equipment and can be easily set up using…

Human-Computer Interaction · Computer Science 2024-10-01 Arash Akbarinia

This thesis delves into the world of non-invasive electrophysiological brain signals like electroencephalography (EEG) and magnetoencephalography (MEG), focusing on modelling and decoding such data. The research aims to investigate what…

Signal Processing · Electrical Eng. & Systems 2025-10-30 Richard Csaky

Decoding language from brain dynamics is an important open direction in the realm of brain-computer interface (BCI), especially considering the rapid growth of large language models. Compared to invasive-based signals which require…

Computation and Language · Computer Science 2024-06-04 Yiqian Yang , Yiqun Duan , Qiang Zhang , Hyejeong Jo , Jinni Zhou , Won Hee Lee , Renjing Xu , Hui Xiong