English
Related papers

Related papers: NeuSpeech: Decode Neural signal as Speech

200 papers

During speech perception, a listener's electroencephalogram (EEG) reflects acoustic-level processing as well as higher-level cognitive factors such as speech comprehension and attention. However, decoding speech from EEG recordings is…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Mike Thornton , Danilo Mandic , Tobias Reichenbach

With the rapid advancement of large language models like Gemini, GPT, and others, bridging the gap between the human brain and language processing has become an important area of focus. To address this challenge, researchers have developed…

Computation and Language · Computer Science 2025-12-10 Saydul Akbar Murad , Ashim Dahal , Nick Rahimi

Human language processing relies on the brain's capacity for predictive inference. We present a machine learning framework for decoding neural (EEG) responses to dynamic visual language stimuli in Deaf signers. Using coherence between…

Neurons and Cognition · Quantitative Biology 2025-12-25 Sean C. Borneman , Julia Krebs , Ronnie B. Wilbur , Evie A. Malaia

Brain-computer interfaces (BCIs) hold great potential for aiding individuals with speech impairments. Utilizing electroencephalography (EEG) to decode speech is particularly promising due to its non-invasive nature. However, recordings are…

Neurons and Cognition · Quantitative Biology 2024-07-11 Motoshige Sato , Kenichi Tomeoka , Ilya Horiguchi , Kai Arulkumaran , Ryota Kanai , Shuntaro Sasai

Decoding neurophysiological signals into language is of great research interest within brain-computer interface (BCI) applications. Electroencephalography (EEG), known for its non-invasiveness, ease of use, and cost-effectiveness, has been…

Quantitative Methods · Quantitative Biology 2024-09-26 Yitian Tao , Yan Liang , Luoyu Wang , Yongqing Li , Qing Yang , Han Zhang

Brain-computer interfaces (BCI) offer numerous human-centered application possibilities, particularly affecting people with neurological disorders. Text or speech decoding from brain activities is a relevant domain that could augment the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-10 Jihwan Lee , Tiantian Feng , Aditya Kommineni , Sudarsana Reddy Kadiri , Shrikanth Narayanan

Pretrained generative models have opened new frontiers in brain decoding by enabling the synthesis of realistic texts and images from non-invasive brain recordings. However, the reliability of such outputs remains questionable--whether they…

Computation and Language · Computer Science 2025-05-26 Xiaozhao Liu , Dinggang Shen , Xihui Liu

Until recently, human behavioral data from reading has mainly been of interest to researchers to understand human cognition. However, these human language processing signals can also be beneficial in machine learning-based natural language…

Computation and Language · Computer Science 2021-08-11 Nora Hollenstein , Cedric Renggli , Benjamin Glaus , Maria Barrett , Marius Troendle , Nicolas Langer , Ce Zhang

Decoding visual stimuli from neural recordings is a critical challenge in the development of brain-computer interfaces (BCIs). Although recent EEG-based decoding approaches have made progress in tasks such as visual classification,…

Human-Computer Interaction · Computer Science 2024-12-31 Dongyang Li , Haoyang Qin , Mingyang Wu , Jiahua Tang , Yuang Cao , Chen Wei , Quanying Liu

Decoding natural language from brain activity using non-invasive electroencephalography (EEG) remains a significant challenge in neuroscience and machine learning, particularly for open-vocabulary scenarios where traditional methods…

Machine Learning · Computer Science 2025-06-19 Mohamed Masry , Mohamed Amen , Mohamed Elzyat , Mohamed Hamed , Norhan Magdy , Maram Khaled

Reconstructing natural language from non-invasive electroencephalography (EEG) holds great promise as a language decoding technology for brain-computer interfaces (BCIs). However, EEG-based language decoding is still in its nascent stages,…

Computation and Language · Computer Science 2024-09-27 Jiaqi Wang , Zhenxi Song , Zhengyu Ma , Xipeng Qiu , Min Zhang , Zhiguo Zhang

Brain-computer interface (BCI) is the technology that enables the communication between humans and devices by reflecting status and intentions of humans. When conducting imagined speech, the users imagine the pronunciation as if actually…

Human-Computer Interaction · Computer Science 2021-12-15 Dae-Hyeok Lee , Sung-Jin Kim , Keon-Woo Lee

Decoding visual experience from brain signals offers exciting possibilities for neuroscience and interpretable AI. While EEG is accessible and temporally precise, its limitations in spatial detail hinder image reconstruction. Our model…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Arshak Rezvani , Ali Akbari , Kosar Sanjar Arani , Maryam Mirian , Emad Arasteh , Martin J. McKeown

Electroencephalography (EEG) decoding is a challenging task due to the limited availability of labelled data. While transfer learning is a promising technique to address this challenge, it assumes that transferable data domains and task are…

Signal Processing · Electrical Eng. & Systems 2023-08-07 Bruno Aristimunha , Raphael Y. de Camargo , Walter H. Lopez Pinaya , Sylvain Chevallier , Alexandre Gramfort , Cedric Rommel

Deciphering natural language from brain activity through non-invasive devices remains a formidable challenge. Previous non-invasive decoders either require multiple experiments with identical stimuli to pinpoint cortical regions and enhance…

Computation and Language · Computer Science 2024-03-20 Cenyuan Zhang , Xiaoqing Zheng , Ruicheng Yin , Shujie Geng , Jianhan Xu , Xuan Gao , Changze Lv , Zixuan Ling , Xuanjing Huang , Miao Cao , Jianfeng Feng

Neuroimaging techniques have shown to be useful when studying the brain's activity. This paper uses Magnetoencephalography (MEG) data, provided by the Human Connectome Project (HCP), in combination with various deep artificial neural…

Machine Learning · Computer Science 2020-07-07 Ismail Alaoui Abdellaoui , Jesus Garcia Fernandez , Caner Sahinli , Siamak Mehrkanoon

Handwriting imagery has emerged as a promising paradigm for brain-computer interfaces (BCIs) aimed at translating brain activity into text output. Compared with invasively recorded electroencephalography (EEG), non-invasive recording offers…

Signal Processing · Electrical Eng. & Systems 2025-09-04 Hao Yang , Guang Ouyang

Current electroencephalogram (EEG) decoding models are typically trained on small numbers of subjects performing a single task. Here, we introduce a large-scale, code-submission-based competition comprising two challenges. First, the…

We present a novel approach to EEG decoding for non-invasive brain machine interfaces (BMIs), with a focus on motor-behavior classification. While conventional convolutional architectures such as EEGNet and DeepConvNet are effective in…

Machine Learning · Computer Science 2025-12-09 Tian Lan

Passive brain-computer interfaces offer a potential source of implicit feedback for alignment of large language models, but most mental state decoding has been done in controlled tasks. This paper investigates whether established EEG…

Human-Computer Interaction · Computer Science 2026-02-03 Lucija Mihić Zidar , Philipp Wicke , Praneel Bhatia , Rosa Lutz , Marius Klug , Thorsten O. Zander