English
Related papers

Related papers: NeuroIncept Decoder for High-Fidelity Speech Recon…

200 papers

Brain-computer interface (BCI) is the technology that enables the communication between humans and devices by reflecting status and intentions of humans. When conducting imagined speech, the users imagine the pronunciation as if actually…

Human-Computer Interaction · Computer Science 2021-12-15 Dae-Hyeok Lee , Sung-Jin Kim , Keon-Woo Lee

Electroencephalogram (EEG) signals play a pivotal role in clinical medicine, brain research, and neurological disease studies. However, susceptibility to various physiological and environmental artifacts introduces noise in recorded EEG…

Signal Processing · Electrical Eng. & Systems 2024-05-24 Bin Wang , Fei Deng , Peifan Jiang

Although obtaining deep brain activity from non-invasive scalp electroencephalography (sEEG) is crucial for neuroscience and clinical diagnosis, directly generating high-fidelity intracranial electroencephalography (iEEG) signals remains a…

Neurons and Cognition · Quantitative Biology 2026-05-26 Dongyi He , Bin Jiang , Kecheng Feng , Luyin Zhang , Ling Liu , Yuxuan Li , Yun Zhao , He Yan

The aim of the study is to investigate the complex mechanisms of speech perception and ultimately decode the electrical changes in the brain accruing while listening to speech. We attempt to decode heard speech from intracranial…

Human-Computer Interaction · Computer Science 2025-01-28 Milán András Fodor , Tamás Gábor Csapó , Frigyes Viktor Arthur

In this paper we demonstrate predicting electroencephalograpgy (EEG) features from acoustic features using recurrent neural network (RNN) based regression model and generative adversarial network (GAN). We predict various types of EEG…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-20 Gautam Krishna , Co Tran , Mason Carnahan , Yan Han , Ahmed H Tewfik

In this study, we propose an ensemble learning framework for electroencephalogram-based overt speech classification, leveraging denoising diffusion probabilistic models with varying convolutional kernel sizes. The ensemble comprises three…

Sound · Computer Science 2024-11-15 Soowon Kim , Ha-Na Jo , Eunyeong Ko

Decoding language representations directly from the brain can enable new Brain-Computer Interfaces (BCI) for high bandwidth human-human and human-machine communication. Clinically, such technologies can restore communication in people with…

Machine Learning · Computer Science 2019-09-05 Pengfei Sun , Gopala K. Anumanchipalli , Edward F. Chang

Modern neuroprostheses can now restore communication in patients who have lost the ability to speak or move. However, these invasive devices entail risks inherent to neurosurgery. Here, we introduce a non-invasive method to decode the…

Signal Processing · Electrical Eng. & Systems 2025-02-26 Jarod Lévy , Mingfang Zhang , Svetlana Pinet , Jérémy Rapin , Hubert Banville , Stéphane d'Ascoli , Jean-Rémi King

In this paper we demonstrate spoken speech enhancement using electroencephalography (EEG) signals using a generative adversarial network (GAN) based model, gated recurrent unit (GRU) regression based model, temporal convolutional network…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-21 Gautam Krishna , Co Tran , Yan Han , Mason Carnahan , Ahmed H Tewfik

Speech synthesis from intracranial EEG (iEEG) signals offers a promising avenue for restoring communication in individuals with severe speech impairments. However, achieving intelligible and natural speech remains challenging due to…

Sound · Computer Science 2025-08-06 Mohammed Salah Al-Radhi , Géza Németh , Branislav Gerazov

Decoding the human brain has been a hallmark of neuroscientists and Artificial Intelligence researchers alike. Reconstruction of visual images from brain Electroencephalography (EEG) signals has garnered a lot of interest due to its…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Prajwal Singh , Dwip Dalal , Gautam Vashishtha , Krishna Miyapuram , Shanmuganathan Raman

The conversion from text to speech relies on the accurate mapping from linguistic to acoustic symbol sequences, for which current practice employs recurrent statistical models like recurrent neural networks. Despite the good performance of…

Sound · Computer Science 2018-11-07 Santiago Pascual , Antonio Bonafonte , Joan Serrà

Brain activity translation into human language delivers the capability to revolutionize machine-human interaction while providing communication support to people with speech disability. Electronic decoding reaches a certain level of…

Signal Processing · Electrical Eng. & Systems 2025-02-26 Mostafa El Gedawy , Omnia Nabil , Omar Mamdouh , Mahmoud Nady , Nour Alhuda Adel , Ahmed Fares

High-quality speech corpora are essential foundations for most speech applications. However, such speech data are expensive and limited since they are collected in professional recording environments. In this work, we propose an…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-11 Haoyu Li , Yang Ai , Junichi Yamagishi

Current EEG/MEG-to-text decoding systems suffer from three key limitations: (1) reliance on teacher-forcing methods, which compromises robustness during inference, (2) sensitivity to session-specific noise, hindering generalization across…

Artificial Intelligence · Computer Science 2025-08-06 Jilong Li , Zhenxi Song , Jiaqi Wang , Meishan Zhang , Honghai Liu , Min Zhang , Zhiguo Zhang

During speech perception, a listener's electroencephalogram (EEG) reflects acoustic-level processing as well as higher-level cognitive factors such as speech comprehension and attention. However, decoding speech from EEG recordings is…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Mike Thornton , Danilo Mandic , Tobias Reichenbach

Decoding language from brain dynamics is an important open direction in the realm of brain-computer interface (BCI), especially considering the rapid growth of large language models. Compared to invasive-based signals which require…

Computation and Language · Computer Science 2024-06-04 Yiqian Yang , Yiqun Duan , Qiang Zhang , Hyejeong Jo , Jinni Zhou , Won Hee Lee , Renjing Xu , Hui Xiong

Recently, many efforts have been made to explore how the brain processes speech using electroencephalographic (EEG) signals, where deep learning-based approaches were shown to be applicable in this field. In order to decode speech signals…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-24 Qiushi Zhu , Xiaoying Zhao , Jie Zhang , Yu Gu , Chao Weng , Yuchen Hu

In a recent study of auditory evoked potential (AEP) based brain-computer interface (BCI), it was shown that, with an encoder-decoder framework, it is possible to translate human neural activity to speech (T-CAS). However, current…

Sound · Computer Science 2022-03-29 Yina Guo , Xiaofei Zhang , Zhenying Gong , Anhong Wang , Wenwu Wang

Advances in neuroscience and artificial intelligence have enabled preliminary decoding of brain activity. However, despite the progress, the interpretability of neural representations remains limited. A significant challenge arises from the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Hasib Aslam , Muhammad Talal Faiz , Muhammad Imran Malik