English
Related papers

Related papers: A Penny for Your Thoughts: Decoding Speech from In…

200 papers

Recently, many efforts have been made to explore how the brain processes speech using electroencephalographic (EEG) signals, where deep learning-based approaches were shown to be applicable in this field. In order to decode speech signals…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-24 Qiushi Zhu , Xiaoying Zhao , Jie Zhang , Yu Gu , Chao Weng , Yuchen Hu

Translating imagined speech from human brain activity into voice is a challenging and absorbing research issue that can provide new means of human communication via brain signals. Endeavors toward reconstructing speech from brain activity…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-19 Young-Eun Lee , Seo-Hyun Lee , Sang-Ho Kim , Seong-Whan Lee

Brain activity translation into human language delivers the capability to revolutionize machine-human interaction while providing communication support to people with speech disability. Electronic decoding reaches a certain level of…

Signal Processing · Electrical Eng. & Systems 2025-02-26 Mostafa El Gedawy , Omnia Nabil , Omar Mamdouh , Mahmoud Nady , Nour Alhuda Adel , Ahmed Fares

Transformers are groundbreaking architectures that have changed a flow of deep learning, and many high-performance models are developing based on transformer architectures. Transformers implemented only with attention with encoder-decoder…

Human-Computer Interaction · Computer Science 2021-12-20 Young-Eun Lee , Seo-Hyun Lee

Decoding linguistic information from non-invasive brain signals using EEG has gained increasing research attention due to its vast applicational potential. Recently, a number of works have adopted a generative-based framework to decode…

Computation and Language · Computer Science 2024-08-12 Jinzhao Zhou , Yiqun Duan , Ziyi Zhao , Yu-Cheng Chang , Yu-Kai Wang , Thomas Do , Chin-Teng Lin

Brain signals accompany various information relevant to human actions and mental imagery, making them crucial to interpreting and understanding human intentions. Brain-computer interface technology leverages this brain activity to generate…

Artificial Intelligence · Computer Science 2024-11-15 Jung-Sun Lee , Ha-Na Jo , Seo-Hyun Lee

Brain-computer interfaces (BCI) offer numerous human-centered application possibilities, particularly affecting people with neurological disorders. Text or speech decoding from brain activities is a relevant domain that could augment the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-10 Jihwan Lee , Tiantian Feng , Aditya Kommineni , Sudarsana Reddy Kadiri , Shrikanth Narayanan

Decoding speech from brain activity is a long-awaited goal in both healthcare and neuroscience. Invasive devices have recently led to major milestones in that regard: deep learning algorithms trained on intracranial recordings now start to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-06 Alexandre Défossez , Charlotte Caucheteux , Jérémy Rapin , Ori Kabeli , Jean-Rémi King

During speech perception, a listener's electroencephalogram (EEG) reflects acoustic-level processing as well as higher-level cognitive factors such as speech comprehension and attention. However, decoding speech from EEG recordings is…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Mike Thornton , Danilo Mandic , Tobias Reichenbach

When we hear the word "house", we don't just process sound, we imagine walls, doors, memories. The brain builds meaning through layers, moving from raw acoustics to rich, multimodal associations. Inspired by this, we build on recent work…

Machine Learning · Computer Science 2025-11-11 Kateryna Shapovalenko , Quentin Auster

This paper introduces a novel algorithm designed for speech synthesis from neural activity recordings obtained using invasive electroencephalography (EEG) techniques. The proposed system offers a promising communication solution for…

Decoding emotion from brain activity could unlock a deeper understanding of the human experience. While a number of existing datasets align brain data with speech and with speech transcripts, no datasets have annotated brain data with…

Human-Computer Interaction · Computer Science 2026-01-27 Brian Liu , Oiwi Parker Jones

Until recently, human behavioral data from reading has mainly been of interest to researchers to understand human cognition. However, these human language processing signals can also be beneficial in machine learning-based natural language…

Computation and Language · Computer Science 2021-08-11 Nora Hollenstein , Cedric Renggli , Benjamin Glaus , Maria Barrett , Marius Troendle , Nicolas Langer , Ce Zhang

Restoring speech communication from neural signals is a central goal of brain-computer interface research, yet EEG-based speech reconstruction remains challenging due to limited spatial resolution, susceptibility to noise, and the absence…

Signal Processing · Electrical Eng. & Systems 2025-12-30 Hanbeot Park , Yunjeong Cho , Hunhee Kim

Cognitively inspired NLP leverages human-derived data to teach machines about language processing mechanisms. Recently, neural networks have been augmented with behavioral data to solve a range of NLP tasks spanning syntax and semantics. We…

Computation and Language · Computer Science 2020-10-06 Lukas Muttenthaler , Nora Hollenstein , Maria Barrett

Covert speech involves imagining speaking without audible sound or any movements. Decoding covert speech from electroencephalogram (EEG) is challenging due to a limited understanding of neural pronunciation mapping and the low…

Decoding imagined speech engages complex neural processes that are difficult to interpret due to uncertainty in timing and the limited availability of imagined-response datasets. In this study, we present a Magnetoencephalography (MEG)…

Signal Processing · Electrical Eng. & Systems 2025-12-04 Maryam Maghsoudi , Mohsen Rezaeizadeh , Shihab Shamma

Speech decoding from EEG signals is a challenging task, where brain activity is modeled to estimate salient characteristics of acoustic stimuli. We propose FESDE, a novel framework for Fully-End-to-end Speech Decoding from EEG signals. Our…

Signal Processing · Electrical Eng. & Systems 2024-06-14 Jihwan Lee , Aditya Kommineni , Tiantian Feng , Kleanthis Avramidis , Xuan Shi , Sudarsana Kadiri , Shrikanth Narayanan

The aim of the study is to investigate the complex mechanisms of speech perception and ultimately decode the electrical changes in the brain accruing while listening to speech. We attempt to decode heard speech from intracranial…

Human-Computer Interaction · Computer Science 2025-01-28 Milán András Fodor , Tamás Gábor Csapó , Frigyes Viktor Arthur

Every people has their own voice, likewise, brain signals dis-play distinct neural representations for each individual. Al-though recent studies have revealed the robustness of speech-related paradigms for efficient brain-computer…

Human-Computer Interaction · Computer Science 2021-06-01 Seo-Hyun Lee , Young-Eun Lee , Seong-Whan Lee
‹ Prev 1 2 3 10 Next ›