English

Continuous Silent Speech Recognition using EEG

Audio and Speech Processing 2020-05-06 v7 Machine Learning Sound Machine Learning
Authors: Gautam Krishna , Co Tran , Mason Carnahan , Ahmed Tewfik
View on arXiv ↗ PDF ↗

Abstract

In this paper we explore continuous silent speech recognition using electroencephalography (EEG) signals. We implemented a connectionist temporal classification (CTC) automatic speech recognition (ASR) model to translate EEG signals recorded in parallel while subjects were reading English sentences in their mind without producing any voice to text. Our results demonstrate the feasibility of using EEG signals for performing continuous silent speech recognition. We demonstrate our results for a limited English vocabulary consisting of 30 unique sentences.

Keywords

eeg signal processing automatic speech recognition

Cite

@article{arxiv.2002.03851,
  title  = {Continuous Silent Speech Recognition using EEG},
  author = {Gautam Krishna and Co Tran and Mason Carnahan and Ahmed Tewfik},
  journal= {arXiv preprint arXiv:2002.03851},
  year   = {2020}
}

Related papers

View all related →
Audio and Speech Processing · Electrical Eng. & Systems
Advancing Speech Recognition With No Speech Or With Noisy Speech
Gautam Krishna, Co Tran, Mason Carnahan, Ahmed H Tewfik
2020-03-17
Audio and Speech Processing · Electrical Eng. & Systems
Speech Recognition With No Speech Or With Noisy Speech Beyond English
Gautam Krishna, Co Tran, Yan Han, Mason Carnahan +1
2020-03-02
Machine Learning · Computer Science
Continuous Speech Recognition using EEG and Video
Gautam Krishna, Mason Carnahan, Co Tran, Ahmed H Tewfik
2020-01-01
Audio and Speech Processing · Electrical Eng. & Systems
Understanding effect of speech perception in EEG based speech recognition systems
Gautam Krishna, Co Tran, Mason Carnahan, Ahmed Tewfik
2020-06-03
Audio and Speech Processing · Electrical Eng. & Systems
State-of-the-art Speech Recognition using EEG and Towards Decoding of Speech Spectrum From EEG
Gautam Krishna, Yan Han, Co Tran, Mason Carnahan +1
2020-03-06
Audio and Speech Processing · Electrical Eng. & Systems
Improving EEG based Continuous Speech Recognition
Gautam Krishna, Co Tran, Mason Carnahan, Yan Han +1
2019-12-25
Audio and Speech Processing · Electrical Eng. & Systems
EEG based Continuous Speech Recognition using Transformers
Gautam Krishna, Co Tran, Mason Carnahan, Ahmed H Tewfik
2020-05-06
Machine Learning · Computer Science
Speech Recognition with no speech or with noisy speech
Gautam Krishna, Co Tran, Jianguo Yu, Ahmed H Tewfik
2019-03-05
Audio and Speech Processing · Electrical Eng. & Systems
Speech Recognition using EEG signals recorded using dry electrodes
Gautam Krishna, Co Tran, Mason Carnahan, Morgan M Hagood +1
2020-08-19
Audio and Speech Processing · Electrical Eng. & Systems
Speech Synthesis using EEG
Gautam Krishna, Co Tran, Yan Han, Mason Carnahan
2020-05-05
Audio and Speech Processing · Electrical Eng. & Systems
Improving EEG based continuous speech recognition using GAN
Gautam Krishna, Co Tran, Mason Carnahan, Ahmed Tewfik
2020-06-03
Machine Learning · Computer Science
Cueless EEG imagined speech for subject identification: dataset and benchmarks
Ali Derakhshesh, Zahra Dehghanian, Reza Ebrahimpour, Hamid R. Rabiee
2026-01-29
Quantitative Methods · Quantitative Biology
A Silent Speech Decoding System from EEG and EMG with Heterogenous Electrode Configurations
Masakazu Inoue, Motoshige Sato, Kenichi Tomeoka, Nathania Nah +4
2025-06-18
Audio and Speech Processing · Electrical Eng. & Systems
Advancing Speech Synthesis using EEG
Gautam Krishna, Co Tran, Mason Carnahan, Ahmed Tewfik
2020-05-05
Signal Processing · Electrical Eng. & Systems
Decoding Covert Speech from EEG Using a Functional Areas Spatio-Temporal Transformer
Muyun Jiang, Yi Ding, Wei Zhang, Kok Ann Colin Teo +13
2025-04-08
Audio and Speech Processing · Electrical Eng. & Systems
An Improved Model for Voicing Silent Speech
David Gaddy, Dan Klein
2021-06-22
Audio and Speech Processing · Electrical Eng. & Systems
Constrained Variational Autoencoder for improving EEG based Speech Recognition Systems
Gautam Krishna, Co Tran, Mason Carnahan, Ahmed Tewfik
2020-06-05
Human-Computer Interaction · Computer Science
Silent Speech Sentence Recognition with Six-Axis Accelerometers using Conformer and CTC Algorithm
Yudong Xie, Zhifeng Han, Qinfan Xiao, Liwei Liang +2
2025-09-19
Computation and Language · Computer Science
Towards Linguistic Neural Representation Learning and Sentence Retrieval from Electroencephalogram Recordings
Jinzhao Zhou, Yiqun Duan, Ziyi Zhao, Yu-Cheng Chang +3
2024-08-12
Sound · Computer Science
Brain Signals to Rescue Aphasia, Apraxia and Dysarthria Speech Recognition
Gautam Krishna, Mason Carnahan, Shilpa Shamapant, Yashitha Surendranath +5
2021-07-20
Audio and Speech Processing · Electrical Eng. & Systems
Spoken Speech Enhancement using EEG
Gautam Krishna, Co Tran, Yan Han, Mason Carnahan +1
2020-04-21
Audio and Speech Processing · Electrical Eng. & Systems
Relating EEG to continuous speech using deep neural networks: a review
Corentin Puffay, Bernd Accou, Lies Bollens, Mohammad Jalilpour Monesi +3
2023-06-19
Human-Computer Interaction · Computer Science
Inner speech recognition through electroencephalographic signals
Francesca Gasparini, Elisa Cazzaniga, Aurora Saibene
2023-10-26
Audio and Speech Processing · Electrical Eng. & Systems
End-to-end Silent Speech Recognition with Acoustic Sensing
Jian Luo, Jianzong Wang, Ning Cheng, Guilin Jiang +1
2020-11-24
Audio and Speech Processing · Electrical Eng. & Systems
Learning Subject-Invariant Representations from Speech-Evoked EEG Using Variational Autoencoders
Lies Bollens, Tom Francart, Hugo Van Hamme
2022-07-25
R2 v1 2026-06-23T13:36:57.341Z