English

Speech Recognition with no speech or with noisy speech

Machine Learning 2019-03-05 v1 Machine Learning
Authors: Gautam Krishna , Co Tran , Jianguo Yu , Ahmed H Tewfik
View on arXiv ↗ PDF ↗

Abstract

The performance of automatic speech recognition systems(ASR) degrades in the presence of noisy speech. This paper demonstrates that using electroencephalography (EEG) can help automatic speech recognition systems overcome performance loss in the presence of noise. The paper also shows that distillation training of automatic speech recognition systems using EEG features will increase their performance. Finally, we demonstrate the ability to recognize words from EEG with no speech signal on a limited English vocabulary with high accuracy.

Keywords

automatic speech recognition speech recognition speaker verification

Cite

@article{arxiv.1903.00739,
  title  = {Speech Recognition with no speech or with noisy speech},
  author = {Gautam Krishna and Co Tran and Jianguo Yu and Ahmed H Tewfik},
  journal= {arXiv preprint arXiv:1903.00739},
  year   = {2019}
}

Comments

Accepted for ICASSP 2019

Related papers

View all related →
Audio and Speech Processing · Electrical Eng. & Systems
Advancing Speech Recognition With No Speech Or With Noisy Speech
Gautam Krishna, Co Tran, Mason Carnahan, Ahmed H Tewfik
2020-03-17
Audio and Speech Processing · Electrical Eng. & Systems
State-of-the-art Speech Recognition using EEG and Towards Decoding of Speech Spectrum From EEG
Gautam Krishna, Yan Han, Co Tran, Mason Carnahan +1
2020-03-06
Audio and Speech Processing · Electrical Eng. & Systems
Speaker Identification using EEG
Gautam Krishna, Co Tran, Mason Carnahan, Ahmed Tewfik
2020-03-11
Audio and Speech Processing · Electrical Eng. & Systems
Continuous Silent Speech Recognition using EEG
Gautam Krishna, Co Tran, Mason Carnahan, Ahmed Tewfik
2020-05-06
Sound · Computer Science
Brain Signals to Rescue Aphasia, Apraxia and Dysarthria Speech Recognition
Gautam Krishna, Mason Carnahan, Shilpa Shamapant, Yashitha Surendranath +5
2021-07-20
Audio and Speech Processing · Electrical Eng. & Systems
Improving EEG based continuous speech recognition using GAN
Gautam Krishna, Co Tran, Mason Carnahan, Ahmed Tewfik
2020-06-03
Machine Learning · Computer Science
Continuous Speech Recognition using EEG and Video
Gautam Krishna, Mason Carnahan, Co Tran, Ahmed H Tewfik
2020-01-01
Audio and Speech Processing · Electrical Eng. & Systems
EEG based Continuous Speech Recognition using Transformers
Gautam Krishna, Co Tran, Mason Carnahan, Ahmed H Tewfik
2020-05-06
Sound · Computer Science
Speech Enhancement Modeling Towards Robust Speech Recognition System
Urmila Shrawankar, V. M. Thakare
2013-05-08
Sound · Computer Science
A Comprehensive Study on the Effectiveness of ASR Representations for Noise-Robust Speech Emotion Recognition
Xiaohan Shi, Jiajun He, Xingfeng Li, Tomoki Toda
2026-01-13
Audio and Speech Processing · Electrical Eng. & Systems
Improving EEG based Continuous Speech Recognition
Gautam Krishna, Co Tran, Mason Carnahan, Yan Han +1
2019-12-25
Computation and Language · Computer Science
Towards Unsupervised Speech Recognition Without Pronunciation Models
Junrui Ni, Liming Wang, Yang Zhang, Kaizhi Qian +3
2025-01-10
Computation and Language · Computer Science
An Adaptive Psychoacoustic Model for Automatic Speech Recognition
Peng Dai, Xue Teng, Frank Rudzicz, Ing Yann Soon
2016-09-16
Audio and Speech Processing · Electrical Eng. & Systems
Robust End-to-End Speaker Verification Using EEG
Yan Han, Gautam Krishna, Co Tran, Mason Carnahan +1
2020-06-11
Audio and Speech Processing · Electrical Eng. & Systems
Speech Recognition using EEG signals recorded using dry electrodes
Gautam Krishna, Co Tran, Mason Carnahan, Morgan M Hagood +1
2020-08-19
Audio and Speech Processing · Electrical Eng. & Systems
Speech Recognition With No Speech Or With Noisy Speech Beyond English
Gautam Krishna, Co Tran, Yan Han, Mason Carnahan +1
2020-03-02
Audio and Speech Processing · Electrical Eng. & Systems
Speech Emotion Recognition with ASR Integration
Yuanchao Li
2026-03-03
Audio and Speech Processing · Electrical Eng. & Systems
On Neural Phone Recognition of Mixed-Source ECoG Signals
Ahmed Hussen Abdelaziz, Shuo-Yiin Chang, Nelson Morgan, Erik Edwards +4
2019-12-13
Computation and Language · Computer Science
Automatic Speech Recognition for Non-Native English: Accuracy and Disfluency Handling
Michael McGuire
2025-04-01
Sound · Computer Science
Improving Voice Separation by Incorporating End-to-end Speech Recognition
Naoya Takahashi, Mayank Kumar Singh, Sakya Basak, Parthasaarathy Sudarsanam +2
2020-05-05
Audio and Speech Processing · Electrical Eng. & Systems
On the Efficacy and Noise-Robustness of Jointly Learned Speech Emotion and Automatic Speech Recognition
Lokesh Bansal, S. Pavankumar Dubagunta, Malolan Chetlur, Pushpak Jagtap +1
2023-05-29
Artificial Intelligence · Computer Science
Automatic Speech Recognition And Limited Vocabulary: A Survey
Jean Louis K. E. Fendji, Diane C. M. Tala, Blaise O. Yenke, Marcellin Atemkeng
2022-03-03
Audio and Speech Processing · Electrical Eng. & Systems
Too Good to Be True: A Study on Modern Automatic Speech Recognition for the Evaluation of Speech Enhancement
Danilo de Oliveira, Tal Peer, Timo Gerkmann
2026-05-13
Audio and Speech Processing · Electrical Eng. & Systems
Understanding effect of speech perception in EEG based speech recognition systems
Gautam Krishna, Co Tran, Mason Carnahan, Ahmed Tewfik
2020-06-03
Audio and Speech Processing · Electrical Eng. & Systems
A Neural Acoustic Echo Canceller Optimized Using An Automatic Speech Recognizer And Large Scale Synthetic Data
Nathan Howard, Alex Park, Turaj Zakizadeh Shabestary, Alexander Gruenstein +1
2021-06-03
R2 v1 2026-06-23T07:56:21.021Z