English
Related papers

Related papers: Continuous Silent Speech Recognition using EEG

200 papers

In this paper we demonstrate spoken speech enhancement using electroencephalography (EEG) signals using a generative adversarial network (GAN) based model, gated recurrent unit (GRU) regression based model, temporal convolutional network…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-21 Gautam Krishna , Co Tran , Yan Han , Mason Carnahan , Ahmed H Tewfik

Objective. When a person listens to continuous speech, a corresponding response is elicited in the brain and can be recorded using electroencephalography (EEG). Linear models are presently used to relate the EEG recording to the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-19 Corentin Puffay , Bernd Accou , Lies Bollens , Mohammad Jalilpour Monesi , Jonas Vanthornhout , Hugo Van hamme , Tom Francart

This work focuses on inner speech recognition starting from EEG signals. Inner speech recognition is defined as the internalized process in which the person thinks in pure meanings, generally associated with an auditory imagery of own inner…

Human-Computer Interaction · Computer Science 2023-10-26 Francesca Gasparini , Elisa Cazzaniga , Aurora Saibene

Silent speech interfaces (SSI) has been an exciting area of recent interest. In this paper, we present a non-invasive silent speech interface that uses inaudible acoustic signals to capture people's lip movements when they speak. We exploit…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-24 Jian Luo , Jianzong Wang , Ning Cheng , Guilin Jiang , Jing Xiao

The electroencephalogram (EEG) is a powerful method to understand how the brain processes speech. Linear models have recently been replaced for this purpose with deep neural networks and yield promising results. In related EEG…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-25 Lies Bollens , Tom Francart , Hugo Van Hamme

In this paper we demonstrate that performance of a speaker verification system can be improved by concatenating electroencephalography (EEG) signal features with speech signal features or only using EEG signal features. We use…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-11 Yan Han , Gautam Krishna , Co Tran , Mason Carnahan , Ahmed H Tewfik

Recent work has shown that it is possible to train a single model to perform joint acoustic echo cancellation (AEC), speech enhancement, and voice separation, thereby serving as a unified frontend for robust automatic speech recognition…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-15 Tom O'Malley , Arun Narayanan , Quan Wang

Despite recent advances, Automatic Speech Recognition (ASR) systems are still far from perfect. Typical errors include acronyms, named entities, and domain-specific special words for which little or no labeled data is available. To address…

Computation and Language · Computer Science 2025-01-30 Christian Huber , Alexander Waibel

Recently, many efforts have been made to explore how the brain processes speech using electroencephalographic (EEG) signals, where deep learning-based approaches were shown to be applicable in this field. In order to decode speech signals…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-24 Qiushi Zhu , Xiaoying Zhao , Jie Zhang , Yu Gu , Chao Weng , Yuchen Hu

This paper integrates a voice activity detection (VAD) function with end-to-end automatic speech recognition toward an online speech interface and transcribing very long audio recordings. We focus on connectionist temporal classification…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-16 Takenori Yoshimura , Tomoki Hayashi , Kazuya Takeda , Shinji Watanabe

We present a state-of-the-art end-to-end Automatic Speech Recognition (ASR) model. We learn to listen and write characters with a joint Connectionist Temporal Classification (CTC) and attention-based encoder-decoder network. The encoder is…

Computation and Language · Computer Science 2017-06-12 Takaaki Hori , Shinji Watanabe , Yu Zhang , William Chan

This paper proposes a novel automatic speech recognition (ASR) system that can transcribe individual speaker's speech while identifying whether they are target or non-target speakers from multi-talker overlapped speech. Target-speaker ASR…

Graph-based temporal classification (GTC), a generalized form of the connectionist temporal classification loss, was recently proposed to improve automatic speech recognition (ASR) systems using graph-based supervision. For example, GTC was…

Sound · Computer Science 2022-03-02 Xuankai Chang , Niko Moritz , Takaaki Hori , Shinji Watanabe , Jonathan Le Roux

In this paper we explore speaker identification using electroencephalography (EEG) signals. The performance of speaker identification systems degrades in presence of background noise, this paper demonstrates that EEG features can be used to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-11 Gautam Krishna , Co Tran , Mason Carnahan , Ahmed Tewfik

The use of Automatic speech recognition (ASR) interfaces have become increasingly popular in daily life for use in interaction and control of electronic devices. The interfaces currently being used are not feasible for a variety of users…

Signal Processing · Electrical Eng. & Systems 2022-03-30 Ayush Tripathi

Identifying seizure activities in non-stationary electroencephalography (EEG) is a challenging task, since it is time-consuming, burdensome, and dependent on expensive human resources and subject to error and bias. A computerized seizure…

Signal Processing · Electrical Eng. & Systems 2020-04-29 S. Sheykhivand , T. Yousefi Rezaii , Z. Mousavi , A. Delpak , A. Farzamnia

During speech perception, a listener's electroencephalogram (EEG) reflects acoustic-level processing as well as higher-level cognitive factors such as speech comprehension and attention. However, decoding speech from EEG recordings is…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Mike Thornton , Danilo Mandic , Tobias Reichenbach

The electroencephalogram (EEG) offers a non-invasive means by which a listener's auditory system may be monitored during continuous speech perception. Reliable auditory-EEG decoders could facilitate the objective diagnosis of hearing…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-18 Mike Thornton , Danilo Mandic , Tobias Reichenbach

Decoding natural language from brain activity using non-invasive electroencephalography (EEG) remains a significant challenge in neuroscience and machine learning, particularly for open-vocabulary scenarios where traditional methods…

Machine Learning · Computer Science 2025-06-19 Mohamed Masry , Mohamed Amen , Mohamed Elzyat , Mohamed Hamed , Norhan Magdy , Maram Khaled

Decoding the speech signal that a person is listening to from the human brain via electroencephalography (EEG) can help us understand how our auditory system works. Linear models have been used to reconstruct the EEG from speech or vice…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-18 Mohammad Jalilpour Monesi , Bernd Accou , Tom Francart , Hugo Van Hamme