English
Related papers

Related papers: Speech Synthesis using EEG

200 papers

Electroencephalogram (EEG) data is crucial for diagnosing mental health conditions but is costly and time-consuming to collect at scale. Synthetic data generation offers a promising solution to augment datasets for machine learning…

Signal Processing · Electrical Eng. & Systems 2025-07-08 Gideon Vos , Maryam Ebrahimpour , Liza van Eijk , Zoltan Sarnyai , Mostafa Rahimi Azghadi

The electroencephalogram (EEG) is a powerful method to understand how the brain processes speech. Linear models have recently been replaced for this purpose with deep neural networks and yield promising results. In related EEG…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-25 Lies Bollens , Tom Francart , Hugo Van Hamme

Electroencephalography (EEG) plays a significant role in the Brain Computer Interface (BCI) domain, due to its non-invasive nature, low cost, and ease of use, making it a highly desirable option for widespread adoption by the general…

Signal Processing · Electrical Eng. & Systems 2023-03-13 Giulio Tosato , Cesare M. Dalbagno , Francesco Fumagalli

In this paper, we demonstrate speech recognition using electroencephalography (EEG) signals obtained using dry electrodes on a limited English vocabulary consisting of three vowels and one word using a deep learning model. We demonstrate a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-19 Gautam Krishna , Co Tran , Mason Carnahan , Morgan M Hagood , Ahmed H Tewfik

Attending to the speech stream of interest in multi-talker environments can be a challenging task, particularly for listeners with hearing impairment. Research suggests that neural responses assessed with electroencephalography (EEG) are…

Human-Computer Interaction · Computer Science 2023-02-28 Emina Alickovic , Tobias Dorszewski , Thomas U. Christiansen , Kasper Eskelund , Leonardo Gizzi , Martin A. Skoglund , Dorothea Wendt

In this paper we investigate whether electroencephalography (EEG) features can be used to improve the performance of continuous visual speech recognition systems. We implemented a connectionist temporal classification (CTC) based end-to-end…

Machine Learning · Computer Science 2020-01-01 Gautam Krishna , Mason Carnahan , Co Tran , Ahmed H Tewfik

The present study introduces an innovative approach to the synthesis of Electroencephalogram (EEG) signals by integrating diffusion models with reinforcement learning. This integration addresses key challenges associated with traditional…

Signal Processing · Electrical Eng. & Systems 2024-10-02 Yang An , Yuhao Tong , Weikai Wang , Steven W. Su

In the articulatory synthesis task, speech is synthesized from input features containing information about the physical behavior of the human vocal tract. This task provides a promising direction for speech synthesis research, as the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-15 Peter Wu , Shinji Watanabe , Louis Goldstein , Alan W Black , Gopala K. Anumanchipalli

In this paper, we present an improved model for voicing silent speech, where audio is synthesized from facial electromyography (EMG) signals. To give our model greater flexibility to learn its own input features, we directly use EMG signals…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-22 David Gaddy , Dan Klein

The use of electroencephalogram (EEG) as the main input signal in brain-machine interfaces has been widely proposed due to the non-invasive nature of the EEG. Here we are specifically interested in interfaces that extract information from…

Signal Processing · Electrical Eng. & Systems 2018-04-30 Marc-Antoine Moinnereau , Thomas Brienne , Simon Brodeur , Jean Rouat , Kevin Whittingstall , Eric Plourde

In this paper we explore speaker identification using electroencephalography (EEG) signals. The performance of speaker identification systems degrades in presence of background noise, this paper demonstrates that EEG features can be used to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-11 Gautam Krishna , Co Tran , Mason Carnahan , Ahmed Tewfik

Decoding linguistic information from non-invasive brain signals using EEG has gained increasing research attention due to its vast applicational potential. Recently, a number of works have adopted a generative-based framework to decode…

Computation and Language · Computer Science 2024-08-12 Jinzhao Zhou , Yiqun Duan , Ziyi Zhao , Yu-Cheng Chang , Yu-Kai Wang , Thomas Do , Chin-Teng Lin

Speech produced by human vocal apparatus conveys substantial non-semantic information including the gender of the speaker, voice quality, affective state, abnormalities in the vocal apparatus etc. Such information is attributed to the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-16 Prathosh A. P. , Varun Srivastava , Mayank Mishra

The present paper describes a singing voice synthesis based on convolutional neural networks (CNNs). Singing voice synthesis systems based on deep neural networks (DNNs) are currently being proposed and are improving the naturalness of…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-26 Kazuhiro Nakamura , Kei Hashimoto , Keiichiro Oura , Yoshihiko Nankaku , Keiichi Tokuda

Electromyography-to-Speech (ETS) conversion has demonstrated its potential for silent speech interfaces by generating audible speech from Electromyography (EMG) signals during silent articulations. ETS models usually consist of an EMG…

Sound · Computer Science 2024-05-15 Zhao Ren , Kevin Scheck , Qinhan Hou , Stefano van Gogh , Michael Wand , Tanja Schultz

In this paper, we propose an end-to-end neural network (NN) based EEG-speech (NES) modeling framework, in which three network structures are developed to map imagined EEG signals to phonemes. The proposed NES models incorporate a language…

Sound · Computer Science 2017-04-04 Pengfei Sun , Jun Qin

Brain-computer interfaces (BCI) offer numerous human-centered application possibilities, particularly affecting people with neurological disorders. Text or speech decoding from brain activities is a relevant domain that could augment the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-10 Jihwan Lee , Tiantian Feng , Aditya Kommineni , Sudarsana Reddy Kadiri , Shrikanth Narayanan

In this paper we demonstrate continuous noisy speech recognition using connectionist temporal classification (CTC) model on limited Chinese vocabulary using electroencephalography (EEG) features with no speech signal as input and we further…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-02 Gautam Krishna , Co Tran , Yan Han , Mason Carnahan , Ahmed H Tewfik

Reconstructing images using brain signals of imagined visuals may provide an augmented vision to the disabled, leading to the advancement of Brain-Computer Interface (BCI) technology. The recent progress in deep learning has boosted the…

Human-Computer Interaction · Computer Science 2023-03-21 Prajwal Singh , Pankaj Pandey , Krishna Miyapuram , Shanmuganathan Raman

Decoding the human brain has been a hallmark of neuroscientists and Artificial Intelligence researchers alike. Reconstruction of visual images from brain Electroencephalography (EEG) signals has garnered a lot of interest due to its…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Prajwal Singh , Dwip Dalal , Gautam Vashishtha , Krishna Miyapuram , Shanmuganathan Raman