English
Related papers

Related papers: Adversarial Approximate Inference for Speech to El…

200 papers

Human voice is the source of several important information. This is in the form of features. These Features help in interpreting various features associated with the speaker and speech. The speaker dependent work researchersare targeted…

Sound · Computer Science 2022-03-30 Shankhanil Ghosh , Chhanda Saha , Naagamani Molakathaala

The decoding of linguistic information from electroencephalography (EEG) signals remains an extremely challenging problem in brain-computer interface (BCI) research. In particular, sentence-level decoding from EEG is difficult due to the…

Artificial Intelligence · Computer Science 2026-05-19 Enrico Collautti , Xiaopeng Mao , Luca Tonin , Stefano Tortora , Sadasivan Puthusserypady

Speech decoding from EEG signals is a challenging task, where brain activity is modeled to estimate salient characteristics of acoustic stimuli. We propose FESDE, a novel framework for Fully-End-to-end Speech Decoding from EEG signals. Our…

Signal Processing · Electrical Eng. & Systems 2024-06-14 Jihwan Lee , Aditya Kommineni , Tiantian Feng , Kleanthis Avramidis , Xuan Shi , Sudarsana Kadiri , Shrikanth Narayanan

In this paper we explore speaker identification using electroencephalography (EEG) signals. The performance of speaker identification systems degrades in presence of background noise, this paper demonstrates that EEG features can be used to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-11 Gautam Krishna , Co Tran , Mason Carnahan , Ahmed Tewfik

We study the problem of inferring user intent from noninvasive electroencephalography (EEG) to restore communication for people with severe speech and physical impairments (SSPI). The focus of this work is improving the estimation of…

Signal Processing · Electrical Eng. & Systems 2022-11-07 Niklas Smedemark-Margulies , Basak Celik , Tales Imbiriba , Aziz Kocanaogullari , Deniz Erdogmus

This work focuses on inner speech recognition starting from EEG signals. Inner speech recognition is defined as the internalized process in which the person thinks in pure meanings, generally associated with an auditory imagery of own inner…

Human-Computer Interaction · Computer Science 2023-10-26 Francesca Gasparini , Elisa Cazzaniga , Aurora Saibene

EEG is a non-invasive, safe, and low-risk method to record electrophysiological signals inside the brain. Especially with recent technology developments like dry electrodes, consumer-grade EEG devices, and rapid advances in machine…

Machine Learning · Computer Science 2025-06-23 Tri Duc Ly , Gia H. Ngo

Electroencephalography (EEG) is an invaluable tool in neuroscience, offering insights into brain activity with high temporal resolution. Recent advancements in machine learning and generative modeling have catalyzed the application of EEG…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yashvir Sabharwal , Balaji Rama

Speech emotion recognition (SER) has advanced significantly for the sake of deep-learning methods, while textual information further enhances its performance. However, few studies have focused on the physiological information during speech…

Sound · Computer Science 2025-11-12 Ziqian Zhang , Min Huang , Zhongzhe Xiao

The electroretinogram (ERG) is a clinical test that records the retina's electrical response to light. The ERG is a promising way to study different neurodevelopmental and neurodegenerative disorders, including autism spectrum disorder…

Brain-computer interfaces (BCI) offer numerous human-centered application possibilities, particularly affecting people with neurological disorders. Text or speech decoding from brain activities is a relevant domain that could augment the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-10 Jihwan Lee , Tiantian Feng , Aditya Kommineni , Sudarsana Reddy Kadiri , Shrikanth Narayanan

\textit{Objective:} Conventional EEG-based auditory attention detection (AAD) is achieved by comparing the time-varying speech stimuli and the elicited EEG signals. However, in order to obtain reliable correlation values, these methods…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-30 Hongxu Zhu , Siqi Cai , Yidi Jiang , Qiquan Zhang , Haizhou Li

Speech signals are subjected to more acoustic interference and emotional factors than other signals. Noisy emotion-riddled speech data is a challenge for real-time speech processing applications. It is essential to find an effective way to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-25 Shibani Hamsa , Ismail Shahin , Youssef Iraqi , Ernesto Damiani , Naoufel Werghi

Decoding speech from non-invasive brain signals, such as electroencephalography (EEG), has the potential to advance brain-computer interfaces (BCIs), with applications in silent communication and assistive technologies for individuals with…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-30 Terrance Yu-Hao Chen , Yulin Chen , Pontus Soederhaell , Sadrishya Agrawal , Kateryna Shapovalenko

Surface electromyography (EMG) is a promising modality for silent speech interfaces, but its effectiveness depends heavily on sensor placement and channel availability. In this work, we investigate the contribution of individual and…

Sound · Computer Science 2026-02-09 Injune Hwang , Jaejun Lee , Kyogu Lee

Research about brain activities involving spoken word production is considerably underdeveloped because of the undiscovered characteristics of speech artifacts, which contaminate electroencephalogram (EEG) signals and prevent the inspection…

Sound · Computer Science 2022-06-02 Holy Lovenia , Hiroki Tanaka , Sakriani Sakti , Ayu Purwarianti , Satoshi Nakamura

Electroencephalogram (EEG) data is crucial for diagnosing mental health conditions but is costly and time-consuming to collect at scale. Synthetic data generation offers a promising solution to augment datasets for machine learning…

Signal Processing · Electrical Eng. & Systems 2025-07-08 Gideon Vos , Maryam Ebrahimpour , Liza van Eijk , Zoltan Sarnyai , Mostafa Rahimi Azghadi

Electrocardiograms (ECGs) are an established technique to screen for abnormal cardiac signals. Recent work has established that it is possible to detect arrhythmia directly from the ECG signal using deep learning algorithms. While a few…

Signal Processing · Electrical Eng. & Systems 2024-11-28 Hyewon Jeong , Suyeol Yun , Hammaad Adam

We present a neuromuscular speech interface that translates electromyographic (EMG) signals recorded from orofacial muscles during speech articulation directly into audio. We find that self-supervised speech (S3) representations are…

Sound · Computer Science 2026-04-21 Harshavardhana T. Gowda , Daniel C. Comstock , Lee M. Miller

In this paper, we demonstrate speech recognition using electroencephalography (EEG) signals obtained using dry electrodes on a limited English vocabulary consisting of three vowels and one word using a deep learning model. We demonstrate a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-19 Gautam Krishna , Co Tran , Mason Carnahan , Morgan M Hagood , Ahmed H Tewfik