English
Related papers

Related papers: Understanding effect of speech perception in EEG b…

200 papers

Speech decoding from EEG signals is a challenging task, where brain activity is modeled to estimate salient characteristics of acoustic stimuli. We propose FESDE, a novel framework for Fully-End-to-end Speech Decoding from EEG signals. Our…

Signal Processing · Electrical Eng. & Systems 2024-06-14 Jihwan Lee , Aditya Kommineni , Tiantian Feng , Kleanthis Avramidis , Xuan Shi , Sudarsana Kadiri , Shrikanth Narayanan

Carrying conversations in multi-sound environments is one of the more challenging tasks, since the sounds overlap across time and frequency making it difficult to understand a single sound source. One proposed approach to help isolate an…

Machine Learning · Computer Science 2024-10-25 Seyed Ali Alavi Bajestan , Mark Pitt , Donald S. Williamson

In this paper, we propose a deep learning-based algorithm to improve the performance of automatic speech recognition (ASR) systems for aphasia, apraxia, and dysarthria speech by utilizing electroencephalography (EEG) features recorded…

In this paper we demonstrate predicting electroencephalograpgy (EEG) features from acoustic features using recurrent neural network (RNN) based regression model and generative adversarial network (GAN). We predict various types of EEG…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-20 Gautam Krishna , Co Tran , Mason Carnahan , Yan Han , Ahmed H Tewfik

The present study introduces an innovative approach to the synthesis of Electroencephalogram (EEG) signals by integrating diffusion models with reinforcement learning. This integration addresses key challenges associated with traditional…

Signal Processing · Electrical Eng. & Systems 2024-10-02 Yang An , Yuhao Tong , Weikai Wang , Steven W. Su

Relating speech to EEG holds considerable importance but is challenging. In this study, a deep convolutional network was employed to extract spatiotemporal features from EEG data. Self-supervised speech representation and contextual text…

Signal Processing · Electrical Eng. & Systems 2024-02-02 Bo Wang , Xiran Xu , Zechen Zhang , Haolin Zhu , YuJie Yan , Xihong Wu , Jing Chen

Speech enhancement is widely used as a front-end to improve the speech quality in many audio systems, while it is hard to extract the target speech in multi-talker conditions without prior information on the speaker identity. It was shown…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-26 Jie Zhang , Qing-Tian Xu , Zhen-Hua Ling , Haizhou Li

Decoding speech from non-invasive brain signals, such as electroencephalography (EEG), has the potential to advance brain-computer interfaces (BCIs), with applications in silent communication and assistive technologies for individuals with…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-30 Terrance Yu-Hao Chen , Yulin Chen , Pontus Soederhaell , Sadrishya Agrawal , Kateryna Shapovalenko

We propose a brain-informed speech separation method for cochlear implants (CIs) that uses electroencephalography (EEG)-derived attention cues to guide enhancement toward the attended speaker. An attention-guided network fuses audio…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-02 Tom Gajecki , Jonas Althoff , Waldo Nogueira

This work explores the feasibility of biometric authentication using EEG signals acquired through in-ear devices, commonly referred to as ear-EEG. Traditional EEG-based biometric systems, while secure, often suffer from low usability due to…

Machine Learning · Computer Science 2025-07-18 Danilo Avola , Giancarlo Crocetti , Gian Luca Foresti , Daniele Pannone , Claudio Piciarelli , Amedeo Ranaldi

Machine learning (ML)-based analysis of electroencephalograms (EEGs) is playing an important role in advancing neurological care. However, the difficulties in automatically extracting useful metadata from clinical records hinder the…

Computation and Language · Computer Science 2021-09-14 Samarth Rawal , Yogatheesan Varatharajah

In [1,2] authors provided preliminary results for synthesizing speech from electroencephalography (EEG) features where they first predict acoustic features from EEG features and then the speech is reconstructed from the predicted acoustic…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-03 Gautam Krishna , Co Tran , Mason Carnahan , Ahmed Tewfik

Electroencephalography (EEG) signals reflect activities on certain brain areas. Effective classification of time-varying EEG signals is still challenging. First, EEG signal processing and feature engineering are time-consuming and highly…

Human-Computer Interaction · Computer Science 2019-08-27 Xiang Zhang , Lina Yao , Xianzhi Wang , Wenjie Zhang , Shuai Zhang , Yunhao Liu

Single-channel electroencephalogram (EEG) is a cost-effective, comfortable, and non-invasive method for monitoring brain activity, widely adopted by researchers, consumers, and clinicians. The increasing number and proportion of articles on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Yueyang Li , Weiming Zeng , Wenhao Dong , Di Han , Lei Chen , Hongyu Chen , Zijian Kang , Shengyu Gong , Hongjie Yan , Wai Ting Siok , Nizhuan Wang

Electromyography-to-Speech (ETS) conversion has demonstrated its potential for silent speech interfaces by generating audible speech from Electromyography (EMG) signals during silent articulations. ETS models usually consist of an EMG…

Sound · Computer Science 2024-05-15 Zhao Ren , Kevin Scheck , Qinhan Hou , Stefano van Gogh , Michael Wand , Tanja Schultz

In the past few years it has been demonstrated that electroencephalography (EEG) can be recorded from inside the ear (in-ear EEG). To open the door to low-profile earpieces as wearable brain-computer interfaces (BCIs), this work presents a…

Quantitative Methods · Quantitative Biology 2020-04-30 Ryan Kaveh , Justin Doong , Andy Zhou , Carolyn Schwendeman , Karthik Gopalan , Fred Burghardt , Ana C. Arias , Michel Maharbiz , Rikky Muller

In conventional machine learning (ML) approaches applied to electroencephalography (EEG), this is often a limited focus, isolating specific brain activities occurring across disparate temporal scales (from transient spikes in milliseconds…

Quantitative Methods · Quantitative Biology 2024-02-06 Jonathan W. Kim , Ahmed Alaa , Danilo Bernardo

Recent studies have shown that the underlying neural mechanisms of human speech comprehension can be analyzed using a match-mismatch classification of the speech stimulus and the neural response. However, such studies have been conducted…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-04 Akshara Soman , Vidhi Sinha , Sriram Ganapathy

Electroencephalography (EEG) is an non-invasive method to record the electrical activity of the brain. The EEG signals are low bandwidth and recorded from multiple electrodes simultaneously in a time synchronized manner. Typical EEG signal…

Signal Processing · Electrical Eng. & Systems 2024-12-24 Sunil Kumar Kopparapu

Electroencephalography (EEG) serves as an effective diagnostic tool for mental disorders and neurological abnormalities. Enhanced analysis and classification of EEG signals can help improve detection performance. A new approach is examined…

Signal Processing · Electrical Eng. & Systems 2020-02-11 Lubna Shibly Mokatren , Rashid Ansari , Ahmet Enis Cetin , Alex D Leow , Heide Klumpp , Olusola Ajilore , Fatos Yarman Vural