English
Related papers

Related papers: A Silent Speech Decoding System from EEG and EMG w…

200 papers

Decoding speech from brain activity is a long-awaited goal in both healthcare and neuroscience. Invasive devices have recently led to major milestones in that regard: deep learning algorithms trained on intracranial recordings now start to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-06 Alexandre Défossez , Charlotte Caucheteux , Jérémy Rapin , Ori Kabeli , Jean-Rémi King

Brain-computer interface (BCI) speech decoding has emerged as a promising tool for assisting individuals with speech impairments. In this context, the integration of electroencephalography (EEG) and electromyography (EMG) signals offers…

Sound · Computer Science 2025-11-17 Yifan Zhuang , Calvin Huang , Zepeng Yu , Yongjie Zou , Jiawei Ju

The performance of automatic speech recognition systems(ASR) degrades in the presence of noisy speech. This paper demonstrates that using electroencephalography (EEG) can help automatic speech recognition systems overcome performance loss…

Machine Learning · Computer Science 2019-03-05 Gautam Krishna , Co Tran , Jianguo Yu , Ahmed H Tewfik

This thesis delves into the world of non-invasive electrophysiological brain signals like electroencephalography (EEG) and magnetoencephalography (MEG), focusing on modelling and decoding such data. The research aims to investigate what…

Signal Processing · Electrical Eng. & Systems 2025-10-30 Richard Csaky

Neuro-steered speaker extraction aims to extract the listener's brain-attended speech signal from a multi-talker speech signal, in which the attention is derived from the cortical activity. This activity is usually recorded using…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-13 Zexu Pan , Gordon Wichern , Francois G. Germain , Sameer Khurana , Jonathan Le Roux

Electroencephalography (EEG) serves as an effective diagnostic tool for mental disorders and neurological abnormalities. Enhanced analysis and classification of EEG signals can help improve detection performance. A new approach is examined…

Signal Processing · Electrical Eng. & Systems 2020-02-11 Lubna Shibly Mokatren , Rashid Ansari , Ahmet Enis Cetin , Alex D Leow , Heide Klumpp , Olusola Ajilore , Fatos Yarman Vural

We present a wearable, fully-dry, and ultra-low power EMG system for silent speech recognition, integrated into a textile neckband to enable comfortable, non-intrusive use. The system features 14 fully-differential EMG channels and is based…

Systems and Control · Electrical Eng. & Systems 2025-09-29 Fiona Meier , Giusy Spacone , Sebastian Frey , Luca Benini , Andrea Cossettini

In conventional machine learning (ML) approaches applied to electroencephalography (EEG), this is often a limited focus, isolating specific brain activities occurring across disparate temporal scales (from transient spikes in milliseconds…

Quantitative Methods · Quantitative Biology 2024-02-06 Jonathan W. Kim , Ahmed Alaa , Danilo Bernardo

Objective: EEG-based methods can predict speech intelligibility, but their accuracy and robustness lag behind behavioral tests, which typically show test-retest differences under 1 dB. We introduce the multi-decoder method to predict speech…

Signal Processing · Electrical Eng. & Systems 2026-02-04 Rien Sonck , Bernd Accou , Tom Francart , Jonas Vanthornhout

Recent studies have shown that the underlying neural mechanisms of human speech comprehension can be analyzed using a match-mismatch classification of the speech stimulus and the neural response. However, such studies have been conducted…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-04 Akshara Soman , Vidhi Sinha , Sriram Ganapathy

This paper introduces a novel algorithm designed for speech synthesis from neural activity recordings obtained using invasive electroencephalography (EEG) techniques. The proposed system offers a promising communication solution for…

This paper presents EffortNet, a novel deep learning framework for decoding individual listening effort from electroencephalography (EEG) during speech comprehension. Listening effort represents a significant challenge in speech-hearing…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-22 Ching-Chih Sung , Cheng-Hung Hsin , Yu-Anne Shiah , Bo-Jyun Lin , Yi-Xuan Lai , Chia-Ying Lee , Yu-Te Wang , Borchin Su , Yu Tsao

In this paper, we demonstrate speech recognition using electroencephalography (EEG) signals obtained using dry electrodes on a limited English vocabulary consisting of three vowels and one word using a deep learning model. We demonstrate a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-19 Gautam Krishna , Co Tran , Mason Carnahan , Morgan M Hagood , Ahmed H Tewfik

Dysarthria impairs motor control of speech, often resulting in reduced intelligibility and frequent misarticulations. Although interest in brain-computer interface technologies is growing, electroencephalogram (EEG)-based communication…

Artificial Intelligence · Computer Science 2025-12-15 Ha-Na Jo , Jung-Sun Lee , Eunyeong Ko

Brain decoding has emerged as a rapidly advancing and extensively utilized technique within neuroscience. This paper centers on the application of raw electroencephalogram (EEG) signals for decoding human brain activity, offering a more…

Machine Learning · Computer Science 2025-02-04 Zenon Lamprou , Yashar Moshfeghi

The aim of the study is to investigate the complex mechanisms of speech perception and ultimately decode the electrical changes in the brain accruing while listening to speech. We attempt to decode heard speech from intracranial…

Human-Computer Interaction · Computer Science 2025-01-28 Milán András Fodor , Tamás Gábor Csapó , Frigyes Viktor Arthur

Speech-related Brain Computer Interfaces (BCI) aim primarily at finding an alternative vocal communication pathway for people with speaking disabilities. As a step towards full decoding of imagined speech from active thoughts, we present a…

Machine Learning · Computer Science 2019-04-10 Pramit Saha , Muhammad Abdul-Mageed , Sidney Fels

Decoding the speech signal that a person is listening to from the human brain via electroencephalography (EEG) can help us understand how our auditory system works. Linear models have been used to reconstruct the EEG from speech or vice…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-18 Mohammad Jalilpour Monesi , Bernd Accou , Tom Francart , Hugo Van Hamme

Decoding imagined speech from non-invasive brain recordings is challenging because imagined datasets are scarce and difficult to align temporally across subjects and sessions In this work, we propose a new approach to the decoding of…

Machine Learning · Computer Science 2026-05-11 Maryam Maghsoudi , Shihab Shamma

Electroencephalography (EEG) decoding is a challenging task due to the limited availability of labelled data. While transfer learning is a promising technique to address this challenge, it assumes that transferable data domains and task are…

Signal Processing · Electrical Eng. & Systems 2023-08-07 Bruno Aristimunha , Raphael Y. de Camargo , Walter H. Lopez Pinaya , Sylvain Chevallier , Alexandre Gramfort , Cedric Rommel