English
Related papers

Related papers: A Silent Speech Decoding System from EEG and EMG w…

200 papers

The use of Automatic speech recognition (ASR) interfaces have become increasingly popular in daily life for use in interaction and control of electronic devices. The interfaces currently being used are not feasible for a variety of users…

Signal Processing · Electrical Eng. & Systems 2022-03-30 Ayush Tripathi

Electroencephalogram (EEG) decoding aims to identify the perceptual, semantic, and cognitive content of neural processing based on non-invasively measured brain activity. Traditional EEG decoding methods have achieved moderate success when…

Signal Processing · Electrical Eng. & Systems 2022-03-09 Xun Chen , Chang Li , Aiping Liu , Martin J. McKeown , Ruobing Qian , Z. Jane Wang

In this paper we demonstrate that performance of a speaker verification system can be improved by concatenating electroencephalography (EEG) signal features with speech signal features or only using EEG signal features. We use…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-11 Yan Han , Gautam Krishna , Co Tran , Mason Carnahan , Ahmed H Tewfik

Relating speech to EEG holds considerable importance but is challenging. In this study, a deep convolutional network was employed to extract spatiotemporal features from EEG data. Self-supervised speech representation and contextual text…

Signal Processing · Electrical Eng. & Systems 2024-02-02 Bo Wang , Xiran Xu , Zechen Zhang , Haolin Zhu , YuJie Yan , Xihong Wu , Jing Chen

Restoring speech communication from neural signals is a central goal of brain-computer interface research, yet EEG-based speech reconstruction remains challenging due to limited spatial resolution, susceptibility to noise, and the absence…

Signal Processing · Electrical Eng. & Systems 2025-12-30 Hanbeot Park , Yunjeong Cho , Hunhee Kim

Electromyography-to-Speech (ETS) conversion has demonstrated its potential for silent speech interfaces by generating audible speech from Electromyography (EMG) signals during silent articulations. ETS models usually consist of an EMG…

Sound · Computer Science 2024-05-15 Zhao Ren , Kevin Scheck , Qinhan Hou , Stefano van Gogh , Michael Wand , Tanja Schultz

Unlike conventional data such as natural images, audio and speech, raw multi-channel Electroencephalogram (EEG) data are difficult to interpret. Modern deep neural networks have shown promising results in EEG studies, however finding robust…

Signal Processing · Electrical Eng. & Systems 2022-06-22 Nikesh Bajaj , Jesús Requena Carrión , Francesco Bellotti

Substantial increase in the use of Electronic Health Records (EHRs) has opened new frontiers for predictive healthcare. However, while EHR systems are nearly ubiquitous, they lack a unified code system for representing medical concepts.…

Machine Learning · Computer Science 2022-03-21 Kyunghoon Hur , Jiyoung Lee , Jungwoo Oh , Wesley Price , Young-Hak Kim , Edward Choi

In this paper we demonstrate that it is possible to generate more meaningful electroencephalography (EEG) features from raw EEG features using generative adversarial networks (GAN) to improve the performance of EEG based continuous speech…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-03 Gautam Krishna , Co Tran , Mason Carnahan , Ahmed Tewfik

Electroencephalography (EEG) classification techniques have been widely studied for human behavior and emotion recognition tasks. But it is still a challenging issue since the data may vary from subject to subject, may change over time for…

Signal Processing · Electrical Eng. & Systems 2020-09-14 Dashan Gao , Ce Ju , Xiguang Wei , Yang Liu , Tianjian Chen , Qiang Yang

Decoding the directional focus of an attended speaker from listeners' electroencephalogram (EEG) signals is essential for developing brain-computer interfaces to improve the quality of life for individuals with hearing impairment. Previous…

Sound · Computer Science 2025-10-23 Yuanming Zhang , Jing Lu , Fei Chen , Haoliang Du , Xia Gao , Zhibin Lin

In recent years, brain-computer interfaces have made advances in decoding various motor-related tasks, including gesture recognition and movement classification, utilizing electroencephalogram (EEG) data. These developments are fundamental…

Machine Learning · Computer Science 2024-11-15 Jun-Young Kim , Deok-Seon Kim , Seo-Hyun Lee

Decoding inner speech from the brain signal via hybridisation of fMRI and EEG data is explored to investigate the performance benefits over unimodal models. Two different bimodal fusion approaches are examined: concatenation of probability…

Transformers are groundbreaking architectures that have changed a flow of deep learning, and many high-performance models are developing based on transformer architectures. Transformers implemented only with attention with encoder-decoder…

Human-Computer Interaction · Computer Science 2021-12-20 Young-Eun Lee , Seo-Hyun Lee

Objective: Currently, only behavioral speech understanding tests are available, which require active participation of the person being tested. As this is infeasible for certain populations, an objective measure of speech intelligibility is…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-30 Bernd Accou , Mohammad Jalilpour Monesi , Hugo Van hamme , Tom Francart

This paper presents a novel wireless silent speech interface (SSI) integrating multi-channel textile-based EMG electrodes into headphone earmuff for real-time, hands-free communication. Unlike conventional patch-based EMG systems, which…

Selective auditory attention decoding aims to identify the speaker of interest from listeners' neural signals, such as electroencephalography (EEG), in the presence of multiple concurrent speakers. Most existing methods operate at the…

Signal Processing · Electrical Eng. & Systems 2026-02-17 Yuanyuan Yao , Simon Geirnaert , Tinne Tuytelaars , Alexander Bertrand

Electroencephalography (EEG) plays a crucial role in brain-computer interfaces (BCIs) and neurological diagnostics, but its real-world deployment faces challenges due to noise artifacts, missing data, and high annotation costs. We introduce…

Signal Processing · Electrical Eng. & Systems 2025-10-24 Meghna Roy Chowdhury , Yi Ding , Shreyas Sen

Until recently, human behavioral data from reading has mainly been of interest to researchers to understand human cognition. However, these human language processing signals can also be beneficial in machine learning-based natural language…

Computation and Language · Computer Science 2021-08-11 Nora Hollenstein , Cedric Renggli , Benjamin Glaus , Maria Barrett , Marius Troendle , Nicolas Langer , Ce Zhang

Current assistive hearing devices, such as hearing aids and cochlear implants, lack the ability to adapt to the listener's focus of auditory attention, limiting their effectiveness in complex acoustic environments like cocktail party…

Signal Processing · Electrical Eng. & Systems 2025-10-29 Simon Geirnaert , Simon L. Kappel , Preben Kidmose