English
Related papers

Related papers: Correlation based Multi-phasal models for improved…

200 papers

An asynchronous Brain--Computer Interface (BCI) based on imagined speech is a tool that allows to control an external device or to emit a message at the moment the user desires to by decoding EEG signals of imagined speech. In order to…

Human-Computer Interaction · Computer Science 2021-05-11 Tonatiuh Hernández-Del-Toro , Carlos A. Reyes-García , Luis Villaseñor-Pineda

Decoding linguistic information from non-invasive brain signals using EEG has gained increasing research attention due to its vast applicational potential. Recently, a number of works have adopted a generative-based framework to decode…

Computation and Language · Computer Science 2024-08-12 Jinzhao Zhou , Yiqun Duan , Ziyi Zhao , Yu-Cheng Chang , Yu-Kai Wang , Thomas Do , Chin-Teng Lin

Decoding imagined speech from human brain signals is a challenging and important issue that may enable human communication via brain signals. While imagined speech can be the paradigm for silent communication via brain signals, it is always…

Human-Computer Interaction · Computer Science 2023-02-16 Seo-Hyun Lee , Young-Eun Lee , Soowon Kim , Byung-Kwan Ko , Seong-Whan Lee

We propose a brain-informed speech separation method for cochlear implants (CIs) that uses electroencephalography (EEG)-derived attention cues to guide enhancement toward the attended speaker. An attention-guided network fuses audio…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-02 Tom Gajecki , Jonas Althoff , Waldo Nogueira

In this paper we demonstrate spoken speech enhancement using electroencephalography (EEG) signals using a generative adversarial network (GAN) based model, gated recurrent unit (GRU) regression based model, temporal convolutional network…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-21 Gautam Krishna , Co Tran , Yan Han , Mason Carnahan , Ahmed H Tewfik

Electroencephalography (EEG) signals reflect activities on certain brain areas. Effective classification of time-varying EEG signals is still challenging. First, EEG signal processing and feature engineering are time-consuming and highly…

Human-Computer Interaction · Computer Science 2019-08-27 Xiang Zhang , Lina Yao , Xianzhi Wang , Wenjie Zhang , Shuai Zhang , Yunhao Liu

In this paper, we propose an end-to-end neural network (NN) based EEG-speech (NES) modeling framework, in which three network structures are developed to map imagined EEG signals to phonemes. The proposed NES models incorporate a language…

Sound · Computer Science 2017-04-04 Pengfei Sun , Jun Qin

Active speaker detection and speech enhancement have become two increasingly attractive topics in audio-visual scenario understanding. According to their respective characteristics, the scheme of independently designed architecture has been…

Sound · Computer Science 2022-07-08 Junwen Xiong , Yu Zhou , Peng Zhang , Lei Xie , Wei Huang , Yufei Zha

Electroencephalography (EEG) is a neuroimaging technique that records brain neural activity with high temporal resolution. Unlike other methods, EEG does not require prohibitively expensive equipment and can be easily set up using…

Human-Computer Interaction · Computer Science 2024-10-01 Arash Akbarinia

This study examines the effectiveness of traditional machine learning classifiers versus deep learning models for detecting the imagined speech using electroencephalogram data. Specifically, we evaluated conventional machine learning…

Machine Learning · Computer Science 2024-12-18 Byung-Kwan Ko , Jun-Young Kim , Seo-Hyun Lee

In this paper, we present an improved model for voicing silent speech, where audio is synthesized from facial electromyography (EMG) signals. To give our model greater flexibility to learn its own input features, we directly use EMG signals…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-22 David Gaddy , Dan Klein

Silent speech decoding, which performs unvocalized human speech recognition from electroencephalography/electromyography (EEG/EMG), increases accessibility for speech-impaired humans. However, data collection is difficult and performed…

Quantitative Methods · Quantitative Biology 2025-06-18 Masakazu Inoue , Motoshige Sato , Kenichi Tomeoka , Nathania Nah , Eri Hatakeyama , Kai Arulkumaran , Ilya Horiguchi , Shuntaro Sasai

Translating imagined speech from human brain activity into voice is a challenging and absorbing research issue that can provide new means of human communication via brain signals. Endeavors toward reconstructing speech from brain activity…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-19 Young-Eun Lee , Seo-Hyun Lee , Sang-Ho Kim , Seong-Whan Lee

Decoding EEG signals for imagined speech is a challenging task due to the high-dimensional nature of the data and low signal-to-noise ratio. In recent years, denoising diffusion probabilistic models (DDPMs) have emerged as promising…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-28 Soowon Kim , Young-Eun Lee , Seo-Hyun Lee , Seong-Whan Lee

Electroencephalography (EEG) serves as an effective diagnostic tool for mental disorders and neurological abnormalities. Enhanced analysis and classification of EEG signals can help improve detection performance. A new approach is examined…

Signal Processing · Electrical Eng. & Systems 2020-02-11 Lubna Shibly Mokatren , Rashid Ansari , Ahmet Enis Cetin , Alex D Leow , Heide Klumpp , Olusola Ajilore , Fatos Yarman Vural

Studies have shown that in noisy acoustic environments, providing binaural signals to the user of an assistive listening device may improve speech intelligibility and spatial awareness. This paper presents a binaural speech enhancement…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-11 Vikas Tokala , Eric Grinstein , Mike Brookes , Simon Doclo , Jesper Jensen , Patrick A. Naylor

In conventional machine learning (ML) approaches applied to electroencephalography (EEG), this is often a limited focus, isolating specific brain activities occurring across disparate temporal scales (from transient spikes in milliseconds…

Quantitative Methods · Quantitative Biology 2024-02-06 Jonathan W. Kim , Ahmed Alaa , Danilo Bernardo

This work explores the possibility of decoding Imagined Speech (IS) signals which can be used to create a new design of Human-Computer Interface (HCI). Since the underlying process generating EEG signals is unknown, various feature…

Signal Processing · Electrical Eng. & Systems 2020-11-26 Abhiram Singh , Ashwin Gumaste

To investigate how speech is processed in the brain, we can model the relation between features of a natural speech signal and the corresponding recorded electroencephalogram (EEG). Usually, linear models are used in regression tasks.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-25 Corentin Puffay , Jana Van Canneyt , Jonas Vanthornhout , Hugo Van Hamme , Tom Francart

Electroencephalography (EEG) is a useful way to implicitly monitor the users perceptual state during multimedia consumption. One of the primary challenges for the practical use of EEG-based monitoring is to achieve a satisfactory level of…

Machine Learning · Computer Science 2021-12-07 Soobeom Jang , Seong-Eun Moon , Jong-Seok Lee