English
Related papers

Related papers: Decoding Imagined Speech and Computer Control usin…

200 papers

Speech impairments due to cerebral lesions and degenerative disorders can be devastating. For humans with severe speech deficits, imagined speech in the brain-computer interface has been a promising hope for reconstructing the neural…

Neurons and Cognition · Quantitative Biology 2022-04-18 Keon-Woo Lee , Dae-Hyeok Lee , Sung-Jin Kim , Seong-Whan Lee

In this work, we present a method for learning interpretable music signal representations directly from waveform signals. Our method can be trained using unsupervised objectives and relies on the denoising auto-encoder model that uses a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-02 Stylianos I. Mimilakis , Konstantinos Drossos , Gerald Schuller

Brain-Computer Interfaces (BCIs) can decode imagined speech from neural activity. However, these systems typically require extensive training sessions where participants imaginedly repeat words, leading to mental fatigue and difficulties…

Machine Learning · Computer Science 2025-02-07 Saravanakumar Duraisamy , Mateusz Dubiel , Maurice Rekrut , Luis A. Leiva

In this study, we adopted visual motion imagery, which is a more intuitive brain-computer interface (BCI) paradigm, for decoding the intuitive user intention. We developed a 3-dimensional BCI training platform and applied it to assist the…

Signal Processing · Electrical Eng. & Systems 2020-05-19 Byoung-Hee Kwon , Ji-Hoon Jeong , Jeong-Hyun Cho , Seong-Whan Lee

Invasive brain-computer interfaces with Electrocorticography (ECoG) have shown promise for high-performance speech decoding in medical applications, but less damaging methods like intracranial stereo-electroencephalography (sEEG) remain…

Signal Processing · Electrical Eng. & Systems 2024-11-04 Hui Zheng , Hai-Teng Wang , Wei-Bang Jiang , Zhong-Tao Chen , Li He , Pei-Yang Lin , Peng-Hu Wei , Guo-Guang Zhao , Yun-Zhe Liu

Decoding visual images from brain activity has significant potential for advancing brain-computer interaction and enhancing the understanding of human perception. Recent approaches align the representation spaces of images and brain…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Nona Rajabi , Antônio H. Ribeiro , Miguel Vasco , Farzaneh Taleb , Mårten Björkman , Danica Kragic

Recently, artificial-intelligence (AI) technologies have been increasingly utilized in a wide range of real-world applications. Speech recognition is one of these practical AI tasks and is regarded as a key application for edge AI systems.…

Electroencephalogram (EEG) signals have emerged as a promising modality for biometric identification. While previous studies have explored the use of imagined speech with semantically meaningful words for subject identification, most have…

Machine Learning · Computer Science 2026-01-29 Ali Derakhshesh , Zahra Dehghanian , Reza Ebrahimpour , Hamid R. Rabiee

This thesis delves into the world of non-invasive electrophysiological brain signals like electroencephalography (EEG) and magnetoencephalography (MEG), focusing on modelling and decoding such data. The research aims to investigate what…

Signal Processing · Electrical Eng. & Systems 2025-10-30 Richard Csaky

Interpreting human neural signals to decode static speech intentions such as text or images and dynamic speech intentions such as audio or video is showing great potential as an innovative communication tool. Human communication accompanies…

Artificial Intelligence · Computer Science 2025-01-22 Ji-Ha Park , Seo-Hyun Lee , Soowon Kim , Seong-Whan Lee

In a hybrid speech model, both voiced and unvoiced components can coexist in a segment. Often, the voiced speech is regarded as the deterministic component, and the unvoiced speech and additive noise are the stochastic components.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-05 Alfredo Esquivel Jaramillo , Jesper Kjær Nielsen , Mads Græsbøll Christensen

Deciphering natural language from brain activity through non-invasive devices remains a formidable challenge. Previous non-invasive decoders either require multiple experiments with identical stimuli to pinpoint cortical regions and enhance…

Computation and Language · Computer Science 2024-03-20 Cenyuan Zhang , Xiaoqing Zheng , Ruicheng Yin , Shujie Geng , Jianhan Xu , Xuan Gao , Changze Lv , Zixuan Ling , Xuanjing Huang , Miao Cao , Jianfeng Feng

Intracranial language brain-computer interfaces (BCIs) are a promising route for restoring communication in people with severe motor and speech impairments, but clinical translation remains limited by fragmented evidence and unresolved…

Neurons and Cognition · Quantitative Biology 2026-03-17 Dongyi He , Wai Ting Siok , Nizhuan Wang

Decoding EEG signals for imagined speech is a challenging task due to the high-dimensional nature of the data and low signal-to-noise ratio. In recent years, denoising diffusion probabilistic models (DDPMs) have emerged as promising…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-28 Soowon Kim , Young-Eun Lee , Seo-Hyun Lee , Seong-Whan Lee

We propose an approach for cognitive coding of speech by unsupervised extraction of contextual representations in two hierarchical levels of abstraction. Speech attributes such as phoneme identity that last one hundred milliseconds or less…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-11 Reza Lotfidereshgi , Philippe Gournay

The translation of brain dynamics into natural language is pivotal for brain-computer interfaces (BCIs). With the swift advancement of large language models, such as ChatGPT, the need to bridge the gap between the brain and languages…

Human-Computer Interaction · Computer Science 2024-01-04 Yiqun Duan , Jinzhao Zhou , Zhen Wang , Yu-Kai Wang , Chin-Teng Lin

Brain computer interface (BCI) has been popular as a key approach to monitor our brains recent year. Mental states monitoring is one of the most important BCI applications and becomes increasingly accessible. However, the mental state…

Signal Processing · Electrical Eng. & Systems 2019-11-14 Dongdong Zhang , Dong Cao , Haibo Chen

Recent work on intracranial brain-machine interfaces has demonstrated that spoken speech can be decoded with high accuracy, essentially by treating the problem as an instance of supervised learning and training deep neural networks to map…

Neurons and Cognition · Quantitative Biology 2024-05-30 Brian A. Yuan , Joseph G. Makin

Decoding linguistic information from non-invasive brain signals using EEG has gained increasing research attention due to its vast applicational potential. Recently, a number of works have adopted a generative-based framework to decode…

Computation and Language · Computer Science 2024-08-12 Jinzhao Zhou , Yiqun Duan , Ziyi Zhao , Yu-Cheng Chang , Yu-Kai Wang , Thomas Do , Chin-Teng Lin

Recent advances in brain-computer interface technology have shown the potential of imagined speech and visual imagery as a robust paradigm for intuitive brain-computer interface communication. However, the internal dynamics of the two…

Human-Computer Interaction · Computer Science 2020-12-15 Seo-Hyun Lee , Minji Lee , Seong-Whan Lee