English
Related papers

Related papers: Decoding Imagined Speech and Computer Control usin…

200 papers

Recognition of speech, and in particular the ability to generalize and learn from small sets of labelled examples like humans do, depends on an appropriate representation of the acoustic input. We formulate the problem of finding robust…

Restoring speech communication from neural signals is a central goal of brain-computer interface research, yet EEG-based speech reconstruction remains challenging due to limited spatial resolution, susceptibility to noise, and the absence…

Signal Processing · Electrical Eng. & Systems 2025-12-30 Hanbeot Park , Yunjeong Cho , Hunhee Kim

In this work, we propose a new mathematical vocoder algorithm(modified spectral inversion) that generates a waveform from acoustic features without phase estimation. The main benefit of using our proposed method is that it excludes the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-17 Hyun Gon Ryu , Jeong-Hoon Kim , Simon See

Brain-computer interfaces have promising medical and scientific applications for aiding speech and studying the brain. In this work, we propose an information-based evaluation metric for brain-to-text decoders. Using this metric, we examine…

Computation and Language · Computer Science 2024-05-24 Richard Antonello , Nihita Sarma , Jerry Tang , Jiaru Song , Alexander Huth

Brain decoding techniques are essential for understanding the neurocognitive system. Although numerous methods have been introduced in this field, accurately aligning complex external stimuli with brain activities remains a formidable…

Neurons and Cognition · Quantitative Biology 2024-07-16 Heng Huang , Lin Zhao , Zihao Wu , Xiaowei Yu , Jing Zhang , Xintao Hu , Dajiang Zhu , Tianming Liu

We propose a brain-informed speech separation method for cochlear implants (CIs) that uses electroencephalography (EEG)-derived attention cues to guide enhancement toward the attended speaker. An attention-guided network fuses audio…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-02 Tom Gajecki , Jonas Althoff , Waldo Nogueira

Sparse coding is an unsupervised learning algorithm that learns a succinct high-level representation of the inputs given only unlabeled data; it represents each input as a sparse linear combination of a set of basis functions. Originally…

Machine Learning · Computer Science 2012-06-26 Roger Grosse , Rajat Raina , Helen Kwong , Andrew Y. Ng

Individuals with aphasia experience severe difficulty in real-time verbal communication, while most imagined speech decoding approaches remain limited to offline analysis or computationally demanding models. To address this limitation, we…

Artificial Intelligence · Computer Science 2026-01-16 Eunyeong Ko , Soowon Kim , Ha-Na Jo

Decoding language from neural signals holds considerable theoretical and practical importance. Previous research has indicated the feasibility of decoding text or speech from invasive neural signals. However, when using non-invasive neural…

Human-Computer Interaction · Computer Science 2023-09-15 Bo Wang , Xiran Xu , Longxiang Zhang , Boda Xiao , Xihong Wu , Jing Chen

In low-bitrate speech coding, end-to-end speech coding networks aim to learn compact yet expressive features and a powerful decoder in a single network. A challenging problem as such results in unwelcome complexity increase and inferior…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-16 Haici Yang , Inseon Jang , Minje Kim

Brain decoding is a field of computational neuroscience that uses measurable brain activity to infer mental states or internal representations of perceptual inputs. Therefore, we propose a novel approach to brain decoding that also relies…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Matteo Ferrante , Tommaso Boccato , Nicola Toschi

Generative AI has recently propelled the decoding of images from brain activity. How do these approaches scale with the amount and type of neural recordings? Here, we systematically compare image decoding from four types of non-invasive…

Image and Video Processing · Electrical Eng. & Systems 2025-01-29 Hubert Banville , Yohann Benchetrit , Stéphane d'Ascoli , Jérémy Rapin , Jean-Rémi King

Speech brain-computer interfaces (BCIs) aim to restore communication for people with paralysis by translating neural activity into text. Most systems use cascaded frameworks that decode phonemes before assembling sentences with an n-gram…

Brain-computer interface (BCI) facilitates direct communication between the human brain and external systems by utilizing brain signals, eliminating the need for conventional communication methods such as speaking, writing, or typing.…

Multimedia · Computer Science 2024-07-23 Linfeng Zheng , Peilin Chen , Shiqi Wang

For reliable transmission across a noisy communication channel, classical results from information theory show that it is asymptotically optimal to separate out the source and channel coding processes. However, this decomposition can fall…

Machine Learning · Computer Science 2019-05-15 Kristy Choi , Kedar Tatwawadi , Aditya Grover , Tsachy Weissman , Stefano Ermon

Brain-computer interface (BCI) technology establishes a direct communication pathway between the brain and external devices. Current visual BCI systems suffer from insufficient information transfer rates (ITRs) for practical use. Spatial…

Human-Computer Interaction · Computer Science 2025-07-24 Gege Ming , Weihua Pei , Sen Tian , Xiaogang Chen , Xiaorong Gao , Yijun Wang

In the past five years, the use of generative and foundational AI systems has greatly improved the decoding of brain activity. Visual perception, in particular, can now be decoded from functional Magnetic Resonance Imaging (fMRI) with…

Image and Video Processing · Electrical Eng. & Systems 2024-03-15 Yohann Benchetrit , Hubert Banville , Jean-Rémi King

We propose deep learning based coded waveform design for integrated sensing and communication (ISAC) with orthogonal frequency-division multiplexing (OFDM). Our goal is to design a coded waveform capable of delivering accurate target…

Signal Processing · Electrical Eng. & Systems 2025-10-01 Chenghong Bian , Yumeng Zhang , Meng Hua , Kaitao Meng , Deniz Gunduz

A Brain Computer Interface (BCI) connects the human brain to the outside world, providing a direct communication channel. Electroencephalography (EEG) signals are commonly used in BCIs to reflect cognitive patterns related to motor function…

Machine Learning · Computer Science 2025-11-19 Abdullah Al Shiam , Md. Khademul Islam Molla , Abu Saleh Musa Miah , Md. Abdus Samad Kamal

When brain activity is translated into commands for real applications, the potential for human capacities augmentation is promising. In this paper, EMD is used to decompose EEG signals during Imagined Speech in order to use it as a…

Neurons and Cognition · Quantitative Biology 2018-09-19 Luis Alfredo Moctezuma , Marta Molinas