English
Related papers

Related papers: Brain-to-Text Decoding: A Non-invasive Approach vi…

200 papers

Text generating capabilities have undergone a substantial transformation with the introduction of large language models (LLMs). Electroencephalography (EEG)-based text production is still difficult, though, because it requires a lot of data…

Human-Computer Interaction · Computer Science 2025-11-18 Khushiyant

Brain-Computer Interfaces (BCI) help patients with faltering communication abilities due to neurodegenerative diseases produce text or speech output by direct neural processing. However, practical implementation of such a system has proven…

Human-Computer Interaction · Computer Science 2019-07-10 Janaki Sheth , Ariel Tankus , Michelle Tran , Nader Pouratian , Itzhak Fried , William Speier

Deep learning techniques have revolutionized the field of machine learning and were recently successfully applied to various classification problems in noninvasive electroencephalography (EEG). However, these methods were so far only rarely…

Electroencephalography (EEG) decoding is a challenging task due to the limited availability of labelled data. While transfer learning is a promising technique to address this challenge, it assumes that transferable data domains and task are…

Signal Processing · Electrical Eng. & Systems 2023-08-07 Bruno Aristimunha , Raphael Y. de Camargo , Walter H. Lopez Pinaya , Sylvain Chevallier , Alexandre Gramfort , Cedric Rommel

Covert speech involves imagining speaking without audible sound or any movements. Decoding covert speech from electroencephalogram (EEG) is challenging due to a limited understanding of neural pronunciation mapping and the low…

Understanding how the brain responds to sensory inputs is challenging: brain recordings are partial, noisy, and high dimensional; they vary across sessions and subjects and they capture highly nonlinear dynamics. These challenges have led…

Neurons and Cognition · Quantitative Biology 2022-10-03 Omar Chehab , Alexandre Defossez , Jean-Christophe Loiseau , Alexandre Gramfort , Jean-Remi King

Recent work on intracranial brain-machine interfaces has demonstrated that spoken speech can be decoded with high accuracy, essentially by treating the problem as an instance of supervised learning and training deep neural networks to map…

Neurons and Cognition · Quantitative Biology 2024-05-30 Brian A. Yuan , Joseph G. Makin

Data-efficient neural decoding is a central challenge for speech brain-computer interfaces. We present the first demonstration of transfer learning and cross-task decoding for MEG-based speech models spanning perception and production. We…

Machine Learning · Computer Science 2026-02-23 Xabier de Zuazo , Vincenzo Verbeni , Eva Navas , Ibon Saratxaga , Mathieu Bourguignon , Nicola Molinaro

Speech neuroprostheses aim to restore communication for people with severe paralysis by decoding speech directly from neural activity. To accelerate algorithmic progress, a recent benchmark released intracranial recordings from a paralyzed…

Human-Computer Interaction · Computer Science 2025-11-04 Ebrahim Feghhi , Shreyas Kaasyap , Nima Hadidi , Jonathan C. Kao

We explore surface electromyography (sEMG) as a non-invasive input modality for mapping muscle activity to keyboard inputs, targeting immersive typing in next-generation human-computer interaction (HCI). This is especially relevant for…

Human-Computer Interaction · Computer Science 2025-11-25 Kunwoo Lee , Dhivya Sreedhar , Pushkar Saraf , Chaeeun Lee , Kateryna Shapovalenko

We study the problem of inferring user intent from noninvasive electroencephalography (EEG) to restore communication for people with severe speech and physical impairments (SSPI). The focus of this work is improving the estimation of…

Signal Processing · Electrical Eng. & Systems 2022-11-07 Niklas Smedemark-Margulies , Basak Celik , Tales Imbiriba , Aziz Kocanaogullari , Deniz Erdogmus

Current high-performing intracortical speech neuroprostheses achieve low word error rates but typically rely on external language models during inference, increasing memory, computation, and latency. In this work, we investigate whether…

Computation and Language · Computer Science 2026-05-26 Owais Mujtaba Khanday , Jose A. Gonzalez-Lopez , Marc Ouellet , Alberto Galdon , Gonzalo Olivares Granados

Decoding continuous language from neural signals remains a significant challenge in the intersection of neuroscience and artificial intelligence. We introduce Neuro2Semantic, a novel framework that reconstructs the semantic content of…

Computation and Language · Computer Science 2025-06-03 Siavash Shams , Richard Antonello , Gavin Mischler , Stephan Bickel , Ashesh Mehta , Nima Mesgarani

The translation of brain dynamics into natural language is pivotal for brain-computer interfaces (BCIs). With the swift advancement of large language models, such as ChatGPT, the need to bridge the gap between the brain and languages…

Human-Computer Interaction · Computer Science 2024-01-04 Yiqun Duan , Jinzhao Zhou , Zhen Wang , Yu-Kai Wang , Chin-Teng Lin

Surface electromyography (sEMG) provides a direct neural interface for decoding muscle activity and offers a promising foundation for keyboard-free text input in wearable and mixed-reality systems. Previous sEMG-to-text studies mainly…

Machine Learning · Computer Science 2026-01-07 Meghna Roy Chowdhury , Shreyas Sen , Yi Ding

Decoding natural language from non-invasive electroencephalography (EEG) remains fundamentally limited by low signal-to-noise ratio and restricted information bandwidth. This raises a fundamental question regarding whether sentence-level…

Computation and Language · Computer Science 2026-04-21 Xiaoli Yang , Huiyuan Tian , Yurui Li , Jianyu Zhang , Shijian Li , Gang Pan

Decoding continuous speech from intracortical recordings is a central challenge for brain-computer interfaces (BCIs), with transformative potential for individuals with conditions that impair their ability to speak. While recent…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-17 Tommaso Boccato , Michal Olak , Matteo Ferrante

The conversion of brain activity into text using electroencephalography (EEG) has gained significant traction in recent years. Many researchers are working to develop new models to decode EEG signals into text form. Although this area has…

Signal Processing · Electrical Eng. & Systems 2024-09-23 Saydul Akbar Murad , Nick Rahimi

Brain computer interface (BCI) has been popular as a key approach to monitor our brains recent year. Mental states monitoring is one of the most important BCI applications and becomes increasingly accessible. However, the mental state…

Signal Processing · Electrical Eng. & Systems 2019-11-14 Dongdong Zhang , Dong Cao , Haibo Chen

We present a novel approach to EEG decoding for non-invasive brain machine interfaces (BMIs), with a focus on motor-behavior classification. While conventional convolutional architectures such as EEGNet and DeepConvNet are effective in…

Machine Learning · Computer Science 2025-12-09 Tian Lan