English
Related papers

Related papers: MEGState: Phoneme Decoding from Magnetoencephalogr…

200 papers

Covert speech involves imagining speaking without audible sound or any movements. Decoding covert speech from electroencephalogram (EEG) is challenging due to a limited understanding of neural pronunciation mapping and the low…

Deep learning has recently enabled the decoding of language from the neural activity of a few participants with electrodes implanted inside their brain. However, reliably decoding words from non-invasive recordings remains an open…

Signal Processing · Electrical Eng. & Systems 2024-12-25 Stéphane d'Ascoli , Corentin Bel , Jérémy Rapin , Hubert Banville , Yohann Benchetrit , Christophe Pallier , Jean-Rémi King

Decoding emotion from brain activity could unlock a deeper understanding of the human experience. While a number of existing datasets align brain data with speech and with speech transcripts, no datasets have annotated brain data with…

Human-Computer Interaction · Computer Science 2026-01-27 Brian Liu , Oiwi Parker Jones

Decoding linguistic information from non-invasive brain signals using EEG has gained increasing research attention due to its vast applicational potential. Recently, a number of works have adopted a generative-based framework to decode…

Computation and Language · Computer Science 2024-08-12 Jinzhao Zhou , Yiqun Duan , Ziyi Zhao , Yu-Cheng Chang , Yu-Kai Wang , Thomas Do , Chin-Teng Lin

Speech decoding from EEG signals is a challenging task, where brain activity is modeled to estimate salient characteristics of acoustic stimuli. We propose FESDE, a novel framework for Fully-End-to-end Speech Decoding from EEG signals. Our…

Signal Processing · Electrical Eng. & Systems 2024-06-14 Jihwan Lee , Aditya Kommineni , Tiantian Feng , Kleanthis Avramidis , Xuan Shi , Sudarsana Kadiri , Shrikanth Narayanan

Modelling the complex spatiotemporal patterns of large-scale brain dynamics is crucial for neuroscience, but traditional methods fail to capture the rich structure in modalities such as magnetoencephalography (MEG). Recent advances in deep…

Machine Learning · Computer Science 2025-10-22 Rukuang Huang , Sungjun Cho , Chetan Gohil , Oiwi Parker Jones , Mark Woolrich

Non-invasive brainwave decoding is usually done using Magneto/Electroencephalography (MEG/EEG) sensor measurements as inputs. This makes combining datasets and building models with inductive biases difficult as most datasets use different…

Signal Processing · Electrical Eng. & Systems 2024-10-29 Yonatan Gideoni , Ryan Charles Timms , Oiwi Parker Jones

Current EEG/MEG-to-text decoding systems suffer from three key limitations: (1) reliance on teacher-forcing methods, which compromises robustness during inference, (2) sensitivity to session-specific noise, hindering generalization across…

Artificial Intelligence · Computer Science 2025-08-06 Jilong Li , Zhenxi Song , Jiaqi Wang , Meishan Zhang , Honghai Liu , Min Zhang , Zhiguo Zhang

Magnetoencephalography (MEG) conventionally operates within high-performance magnetic shields due to the extremely weak magnetic field signals from the measured objects and the narrow dynamic range of the magnetic sensors employed for…

Medical Physics · Physics 2024-03-20 Yosuke Ito , Hiroyuki Ueda , Takenori Oida , Takahiro Moriya , Akinori Saito , Motohiro Suyama

Neuroimaging techniques have shown to be useful when studying the brain's activity. This paper uses Magnetoencephalography (MEG) data, provided by the Human Connectome Project (HCP), in combination with various deep artificial neural…

Machine Learning · Computer Science 2020-07-07 Ismail Alaoui Abdellaoui , Jesus Garcia Fernandez , Caner Sahinli , Siamak Mehrkanoon

As an emerging paradigm of brain-computer interfaces (BCIs), speech BCI has the potential to directly reflect auditory perception and thoughts, offering a promising communication alternative for patients with aphasia. Chinese is one of the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-17 Zhihong Jia , Hongbin Wang , Yuanzhong Shen , Feng Hu , Jiayu An , Kai Shu , Dongrui Wu

The electroencephalogram (EEG) offers a non-invasive means by which a listener's auditory system may be monitored during continuous speech perception. Reliable auditory-EEG decoders could facilitate the objective diagnosis of hearing…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-18 Mike Thornton , Danilo Mandic , Tobias Reichenbach

Current non-invasive neuroimaging techniques trade off between spatial resolution and temporal resolution. While magnetoencephalography (MEG) can capture rapid neural dynamics and functional magnetic resonance imaging (fMRI) can spatially…

Neurons and Cognition · Quantitative Biology 2025-10-13 Beige Jerry Jin , Leila Wehbe

Dementia (DEM) is a growing global health challenge, underscoring the need for early and accurate diagnosis. Electroencephalography (EEG) provides a non-invasive window into brain activity, but conventional methods struggle to capture its…

Signal Processing · Electrical Eng. & Systems 2025-09-04 Mohammad Mehedi Hasan , Pedro G. Lind , Hernando Ombao , Anis Yazidi , Rabindra Khadka

Decoding speech from brain activity is a long-awaited goal in both healthcare and neuroscience. Invasive devices have recently led to major milestones in that regard: deep learning algorithms trained on intracranial recordings now start to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-06 Alexandre Défossez , Charlotte Caucheteux , Jérémy Rapin , Ori Kabeli , Jean-Rémi King

Speech Neuroprostheses have the potential to enable communication for people with dysarthria or anarthria. Recent advances have demonstrated high-quality text decoding and speech synthesis from electrocorticographic grids placed on the…

During speech perception, a listener's electroencephalogram (EEG) reflects acoustic-level processing as well as higher-level cognitive factors such as speech comprehension and attention. However, decoding speech from EEG recordings is…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Mike Thornton , Danilo Mandic , Tobias Reichenbach

Deciphering the intricacies of the human brain has captivated curiosity for centuries. Recent strides in Brain-Computer Interface (BCI) technology, particularly using motor imagery, have restored motor functions such as reaching, grasping,…

Computation and Language · Computer Science 2024-05-06 Hanwen Liu , Daniel Hajialigol , Benny Antony , Aiguo Han , Xuan Wang

Silent speech decoding, which performs unvocalized human speech recognition from electroencephalography/electromyography (EEG/EMG), increases accessibility for speech-impaired humans. However, data collection is difficult and performed…

Quantitative Methods · Quantitative Biology 2025-06-18 Masakazu Inoue , Motoshige Sato , Kenichi Tomeoka , Nathania Nah , Eri Hatakeyama , Kai Arulkumaran , Ilya Horiguchi , Shuntaro Sasai

Motor Imagery (MI) is an emerging Brain-Computer Interface (BCI) paradigm where a person imagines body movements without physical action. By decoding scalp-recorded electroencephalography (EEG) signals, BCIs establish direct communication…

Human-Computer Interaction · Computer Science 2026-04-14 Jiani Cao , Kun Wang , Yang Liu , Zhenjiang Li