English
Related papers

Related papers: BrainECHO: Semantic Brain Signal Decoding through …

200 papers

Decoding natural language from non-invasive EEG signals is a promising yet challenging task. However, current state-of-the-art models remain constrained by three fundamental limitations: Semantic Bias (mode collapse into generic templates),…

Computation and Language · Computer Science 2026-04-06 Yuchen Wang , Haonan Wang , Yu Guo , Honglong Yang , Xiaomeng Li

Recent advances in electroencephalography (EEG) foundation models, which capture transferable EEG representations, have greatly accelerated the development of brain-computer interfaces (BCIs). However, existing approaches still struggle to…

Machine Learning · Computer Science 2026-03-24 Muyun Jiang , Shuailei Zhang , Zhenjie Yang , Mengjun Wu , Weibang Jiang , Zhiwei Guo , Wei Zhang , Rui Liu , Shangen Zhang , Yong Li , Yi Ding , Cuntai Guan

Can we directly visualize what we imagine in our brain together with what we describe? The inherent nature of human perception reveals that, when we think, our body can combine language description and build a vivid picture in our brain.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Ling Wang , Chen Wu , Lin Wang

Understanding the neural mechanisms behind auditory and linguistic processing is key to advancing cognitive neuroscience. In this study, we use Magnetoencephalography (MEG) data to analyze brain responses to spoken language stimuli. We…

Neurons and Cognition · Quantitative Biology 2025-01-08 Matteo Ciferri , Matteo Ferrante , Nicola Toschi

We propose EEG2TEXT-CN, which, to the best of our knowledge, represents one of the earliest open-vocabulary EEG-to-text generation frameworks tailored for Chinese. Built on a biologically grounded EEG encoder (NICE-EEG) and a compact…

Computation and Language · Computer Science 2025-07-09 Jacky Tai-Yu Lu , Jung Chiang , Chi-Sheng Chen , Anna Nai-Yun Tung , Hsiang Wei Hu , Yuan Chiao Cheng

Advances in neuroscience and artificial intelligence have enabled preliminary decoding of brain activity. However, despite the progress, the interpretability of neural representations remains limited. A significant challenge arises from the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Hasib Aslam , Muhammad Talal Faiz , Muhammad Imran Malik

Decoding language from neural signals holds considerable theoretical and practical importance. Previous research has indicated the feasibility of decoding text or speech from invasive neural signals. However, when using non-invasive neural…

Human-Computer Interaction · Computer Science 2023-09-15 Bo Wang , Xiran Xu , Longxiang Zhang , Boda Xiao , Xihong Wu , Jing Chen

Electroencephalography (EEG) and magnetoencephalography (MEG) play important and complementary roles in non-invasive brain-computer interface (BCI) decoding. However, compared to the low cost and portability of EEG, MEG is more expensive…

Signal Processing · Electrical Eng. & Systems 2026-02-10 Zhuo Li , Shuqiang Wang

Decoding language representations directly from the brain can enable new Brain-Computer Interfaces (BCI) for high bandwidth human-human and human-machine communication. Clinically, such technologies can restore communication in people with…

Machine Learning · Computer Science 2019-09-05 Pengfei Sun , Gopala K. Anumanchipalli , Edward F. Chang

Recent research has delved into speech enhancement (SE) approaches that leverage audio embeddings from pre-trained models, diverging from time-frequency masking or signal prediction techniques. This paper introduces an efficient and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-16 Xingwei Sun , Heinrich Dinkel , Yadong Niu , Linzhang Wang , Junbo Zhang , Jian Luan

Developing foundation models for electroencephalography (EEG) remains challenging due to the signal's low signal-to-noise ratio and complex spectro-temporal non-stationarity. Existing approaches often overlook the hierarchical latent…

Signal Processing · Electrical Eng. & Systems 2026-02-20 Mingzhe Cui , Tao Chen , Yang Jiao , Yiqin Wang , Lei Xie , Yi Pan , Luca Mainardi

Visual neural decoding aims to extract and interpret original visual experiences directly from human brain activity. Recent studies have demonstrated the feasibility of decoding visual semantic categories from electroencephalography (EEG)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Hongzhou Chen , Lianghua He , Yihang Liu , Longzhen Yang , Shaohua Shang , MengChu Zhou

The reconstruction of 3D objects from brain signals has gained significant attention in brain-computer interface (BCI) research. Current research predominantly utilizes functional magnetic resonance imaging (fMRI) for 3D reconstruction…

Graphics · Computer Science 2025-05-06 Xia Deng , Shen Chen , Jiale Zhou , Lei Li

Non-invasive decoding of imagined speech remains challenging due to weak, distributed signals and limited labeled data. Our paper introduces an image-based approach that transforms magnetoencephalography (MEG) signals into time-frequency…

Computation and Language · Computer Science 2026-01-23 Soufiane Jhilal , Stéphanie Martin , Anne-Lise Giraud

Decoding continuous language from brain activity is a formidable yet promising field of research. It is particularly significant for aiding people with speech disabilities to communicate through brain signals. This field addresses the…

Computation and Language · Computer Science 2024-04-03 Xinpei Zhao , Jingyuan Sun , Shaonan Wang , Jing Ye , Xiaohan Zhang , Chengqing Zong

Decoding spoken speech from neural activity in the brain is a fast-emerging research topic, as it could enable communication for people who have difficulties with producing audible speech. For this task, electrocorticography (ECoG) is a…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-22 Miseul Kim , Zhenyu Piao , Jihyun Lee , Hong-Goo Kang

Modern neuroprostheses can now restore communication in patients who have lost the ability to speak or move. However, these invasive devices entail risks inherent to neurosurgery. Here, we introduce a non-invasive method to decode the…

Signal Processing · Electrical Eng. & Systems 2025-02-26 Jarod Lévy , Mingfang Zhang , Svetlana Pinet , Jérémy Rapin , Hubert Banville , Stéphane d'Ascoli , Jean-Rémi King

Decoding linguistically meaningful representations from non-invasive neural recordings remains a central challenge in neural speech decoding. Among available neuroimaging modalities, magnetoencephalography (MEG) provides a safe and…

Neurons and Cognition · Quantitative Biology 2025-12-23 Shuntaro Suzuki , Chia-Chun Dan Hsu , Yu Tsao , Komei Sugiura

Speech Neuroprostheses have the potential to enable communication for people with dysarthria or anarthria. Recent advances have demonstrated high-quality text decoding and speech synthesis from electrocorticographic grids placed on the…

Intracranial EEG (iEEG) recording, characterized by high spatial and temporal resolution and superior signal-to-noise ratio (SNR), enables the development of precise brain-computer interface (BCI) systems for neural decoding. However, the…

Human-Computer Interaction · Computer Science 2025-12-09 Maryam Ostadsharif Memar , Navid Ziaei , Behzad Nazari