English
Related papers

Related papers: BrainECHO: Semantic Brain Signal Decoding through …

200 papers

Analyzing and reconstructing visual stimuli from brain signals effectively advances the understanding of human visual system. However, the EEG signals are complex and contain significant noise. This leads to substantial limitations in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Honghao Fu , Zhiqi Shen , Jing Jih Chin , Hao Wang

The remarkable success of large language models (LLMs) across various multi-modality applications is well established. However, integrating large language models with humans, or brain dynamics, remains relatively unexplored. In this paper,…

Signal Processing · Electrical Eng. & Systems 2024-09-04 Jinzhao Zhou , Yiqun Duan , Fred Chang , Thomas Do , Yu-Kai Wang , Chin-Teng Lin

Understanding how the brain responds to sensory inputs is challenging: brain recordings are partial, noisy, and high dimensional; they vary across sessions and subjects and they capture highly nonlinear dynamics. These challenges have led…

Neurons and Cognition · Quantitative Biology 2022-10-03 Omar Chehab , Alexandre Defossez , Jean-Christophe Loiseau , Alexandre Gramfort , Jean-Remi King

Electroencephalography (EEG) plays a crucial role in brain-computer interfaces (BCIs) and neurological diagnostics, but its real-world deployment faces challenges due to noise artifacts, missing data, and high annotation costs. We introduce…

Signal Processing · Electrical Eng. & Systems 2025-10-24 Meghna Roy Chowdhury , Yi Ding , Shreyas Sen

Decoding neural activity into human-interpretable representations is a key research direction in brain-computer interfaces (BCIs) and computational neuroscience. Recent progress in machine learning and generative AI has driven growing…

Artificial Intelligence · Computer Science 2025-12-02 Shreya Shukla , Jose Torres , Akshaj Murhekar , Christina Liu , Abhijit Mishra , Jacek Gwizdka , Shounak Roychowdhury

Decoding linguistic information from electroencephalography (EEG) remains challenging due to the brain's distributed and nonlinear organization. We present BrainStack, a functionally guided neuro-mixture-of-experts (Neuro-MoE) framework…

Artificial Intelligence · Computer Science 2026-01-30 Ziyi Zhao , Jinzhao Zhou , Xiaowei Jiang , Beining Cao , Wenhao Ma , Yang Shen , Ren Li , Yu-Kai Wang , Chin-teng Lin

Decoding speech from stereo-electroencephalography (sEEG) signals has emerged as a promising direction for brain-computer interfaces (BCIs). Its clinical applicability, however, is limited by the inherent non-stationarity of neural signals,…

Human-Computer Interaction · Computer Science 2025-09-30 Suli Wang , Yang-yang Li , Siqi Cai , Haizhou Li

Electroencephalography (EEG) stands as a crucial tool in neuroscientific research and clinical diagnostics, providing valuable insights into the electrical activities of the brain. Traditional EEG signal processing techniques, predominantly…

Neurons and Cognition · Quantitative Biology 2024-01-12 Aryan Govil , Eric Yao , Christina R. Borao

Reconstructing human dynamic visual perception from electroencephalography (EEG) signals is of great research significance since EEG's non-invasiveness and high temporal resolution. However, EEG-to-video reconstruction remains challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Tian-Yi Zhou , Xuan-Hao Liu , Bao-Liang Lu , Wei-Long Zheng

The past few years have seen remarkable progress in the decoding of speech from brain activity, primarily driven by large single-subject datasets. However, due to individual variation, such as anatomy, and differences in task design and…

Machine Learning · Computer Science 2025-06-03 Dulhan Jayalath , Gilad Landau , Brendan Shillingford , Mark Woolrich , Oiwi Parker Jones

Understanding and decoding brain activity into visual representations is a fundamental challenge at the intersection of neuroscience and artificial intelligence. While EEG visual decoding has shown promise due to its non-invasive, and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Minxu Liu , Donghai Guan , Chuhang Zheng , Chunwei Tian , Jie Wen , Qi Zhu

Speech synthesis from intracranial EEG (iEEG) signals offers a promising avenue for restoring communication in individuals with severe speech impairments. However, achieving intelligible and natural speech remains challenging due to…

Sound · Computer Science 2025-08-06 Mohammed Salah Al-Radhi , Géza Németh , Branislav Gerazov

Interpreting neural activity through meaningful latent representations remains a complex and evolving challenge at the intersection of neuroscience and artificial intelligence. We investigate the potential of multimodal foundation models to…

Computation and Language · Computer Science 2025-04-22 Yijun Liu

Continuous electroencephalography (EEG) is routinely used in neurocritical care to monitor seizures and other harmful brain activity, including rhythmic and periodic patterns that are clinically significant. Although deep learning methods…

Human-Computer Interaction · Computer Science 2026-01-05 Argha Kamal Samanta , Deepak Mewada , Monalisa Sarma , Debasis Samanta

We propose MEBM-Speech, a multi-scale enhanced neural decoder for speech activity detection from non-invasive magnetoencephalography (MEG) signals. Built upon the BrainMagic backbone, MEBM-Speech integrates three complementary temporal…

Sound · Computer Science 2026-03-04 Li Songyi , Zheng Linze , Liang Jinghua , Zhang Zifeng

With the rapid advancement of large language models like Gemini, GPT, and others, bridging the gap between the human brain and language processing has become an important area of focus. To address this challenge, researchers have developed…

Computation and Language · Computer Science 2025-12-10 Saydul Akbar Murad , Ashim Dahal , Nick Rahimi

Reconstructing visual stimuli from non-invasive electroencephalography (EEG) remains challenging due to its low spatial resolution and high noise, particularly under realistic low-density electrode configurations. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Emanuele Balloni , Emanuele Frontoni , Chiara Matti , Marina Paolanti , Roberto Pierdicca , Emiliano Santarnecchi

Decoding the orchestration of neural activity in electroencephalography (EEG) signals is a central challenge in bridging neuroscience with artificial intelligence. Foundation models have made strides in generalized EEG decoding, yet many…

Machine Learning · Computer Science 2026-03-31 Davy Darankoum , Chloé Habermacher , Julien Volle , Sergei Grudinin

Electroencephalogram (EEG) signals play a pivotal role in clinical medicine, brain research, and neurological disease studies. However, susceptibility to various physiological and environmental artifacts introduces noise in recorded EEG…

Signal Processing · Electrical Eng. & Systems 2024-05-24 Bin Wang , Fei Deng , Peifan Jiang

Silent speech decoding, which performs unvocalized human speech recognition from electroencephalography/electromyography (EEG/EMG), increases accessibility for speech-impaired humans. However, data collection is difficult and performed…

Quantitative Methods · Quantitative Biology 2025-06-18 Masakazu Inoue , Motoshige Sato , Kenichi Tomeoka , Nathania Nah , Eri Hatakeyama , Kai Arulkumaran , Ilya Horiguchi , Shuntaro Sasai