English
Related papers

Related papers: Brain-Gen: Towards Interpreting Neural Signals for…

200 papers

At present, people usually use some methods based on convolutional neural networks (CNNs) for Electroencephalograph (EEG) decoding. However, CNNs have limitations in perceiving global dependencies, which is not adequate for common EEG…

Signal Processing · Electrical Eng. & Systems 2021-06-23 Yonghao Song , Xueyu Jia , Lie Yang , Longhan Xie

Recent work has demonstrated that complex visual stimuli can be decoded from human brain activity using deep generative models, offering new ways to probe how the brain represents real-world scenes. However, many existing approaches first…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Pinyuan Feng , Hossein Adeli , Wenxuan Guo , Fan Cheng , Ethan Hwang , Nikolaus Kriegeskorte

In the field of behavior-related brain computation, it is necessary to align raw neural signals against the drastic domain shift among them. A foundational framework within neuroscience research posits that trial-based neural population…

Neurons and Cognition · Quantitative Biology 2024-03-12 Yule Wang , Zijing Wu , Chengrui Li , Anqi Wu

Electroencephalography (EEG) is a widely used non-invasive technique for monitoring brain activity, but low signal-to-noise ratios (SNR) due to various artifacts often compromise its utility. Conventional artifact removal methods require…

Signal Processing · Electrical Eng. & Systems 2025-11-06 Shantanu Sarkar , Piotr Nabrzyski , Saurabh Prasad , Jose Luis Contreras-Vidal

One of the challenges in modeling cognitive events from electroencephalogram (EEG) data is finding representations that are invariant to inter- and intra-subject differences, as well as to inherent noise associated with such data. Herein,…

Machine Learning · Computer Science 2016-03-02 Pouya Bashivan , Irina Rish , Mohammed Yeasin , Noel Codella

Electroencephalography (EEG) monitors ---by either intrusive or noninvasive electrodes--- time and frequency variations and spectral content of voltage fluctuations or waves, known as brain rhythms, which in some way uncover activity during…

Neurons and Cognition · Quantitative Biology 2019-03-13 Javier A. Galadí , Joaquín J. Torres , J. Marro

Covert speech involves imagining speaking without audible sound or any movements. Decoding covert speech from electroencephalogram (EEG) is challenging due to a limited understanding of neural pronunciation mapping and the low…

In this work, we delve into the EEG classification task in the domain of visual brain decoding via two frameworks, involving two different learning paradigms. Considering the spatio-temporal nature of EEG data, one of our frameworks is…

Human-Computer Interaction · Computer Science 2024-08-12 Akanksha Sharma , Jyoti Nigam , Abhishek Rathore , Arnav Bhavsar

Understanding how humans process visual information is one of the crucial steps for unraveling the underlying mechanism of brain activity. Recently, this curiosity has motivated the fMRI-to-image reconstruction task; given the fMRI data…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Jaehoon Joo , Taejin Jeong , Seongjae Hwang

Data scarcity in the brain-computer interface field can be alleviated through the use of generative models, specifically diffusion models. While diffusion models have previously been successfully applied to electroencephalogram (EEG) data,…

Machine Learning · Computer Science 2024-11-05 Guido Klein , Pierre Guetschel , Gianluigi Silvestri , Michael Tangermann

Those experiencing strokes, traumatic brain injuries, and drug complications can often end up hospitalized and diagnosed with coma or locked-in syndrome. Such mental impediments can permanently alter the neurological pathways in work and…

Neurons and Cognition · Quantitative Biology 2024-07-04 David Fahim , Joshveer Grewal , Ritvik Ellendula

Reconstructing visual stimuli from human brain activities provides a promising opportunity to advance our understanding of the brain's visual system and its connection with computer vision models. Although deep generative models have been…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Jingyuan Sun , Mingxiao Li , Marie-Francine Moens

Visual image reconstruction, the decoding of perceptual content from brain activity into images, has advanced significantly with the integration of deep neural networks (DNNs) and generative models. This review traces the field's evolution…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Yukiyasu Kamitani , Misato Tanaka , Ken Shirakawa

Transformers are groundbreaking architectures that have changed a flow of deep learning, and many high-performance models are developing based on transformer architectures. Transformers implemented only with attention with encoder-decoder…

Human-Computer Interaction · Computer Science 2021-12-20 Young-Eun Lee , Seo-Hyun Lee

AI-based neural decoding reconstructs visual perception by leveraging generative models to map brain activity, measured through functional MRI (fMRI), into latent hierarchical representations. Traditionally, ridge linear models transform…

Image and Video Processing · Electrical Eng. & Systems 2025-09-04 Lorenzo Veronese , Andrea Moglia , Luca Mainardi , Pietro Cerveri

Decoding the human brain has been a hallmark of neuroscientists and Artificial Intelligence researchers alike. Reconstruction of visual images from brain Electroencephalography (EEG) signals has garnered a lot of interest due to its…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Prajwal Singh , Dwip Dalal , Gautam Vashishtha , Krishna Miyapuram , Shanmuganathan Raman

Reconstructing dynamic visual stimuli from brain EEG recordings is challenging due to the non-stationary and noisy nature of EEG signals and the limited availability of EEG-video datasets. Prior work has largely focused on static image…

Human-Computer Interaction · Computer Science 2025-09-23 Prajwal Singh , Anupam Sharma , Pankaj Pandey , Krishna Miyapuram , Shanmuganathan Raman

Visual neural decoding from EEG has improved significantly due to diffusion models that can reconstruct high-quality images from decoded latents. While recent works have focused on relatively complex architectures to achieve good…

Neurons and Cognition · Quantitative Biology 2025-11-25 Teng Fei , Srinivas Ravishankar , Zhining Chen , Abhinav Uppal , Ian Jackson , Virginia R. de Sa

Pretrained generative models have opened new frontiers in brain decoding by enabling the synthesis of realistic texts and images from non-invasive brain recordings. However, the reliability of such outputs remains questionable--whether they…

Computation and Language · Computer Science 2025-05-26 Xiaozhao Liu , Dinggang Shen , Xihui Liu

Electroencephalography (EEG) is an invaluable tool in neuroscience, offering insights into brain activity with high temporal resolution. Recent advancements in machine learning and generative modeling have catalyzed the application of EEG…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yashvir Sabharwal , Balaji Rama