English
Related papers

Related papers: Interpretable EEG-to-Image Generation with Semanti…

200 papers

Visual neural decoding from EEG has improved significantly due to diffusion models that can reconstruct high-quality images from decoded latents. While recent works have focused on relatively complex architectures to achieve good…

Neurons and Cognition · Quantitative Biology 2025-11-25 Teng Fei , Srinivas Ravishankar , Zhining Chen , Abhinav Uppal , Ian Jackson , Virginia R. de Sa

Reconstructing images using brain signals of imagined visuals may provide an augmented vision to the disabled, leading to the advancement of Brain-Computer Interface (BCI) technology. The recent progress in deep learning has boosted the…

Human-Computer Interaction · Computer Science 2023-03-21 Prajwal Singh , Pankaj Pandey , Krishna Miyapuram , Shanmuganathan Raman

EEG signals capture brain activity with high temporal and low spatial resolution, supporting applications such as neurological diagnosis, cognitive monitoring, and brain-computer interfaces. However, effective analysis is hindered by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Amirabbas Hojjati , Lu Li , Ibrahim Hameed , Anis Yazidi , Pedro G. Lind , Rabindra Khadka

Leveraging the universal representations of pre-trained LLMs and MLLMs offers a promising path toward brain foundation models. However, visually-evoked EEG datasets remain scarce, leading existing methods to align neural signals mainly with…

Artificial Intelligence · Computer Science 2026-05-26 Jun-Yu Pan , Yansen Wang , Enze Zhang , Bao-Liang Lu , Wei-Long Zheng , Dongsheng Li

Non-invasive decoding of imagined speech remains challenging due to weak, distributed signals and limited labeled data. Our paper introduces an image-based approach that transforms magnetoencephalography (MEG) signals into time-frequency…

Computation and Language · Computer Science 2026-01-23 Soufiane Jhilal , Stéphanie Martin , Anne-Lise Giraud

Recent advances in large language models have accelerated open-vocabulary EEG-to-imagined-text decoding, where non-invasive neural activity recorded during visual perception is translated into coherent natural language descriptions of…

Machine Learning · Computer Science 2026-05-28 Akshaj Murhekar , Abhijit Mishra

Brain encoding models not only serve to decipher how visual stimuli are transformed into neural responses, but also represent a critical step toward visual prostheses that restore vision for patients with severe vision disorders. Brain…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Ganxi Xu , Zhao-Rong Lai , Yuting Tang , Yonghao Song , Shuyan Zhou , Guoxu Zhou , Boyu Wang , Jian Zhu , Jinyi Long

How to decode human vision through neural signals has attracted a long-standing interest in neuroscience and machine learning. Modern contrastive learning and generative models improved the performance of visual decoding and reconstruction…

Human-Computer Interaction · Computer Science 2024-10-07 Dongyang Li , Chen Wei , Shiying Li , Jiachen Zou , Haoyang Qin , Quanying Liu

Recent progress in diffusion-based generative models has enabled high-quality image synthesis conditioned on diverse modalities. Extending such models to brain signals could deepen our understanding of human perception and mental…

Signal Processing · Electrical Eng. & Systems 2025-11-25 Jeyoung Lee , Hochul Kang

Unlike conventional data such as natural images, audio and speech, raw multi-channel Electroencephalogram (EEG) data are difficult to interpret. Modern deep neural networks have shown promising results in EEG studies, however finding robust…

Signal Processing · Electrical Eng. & Systems 2022-06-22 Nikesh Bajaj , Jesús Requena Carrión , Francesco Bellotti

Every day, the human brain processes an immense volume of visual information, relying on intricate neural mechanisms to perceive and interpret these stimuli. Recent breakthroughs in functional magnetic resonance imaging (fMRI) have enabled…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Matteo Ferrante , Furkan Ozcelik , Tommaso Boccato , Rufin VanRullen , Nicola Toschi

We have developed a graphic user interface (GUI), ExBrainable, dedicated to convolutional neural networks (CNN) model training and visualization in electroencephalography (EEG) decoding. Available functions include model training,…

Signal Processing · Electrical Eng. & Systems 2022-01-12 Ya-Lin Huang , Chia-Ying Hsieh , Jian-Xue Huang , Chun-Shu Wei

Emotional Image Content Generation (EICG) aims to generate semantically clear and emotionally faithful images based on given emotion categories, with broad application prospects. While recent text-to-image diffusion models excel at…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Kaishen Yuan , Yuting Zhang , Shang Gao , Yijie Zhu , Wenshuo Chen , Yutao Yue

This work presents a novel method of exploring human brain-visual representations, with a view towards replicating these processes in machines. The core idea is to learn plausible computational and biological representations by correlating…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Simone Palazzo , Concetto Spampinato , Isaak Kavasidis , Daniela Giordano , Joseph Schmidt , Mubarak Shah

Deciphering the intricacies of the human brain has captivated curiosity for centuries. Recent strides in Brain-Computer Interface (BCI) technology, particularly using motor imagery, have restored motor functions such as reaching, grasping,…

Computation and Language · Computer Science 2024-05-06 Hanwen Liu , Daniel Hajialigol , Benny Antony , Aiguo Han , Xuan Wang

This paper introduces DreamDiffusion, a novel method for generating high-quality images directly from brain electroencephalogram (EEG) signals, without the need to translate thoughts into text. DreamDiffusion leverages pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Yunpeng Bai , Xintao Wang , Yan-pei Cao , Yixiao Ge , Chun Yuan , Ying Shan

Forecasting Electroncephalography (EEG) signals during cognitive events remains a fundamental challenge in neuroscience and Brain-Computer Interfaces (BCIs), as existing methods struggle to capture both the stochastic nature of neural…

Signal Processing · Electrical Eng. & Systems 2026-03-19 Mehran Shabanpour , Sadaf Khademi , Konstantinos N Plataniotis , Arash Mohammadi

Decoding visual images from brain activity has significant potential for advancing brain-computer interaction and enhancing the understanding of human perception. Recent approaches align the representation spaces of images and brain…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Nona Rajabi , Antônio H. Ribeiro , Miguel Vasco , Farzaneh Taleb , Mårten Björkman , Danica Kragic

Decoding visual stimuli from neural recordings is a critical challenge in the development of brain-computer interfaces (BCIs). Although recent EEG-based decoding approaches have made progress in tasks such as visual classification,…

Human-Computer Interaction · Computer Science 2024-12-31 Dongyang Li , Haoyang Qin , Mingyang Wu , Jiahua Tang , Yuang Cao , Chen Wei , Quanying Liu

One of the challenges in modeling cognitive events from electroencephalogram (EEG) data is finding representations that are invariant to inter- and intra-subject differences, as well as to inherent noise associated with such data. Herein,…

Machine Learning · Computer Science 2016-03-02 Pouya Bashivan , Irina Rish , Mohammed Yeasin , Noel Codella