English
Related papers

Related papers: Reconstructing Visual Stimulus Images from EEG Sig…

200 papers

One of the challenges in modeling cognitive events from electroencephalogram (EEG) data is finding representations that are invariant to inter- and intra-subject differences, as well as to inherent noise associated with such data. Herein,…

Machine Learning · Computer Science 2016-03-02 Pouya Bashivan , Irina Rish , Mohammed Yeasin , Noel Codella

Existing approaches to modeling associations between visual stimuli and brain responses are facing difficulties in handling between-subject variance and model generalization. Inspired by the recent progress in modeling speech-brain…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Yiqian Yang , Zhengqiao Zhao , Qian Wang , Yan Yang , Jingdong Chen

While electroencephalogram (EEG) has been a crucial tool for monitoring the brain and diagnosing neurological disorders (e.g., epilepsy), learning meaningful representations from raw EEG signals remains challenging due to limited…

Machine Learning · Computer Science 2025-09-03 Jia Hong Puah , Sim Kuan Goh , Ziwei Zhang , Zixuan Ye , Chow Khuen Chan , Kheng Seang Lim , Si Lei Fong , Kok Sin Woon , Cuntai Guan

EEG based brain state decoding has numerous applications. State of the art decoding is based on processing of the multivariate sensor space signal, however evidence is mounting that EEG source reconstruction can assist decoding. EEG source…

Neurons and Cognition · Quantitative Biology 2017-04-20 Rasmus S. Andersen , Anders U. Eliasen , Nicolai Pedersen , Michael Riis Andersen , Sofie Therese Hansen , Lars Kai Hansen

Electroencephalogram (EEG) signals play a pivotal role in clinical medicine, brain research, and neurological disease studies. However, susceptibility to various physiological and environmental artifacts introduces noise in recorded EEG…

Signal Processing · Electrical Eng. & Systems 2024-05-24 Bin Wang , Fei Deng , Peifan Jiang

Effective visual brain-machine interfaces (BMI) is based on reliable and stable EEG biomarkers. However, traditional adaptive filter-based approaches may suffer from individual variations in EEG signals, while deep neural network-based…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Junwen Luo , Chengyong Jiang , Qingyuan Chen , Dongqi Han , Yansen Wang , Biao Yan , Dongsheng Li , Jiayi Zhang

Electroencephalogram (EEG) classification has been widely used in various medical and engineering applications, where it is important for understanding brain function, diagnosing diseases, and assessing mental health conditions. However,…

Signal Processing · Electrical Eng. & Systems 2024-08-20 Mingzhi Chen , Yiyu Gui , Yuqi Su , Yuesheng Zhu , Guibo Luo , Yuchao Yang

Decoding linguistic information from non-invasive brain signals using EEG has gained increasing research attention due to its vast applicational potential. Recently, a number of works have adopted a generative-based framework to decode…

Computation and Language · Computer Science 2024-08-12 Jinzhao Zhou , Yiqun Duan , Ziyi Zhao , Yu-Cheng Chang , Yu-Kai Wang , Thomas Do , Chin-Teng Lin

Decoding visual experience from brain signals offers exciting possibilities for neuroscience and interpretable AI. While EEG is accessible and temporally precise, its limitations in spatial detail hinder image reconstruction. Our model…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Arshak Rezvani , Ali Akbari , Kosar Sanjar Arani , Maryam Mirian , Emad Arasteh , Martin J. McKeown

This paper presents a novel approach towards creating a foundational model for aligning neural data and visual stimuli across multimodal representationsof brain activity by leveraging contrastive learning. We used electroencephalography…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Matteo Ferrante , Tommaso Boccato , Grigorii Rashkov , Nicola Toschi

Brain encoding models not only serve to decipher how visual stimuli are transformed into neural responses, but also represent a critical step toward visual prostheses that restore vision for patients with severe vision disorders. Brain…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Ganxi Xu , Zhao-Rong Lai , Yuting Tang , Yonghao Song , Shuyan Zhou , Guoxu Zhou , Boyu Wang , Jian Zhu , Jinyi Long

Electroencephalografic (EEG) data are complex multi-dimensional time-series that are very useful in many applications, from diagnostics to driving brain-computer interface systems. Their classification is still a challenging task, due to…

Signal Processing · Electrical Eng. & Systems 2024-07-30 Alberto Zancanaro , Giulia Cisotto , Italo Zoppis , Sara Lucia Manzoni

Decoding visual information from electroencephalography (EEG) has recently achieved promising results, primarily focusing on reconstructing two-dimensional (2D) images from brain activity. However, the reconstruction of three-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Emanuele Balloni , Emanuele Frontoni , Chiara Matti , Marina Paolanti , Roberto Pierdicca , Emiliano Santarnecchi

Despite the rapid advances in Brain-computer Interfacing (BCI) and continuous effort to improve the accuracy of brain decoding systems, the urge for the systems to reconstruct the experiences of the users has been widely acknowledged. This…

Signal Processing · Electrical Eng. & Systems 2017-11-20 Pouya Ghaemmaghami

Electroencephalographic (EEG) signals are fundamental to neuroscience research and clinical applications such as brain-computer interfaces and neurological disorder diagnosis. These signals are typically a combination of neurological…

Machine Learning · Computer Science 2023-10-27 Matteo Gabardi , Aurora Saibene , Francesca Gasparini , Daniele Rizzo , Fabio Antonio Stella

Decoding visual images from brain activity has significant potential for advancing brain-computer interaction and enhancing the understanding of human perception. Recent approaches align the representation spaces of images and brain…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Nona Rajabi , Antônio H. Ribeiro , Miguel Vasco , Farzaneh Taleb , Mårten Björkman , Danica Kragic

Reconstructing images using brain signals of imagined visuals may provide an augmented vision to the disabled, leading to the advancement of Brain-Computer Interface (BCI) technology. The recent progress in deep learning has boosted the…

Human-Computer Interaction · Computer Science 2023-03-21 Prajwal Singh , Pankaj Pandey , Krishna Miyapuram , Shanmuganathan Raman

This paper introduces DreamDiffusion, a novel method for generating high-quality images directly from brain electroencephalogram (EEG) signals, without the need to translate thoughts into text. DreamDiffusion leverages pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Yunpeng Bai , Xintao Wang , Yan-pei Cao , Yixiao Ge , Chun Yuan , Ying Shan

In this study, we introduce an innovative EEG signal reconstruction sub-module designed to enhance the performance of deep learning models on EEG eye-tracking tasks. This sub-module can integrate with all Encoder-Classifier-based deep…

Human-Computer Interaction · Computer Science 2024-08-13 Weigeng Li , Neng Zhou , Xiaodong Qu

Understanding how humans process visual information is one of the crucial steps for unraveling the underlying mechanism of brain activity. Recently, this curiosity has motivated the fMRI-to-image reconstruction task; given the fMRI data…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Jaehoon Joo , Taejin Jeong , Seongjae Hwang