English
Related papers

Related papers: Decoding visual brain representations from electro…

200 papers

Decoding visual information from electroencephalography (EEG) has recently achieved promising results, primarily focusing on reconstructing two-dimensional (2D) images from brain activity. However, the reconstruction of three-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Emanuele Balloni , Emanuele Frontoni , Chiara Matti , Marina Paolanti , Roberto Pierdicca , Emiliano Santarnecchi

Analyzing and reconstructing visual stimuli from brain signals effectively advances the understanding of human visual system. However, the EEG signals are complex and contain significant noise. This leads to substantial limitations in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Honghao Fu , Zhiqi Shen , Jing Jih Chin , Hao Wang

Deep networks for electroencephalogram (EEG) decoding are often only trained to solve one specific task, such as pathology or age decoding. A more general task-agnostic approach is to train deep networks to match a (clinical) EEG recording…

Computation and Language · Computer Science 2025-07-30 Tidiane Camaret Ndir , Robin Tibor Schirrmeister , Tonio Ball

Decoding visual experience from brain signals offers exciting possibilities for neuroscience and interpretable AI. While EEG is accessible and temporally precise, its limitations in spatial detail hinder image reconstruction. Our model…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Arshak Rezvani , Ali Akbari , Kosar Sanjar Arani , Maryam Mirian , Emad Arasteh , Martin J. McKeown

Learned image compression sits at the intersection of machine learning and image processing. With advances in deep learning, neural network-based compression methods have emerged. In this process, an encoder maps the image to a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Fabien Allemand , Attilio Fiandrotti , Sumanta Chaudhuri , Alaa Eddine Mazouz

Human's perception of the visual world is shaped by the stereo processing of 3D information. Understanding how the brain perceives and processes 3D visual stimuli in the real world has been a longstanding endeavor in neuroscience. Towards…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Zhanqiang Guo , Jiamin Wu , Yonghao Song , Jiahui Bu , Weijian Mai , Qihao Zheng , Wanli Ouyang , Chunfeng Song

The recent advances in the field of deep learning have not been fully utilised for decoding imagined speech primarily because of the unavailability of sufficient training samples to train a deep network. In this paper, we present a novel…

Signal Processing · Electrical Eng. & Systems 2020-03-23 Jerrin Thomas Panachakel , A. G. Ramakrishnan , T. V. Ananthapadmanabha

Reconstructing visual stimulus images is a significant task in neural decoding, and up to now, most studies consider the functional magnetic resonance imaging (fMRI) as the signal source. However, the fMRI-based image reconstruction methods…

Image and Video Processing · Electrical Eng. & Systems 2024-03-12 Hongguang Pan , Zhuoyi Li , Yunpeng Fu , Xuebin Qin , Jianchen Hu

Several Convolutional Deep Learning models have been proposed to classify the cognitive states utilizing several neuro-imaging domains. These models have achieved significant results, but they are heavily designed with millions of…

Machine Learning · Computer Science 2021-06-17 Pankaj Pandey , Krishna Prasad Miyapuram

Electroencephalogram (EEG) has been one of the common neuromonitoring modalities for real-world brain-computer interfaces (BCIs) because of its non-invasiveness, low cost, and high temporal resolution. Recently, light-weight and portable…

Machine Learning · Computer Science 2022-12-08 Xin-Yao Huang , Sung-Yu Chen , Chun-Shu Wei

Despite extensive standardization, diagnostic interviews for mental health disorders encompass substantial subjective judgment. Previous studies have demonstrated that EEG-based neural measures can function as reliable objective correlates…

Machine Learning · Computer Science 2020-11-19 Garrett Honke , Irina Higgins , Nina Thigpen , Vladimir Miskovic , Katie Link , Sunny Duan , Pramod Gupta , Julia Klawohn , Greg Hajcak

Visual neural decoding from EEG has improved significantly due to diffusion models that can reconstruct high-quality images from decoded latents. While recent works have focused on relatively complex architectures to achieve good…

Neurons and Cognition · Quantitative Biology 2025-11-25 Teng Fei , Srinivas Ravishankar , Zhining Chen , Abhinav Uppal , Ian Jackson , Virginia R. de Sa

Convolutional neural network (CNN) driven by image recognition has been shown to be able to explain cortical responses to static pictures at ventral-stream areas. Here, we further showed that such CNN could reliably predict and decode…

Neurons and Cognition · Quantitative Biology 2017-11-15 Haiguang Wen , Junxing Shi , Yizhen Zhang , Kun-Han Lu , Jiayue Cao , Zhongming Liu

Visual neural decoding aims to extract and interpret original visual experiences directly from human brain activity. Recent studies have demonstrated the feasibility of decoding visual semantic categories from electroencephalography (EEG)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Hongzhou Chen , Lianghua He , Yihang Liu , Longzhen Yang , Shaohua Shang , MengChu Zhou

This paper introduces DreamDiffusion, a novel method for generating high-quality images directly from brain electroencephalogram (EEG) signals, without the need to translate thoughts into text. DreamDiffusion leverages pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Yunpeng Bai , Xintao Wang , Yan-pei Cao , Yixiao Ge , Chun Yuan , Ying Shan

Recent progress in diffusion-based generative models has enabled high-quality image synthesis conditioned on diverse modalities. Extending such models to brain signals could deepen our understanding of human perception and mental…

Signal Processing · Electrical Eng. & Systems 2025-11-25 Jeyoung Lee , Hochul Kang

Visual decoding from brain signals is a key challenge at the intersection of computer vision and neuroscience, requiring methods that bridge neural representations and computational models of vision. We introduce a tri-modal contrastive…

Machine Learning · Computer Science 2026-05-26 Zexuan Chen , Sichao Liu , Runhao Lu , Huichao Qi , Alexandra Woolgar , Xi Vincent Wang , Lihui Wang

A trained T1 class Convolutional Neural Network (CNN) model will be used to examine its ability to successfully identify motor imagery when fed pre-processed electroencephalography (EEG) data. In theory, and if the model has been trained…

Signal Processing · Electrical Eng. & Systems 2022-06-16 Alessandro Gallo , Manh Duong Phung

Convolutional neural networks (CNNs) are widely used to recognize the user's state through electroencephalography (EEG) signals. In the previous studies, the EEG signals are usually fed into the CNNs in the form of high-dimensional raw…

Machine Learning · Computer Science 2021-01-19 Seong-Eun Moon , Chun-Jui Chen , Cho-Jui Hsieh , Jane-Ling Wang , Jong-Seok Lee

Electroencephalography (EEG) is a useful way to implicitly monitor the users perceptual state during multimedia consumption. One of the primary challenges for the practical use of EEG-based monitoring is to achieve a satisfactory level of…

Machine Learning · Computer Science 2021-12-07 Soobeom Jang , Seong-Eun Moon , Jong-Seok Lee