English
Related papers

Related papers: Brain3D: EEG-to-3D Decoding of Visual Representati…

200 papers

Understanding the hidden mechanisms behind human's visual perception is a fundamental question in neuroscience. To that end, investigating into the neural responses of human mind activities, such as functional Magnetic Resonance Imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yuankun Yang , Li Zhang , Ziyang Xie , Zhiyuan Yuan , Jianfeng Feng , Xiatian Zhu , Yu-Gang Jiang

In the past five years, the use of generative and foundational AI systems has greatly improved the decoding of brain activity. Visual perception, in particular, can now be decoded from functional Magnetic Resonance Imaging (fMRI) with…

Image and Video Processing · Electrical Eng. & Systems 2024-03-15 Yohann Benchetrit , Hubert Banville , Jean-Rémi King

Electroencephalography (EEG) has become one of the key modalities underpinning brain-computer interfaces (BCIs) due to its high temporal resolution, rapid responsiveness, non-invasiveness, low cost, and portability. However, EEG signals are…

Neurons and Cognition · Quantitative Biology 2026-04-17 Yihang Dong , Changhong Jing , Shuqiang Wang

Decoding visual representations from human brain activity has emerged as a thriving research domain, particularly in the context of brain-computer interfaces. Our study presents an innovative method that employs to classify and reconstruct…

Signal Processing · Electrical Eng. & Systems 2023-09-15 Matteo Ferrante , Tommaso Boccato , Stefano Bargione , Nicola Toschi

Visual neural decoding aims to extract and interpret original visual experiences directly from human brain activity. Recent studies have demonstrated the feasibility of decoding visual semantic categories from electroencephalography (EEG)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Hongzhou Chen , Lianghua He , Yihang Liu , Longzhen Yang , Shaohua Shang , MengChu Zhou

Decoding visual experience from brain signals offers exciting possibilities for neuroscience and interpretable AI. While EEG is accessible and temporally precise, its limitations in spatial detail hinder image reconstruction. Our model…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Arshak Rezvani , Ali Akbari , Kosar Sanjar Arani , Maryam Mirian , Emad Arasteh , Martin J. McKeown

EEG based brain state decoding has numerous applications. State of the art decoding is based on processing of the multivariate sensor space signal, however evidence is mounting that EEG source reconstruction can assist decoding. EEG source…

Neurons and Cognition · Quantitative Biology 2017-04-20 Rasmus S. Andersen , Anders U. Eliasen , Nicolai Pedersen , Michael Riis Andersen , Sofie Therese Hansen , Lars Kai Hansen

Seeing is believing, however, the underlying mechanism of how human visual perceptions are intertwined with our cognitions is still a mystery. Thanks to the recent advances in both neuroscience and artificial intelligence, we have been able…

Image and Video Processing · Electrical Eng. & Systems 2023-08-17 Yu-Ting Lan , Kan Ren , Yansen Wang , Wei-Long Zheng , Dongsheng Li , Bao-Liang Lu , Lili Qiu

This paper presents a novel approach towards creating a foundational model for aligning neural data and visual stimuli across multimodal representationsof brain activity by leveraging contrastive learning. We used electroencephalography…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Matteo Ferrante , Tommaso Boccato , Grigorii Rashkov , Nicola Toschi

Deep learning for decoding EEG signals has gained traction, with many claims to state-of-the-art accuracy. However, despite the convincing benchmark performance, successful translation to real applications is limited. The frequent…

Electroencephalography (EEG) signals are known to manifest differential patterns when individuals visually concentrate on different objects. In this work, we present an end-to-end digital fabrication system, Brain2Object, to print the 3D…

Human-Computer Interaction · Computer Science 2020-06-18 Xiang Zhang , Lina Yao , Chaoran Huang , Salil S. Kanhere , Dalin Zhang , Yu Zhang

Electroencephalography (EEG) is an invaluable tool in neuroscience, offering insights into brain activity with high temporal resolution. Recent advancements in machine learning and generative modeling have catalyzed the application of EEG…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yashvir Sabharwal , Balaji Rama

Electroencephalogram (EEG) signals have become a popular medium for decoding visual information due to their cost-effectiveness and high temporal resolution. However, current approaches face significant challenges in bridging the modality…

Machine Learning · Computer Science 2026-03-10 Sicheng Dai , Hongwang Xiao , Shan Yu , Qiwei Ye

EEG-based brain-computer interfaces (BCIs) have shown promise in various applications, such as motor imagery and cognitive state monitoring. However, decoding visual representations from EEG signals remains a significant challenge due to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Tariq Mehmood , Hamza Ahmad , Muhammad Haroon Shakeel , Murtaza Taj

Reconstructing dynamic visual stimuli from brain EEG recordings is challenging due to the non-stationary and noisy nature of EEG signals and the limited availability of EEG-video datasets. Prior work has largely focused on static image…

Human-Computer Interaction · Computer Science 2025-09-23 Prajwal Singh , Anupam Sharma , Pankaj Pandey , Krishna Miyapuram , Shanmuganathan Raman

Reconstructing human dynamic visual perception from electroencephalography (EEG) signals is of great research significance since EEG's non-invasiveness and high temporal resolution. However, EEG-to-video reconstruction remains challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Tian-Yi Zhou , Xuan-Hao Liu , Bao-Liang Lu , Wei-Long Zheng

Deciphering the intricacies of the human brain has captivated curiosity for centuries. Recent strides in Brain-Computer Interface (BCI) technology, particularly using motor imagery, have restored motor functions such as reaching, grasping,…

Computation and Language · Computer Science 2024-05-06 Hanwen Liu , Daniel Hajialigol , Benny Antony , Aiguo Han , Xuan Wang

Reconstructing brain sources is a fundamental challenge in neuroscience, crucial for understanding brain function and dysfunction. Electroencephalography (EEG) signals have a high temporal resolution. However, identifying the correct…

Image and Video Processing · Electrical Eng. & Systems 2026-03-12 Marco Morik , Ali Hashemi , Klaus-Robert Müller , Stefan Haufe , Shinichi Nakajima

In this paper, we introduce Recon3DMind, an innovative task aimed at reconstructing 3D visuals from Functional Magnetic Resonance Imaging (fMRI) signals, marking a significant advancement in the fields of cognitive neuroscience and computer…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Jianxiong Gao , Yuqian Fu , Yun Wang , Xuelin Qian , Jianfeng Feng , Yanwei Fu

Recent progress in NeRF-based GANs has introduced a number of approaches for high-resolution and high-fidelity generative modeling of human heads with a possibility for novel view rendering. At the same time, one must solve an inverse…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Ananta R. Bhattarai , Matthias Nießner , Artem Sevastopolsky