English
Related papers

Related papers: Reconstructing Perceptive Images from Brain Activi…

200 papers

This work presents a novel method of exploring human brain-visual representations, with a view towards replicating these processes in machines. The core idea is to learn plausible computational and biological representations by correlating…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Simone Palazzo , Concetto Spampinato , Isaak Kavasidis , Daniela Giordano , Joseph Schmidt , Mubarak Shah

In recent years, research on decoding brain activity based on functional magnetic resonance imaging (fMRI) has made remarkable achievements. However, constraint-free natural image reconstruction from brain activity is still a challenge. The…

Computer Vision and Pattern Recognition · Computer Science 2018-01-17 Chi Zhang , Kai Qiao , Linyuan Wang , Li Tong , Ying Zeng , Bin Yan

In the past five years, the use of generative and foundational AI systems has greatly improved the decoding of brain activity. Visual perception, in particular, can now be decoded from functional Magnetic Resonance Imaging (fMRI) with…

Image and Video Processing · Electrical Eng. & Systems 2024-03-15 Yohann Benchetrit , Hubert Banville , Jean-Rémi King

Existing compression methods typically focus on the removal of signal-level redundancies, while the potential and versatility of decomposing visual data into compact conceptual components still lack further study. To this end, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Jianhui Chang , Zhenghui Zhao , Chuanmin Jia , Shiqi Wang , Lingbo Yang , Qi Mao , Jian Zhang , Siwei Ma

Decoding sensory experiences from neural activity to reconstruct human-perceived visual stimuli and semantic content remains a challenge in neuroscience and artificial intelligence. Despite notable progress in current brain decoding models,…

Neurons and Cognition · Quantitative Biology 2025-10-13 Feihan Feng , Jingxin Nie

While objects from different categories can be reliably decoded from fMRI brain response patterns, it has proved more difficult to distinguish visually similar inputs, such as different instances of the same category. Here, we apply a…

Human-Computer Interaction · Computer Science 2021-02-23 Rufin VanRullen , Leila Reddy

Decoding visual stimuli from neural responses recorded by functional Magnetic Resonance Imaging (fMRI) presents an intriguing intersection between cognitive neuroscience and machine learning, promising advancements in understanding human…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Jingyuan Sun , Mingxiao Li , Zijiao Chen , Yunhao Zhang , Shaonan Wang , Marie-Francine Moens

Reconstructing human vision from brain activities has been an appealing task that helps to understand our cognitive process. Even though recent research has seen great success in reconstructing static images from non-invasive brain…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Zijiao Chen , Jiaxin Qing , Juan Helen Zhou

In the visual decoding domain, visually reconstructing presented images given the corresponding human brain activity monitored by functional magnetic resonance imaging (fMRI) is difficult, especially when reconstructing viewed natural…

Computer Vision and Pattern Recognition · Computer Science 2020-03-16 Kai Qiao , Jian Chen , Linyuan Wang , Chi Zhang , Li Tong , Bin Yan

Brain decoding is a key neuroscience field that reconstructs the visual stimuli from brain activity with fMRI, which helps illuminate how the brain represents the world. fMRI-to-image reconstruction has achieved impressive progress by…

Neurons and Cognition · Quantitative Biology 2025-10-27 Guoying Sun , Weiyu Guo , Tong Shao , Yang Yang , Haijin Zeng , Jie Liu , Jingyong Su

Decoding images from brain activity has been a challenge. Owing to the development of deep learning, there are available tools to solve this problem. The decoded image, which aims to map neural spike trains to low-level visual features and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Wenyi Li , Shengjie Zheng , Yufan Liao , Rongqi Hong , Weiliang Chen , Chenggnag He , Xiaojian Li

Neural decoding, the process of understanding how brain activity corresponds to different stimuli, has been a primary objective in cognitive sciences. Over the past three decades, advances in functional Magnetic Resonance Imaging (fMRI) and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Yanchen Wang , Adam Turnbull , Tiange Xiang , Yunlong Xu , Sa Zhou , Adnan Masoud , Shekoofeh Azizi , Feng Vankee Lin , Ehsan Adeli

Reconstructing human dynamic vision from brain activity is a challenging task with great scientific significance. Although prior video reconstruction methods have made substantial progress, they still suffer from several limitations,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Yizhuo Lu , Changde Du , Chong Wang , Xuanliu Zhu , Liuyun Jiang , Xujin Li , Huiguang He

Decoding visual representations from brain signals has attracted significant attention in both neuroscience and artificial intelligence. However, the degree to which brain signals truly encode visual information remains unclear. Current…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Jiawen Zheng , Haonan Jia , Ming Li , Yuhui Zheng , Yufeng Zeng , Yang Gao , Chen Liang

Face plays an important role in humans visual perception, and reconstructing perceived faces from brain activities is challenging because of its difficulty in extracting high-level features and maintaining consistency of multiple face…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Zihao Wang , Jing Zhao , Xuetong Ding , Hui Zhang

This literature review will discuss the use of deep learning methods for image reconstruction using fMRI data. More specifically, the quality of image reconstruction will be determined by the choice in decoding and reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Madison Van Horn

Recent work has demonstrated that complex visual stimuli can be decoded from human brain activity using deep generative models, offering new ways to probe how the brain represents real-world scenes. However, many existing approaches first…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Pinyuan Feng , Hossein Adeli , Wenxuan Guo , Fan Cheng , Ethan Hwang , Nikolaus Kriegeskorte

Decoding visual-semantic information from brain signals, such as functional MRI (fMRI), across different subjects poses significant challenges, including low signal-to-noise ratio, limited data availability, and cross-subject variability.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Ruizhe Zheng , Lichao Sun

AI-based neural decoding reconstructs visual perception by leveraging generative models to map brain activity, measured through functional MRI (fMRI), into latent hierarchical representations. Traditionally, ridge linear models transform…

Image and Video Processing · Electrical Eng. & Systems 2025-09-04 Lorenzo Veronese , Andrea Moglia , Luca Mainardi , Pietro Cerveri

In this study, we tackle a modern research challenge within the field of perceptual brain decoding, which revolves around synthesizing images from EEG signals using an adversarial deep learning framework. The specific objective is to…

Artificial Intelligence · Computer Science 2024-11-21 Rahul Mishra , Arnav Bhavsar