English
Related papers

Related papers: Reanimating Images using Neural Representations of…

200 papers

This work presents a novel method of exploring human brain-visual representations, with a view towards replicating these processes in machines. The core idea is to learn plausible computational and biological representations by correlating…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Simone Palazzo , Concetto Spampinato , Isaak Kavasidis , Daniela Giordano , Joseph Schmidt , Mubarak Shah

Reconstructing visual stimulus (image) only from human brain activity measured with functional Magnetic Resonance Imaging (fMRI) is a significant and meaningful task in Human-AI collaboration. However, the inconsistent distribution and…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Ziqi Ren , Jie Li , Xuetong Xue , Xin Li , Fan Yang , Zhicheng Jiao , Xinbo Gao

Brain decoding is a key neuroscience field that reconstructs the visual stimuli from brain activity with fMRI, which helps illuminate how the brain represents the world. fMRI-to-image reconstruction has achieved impressive progress by…

Neurons and Cognition · Quantitative Biology 2025-10-27 Guoying Sun , Weiyu Guo , Tong Shao , Yang Yang , Haijin Zeng , Jie Liu , Jingyong Su

Every day, the human brain processes an immense volume of visual information, relying on intricate neural mechanisms to perceive and interpret these stimuli. Recent breakthroughs in functional magnetic resonance imaging (fMRI) have enabled…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Matteo Ferrante , Furkan Ozcelik , Tommaso Boccato , Rufin VanRullen , Nicola Toschi

The human visual system is an intricate network of brain regions that enables us to recognize the world around us. Despite its abundant lateral and feedback connections, object processing is commonly viewed and studied as a feedforward…

Neurons and Cognition · Quantitative Biology 2019-10-09 Tim C Kietzmann , Courtney J Spoerer , Lynn Sörensen , Radoslaw M Cichy , Olaf Hauk , Nikolaus Kriegeskorte

Quantitative modeling of human brain activity based on language representations has been actively studied in systems neuroscience. However, previous studies examined word-level representation, and little is known about whether we could…

Computer Vision and Pattern Recognition · Computer Science 2018-02-08 Eri Matsuo , Ichiro Kobayashi , Shinji Nishimoto , Satoshi Nishida , Hideki Asoh

Neural coding is one of the central questions in systems neuroscience for understanding how the brain processes stimulus from the environment, moreover, it is also a cornerstone for designing algorithms of brain-machine interface, where…

Neurons and Cognition · Quantitative Biology 2020-01-29 Yichen Zhang , Shanshan Jia , Yajing Zheng , Zhaofei Yu , Yonghong Tian , Siwei Ma , Tiejun Huang , Jian K. Liu

Decoding visual stimuli from neural population activity is crucial for understanding the brain and for applications in brain-machine interfaces. However, such biological data is often scarce, particularly in primates or humans, where…

Machine Learning · Computer Science 2025-10-24 Jan Sobotka , Luca Baroni , Ján Antolík

Deep neural networks (DNNs) trained on visual tasks develop feature representations that resemble those in the human visual system. Although DNN-based encoding models can accurately predict brain responses to visual stimuli, they offer…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Matthew W. Shinkle , Mark D. Lescroart

In recent years, research on decoding brain activity based on functional magnetic resonance imaging (fMRI) has made remarkable achievements. However, constraint-free natural image reconstruction from brain activity is still a challenge. The…

Computer Vision and Pattern Recognition · Computer Science 2018-01-17 Chi Zhang , Kai Qiao , Linyuan Wang , Li Tong , Ying Zeng , Bin Yan

Visual image reconstruction, the decoding of perceptual content from brain activity into images, has advanced significantly with the integration of deep neural networks (DNNs) and generative models. This review traces the field's evolution…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Yukiyasu Kamitani , Misato Tanaka , Ken Shirakawa

Decoding human brain activities via functional magnetic resonance imaging (fMRI) has gained increasing attention in recent years. While encouraging results have been reported in brain states classification tasks, reconstructing the details…

Artificial Intelligence · Computer Science 2017-07-12 Changde Du , Changying Du , Huiguang He

Due to the low signal-to-noise ratio and limited resolution of functional MRI data, and the high complexity of natural images, reconstructing a visual stimulus from human brain fMRI measurements is a challenging task. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Zijin Gu , Keith Jamison , Amy Kuceyeski , Mert Sabuncu

Understanding how spontaneous brain activity relates to stimulus-driven neural responses is a fundamental challenge in cognitive neuroscience. While task-based functional magnetic resonance imaging (fMRI) captures localized stimulus-evoked…

Neurons and Cognition · Quantitative Biology 2025-09-18 Chuyang Zhou , Ziao Ji , Daochang Liu , Dongang Wang , Chenyu Wang , Chang Xu

Reconstructing visual stimuli from measured functional magnetic resonance imaging (fMRI) has been a meaningful and challenging task. Previous studies have successfully achieved reconstructions with structures similar to the original images,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Yizhuo Lu , Changde Du , Dianpeng Wang , Huiguang He

Decoding sensory experiences from neural activity to reconstruct human-perceived visual stimuli and semantic content remains a challenge in neuroscience and artificial intelligence. Despite notable progress in current brain decoding models,…

Neurons and Cognition · Quantitative Biology 2025-10-13 Feihan Feng , Jingxin Nie

Visual reconstruction algorithms are an interpretive tool that map brain activity to pixels. Past reconstruction algorithms employed brute-force search through a massive library to select candidate images that, when passed through an…

Neurons and Cognition · Quantitative Biology 2023-05-03 Reese Kneeland , Jordyn Ojeda , Ghislain St-Yves , Thomas Naselaris

Implicit neural representations (INRs) have emerged as a powerful tool for compressing large-scale volume data. This opens up new possibilities for in situ visualization. However, the efficient application of INRs to distributed data…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-23 Qi Wu , Joseph A. Insley , Victor A. Mateevitsi , Silvio Rizzi , Michael E. Papka , Kwan-Liu Ma

Dreaming is generally thought to be generated by spontaneous brain activity during sleep with patterns common to waking experience. This view is supported by a recent study demonstrating that dreamed objects can be predicted from brain…

Neurons and Cognition · Quantitative Biology 2017-01-24 Tomoyasu Horikawa , Yukiyasu Kamitani

A fundamental challenge in neuroscience is to decode mental states from brain activity. While functional magnetic resonance imaging (fMRI) offers a non-invasive approach to capture brain-wide neural dynamics with high spatial precision,…

Image and Video Processing · Electrical Eng. & Systems 2025-07-31 Yueh-Po Peng , Vincent K. M. Cheung , Li Su