English
Related papers

Related papers: NSD-Imagery: A benchmark dataset for extending fMR…

200 papers

Two recent developments have accelerated progress in image reconstruction from human brain activity: large datasets that offer samples of brain activity in response to many thousands of natural scenes, and the open-sourcing of powerful…

Neurons and Cognition · Quantitative Biology 2023-06-02 Reese Kneeland , Jordyn Ojeda , Ghislain St-Yves , Thomas Naselaris

Decoding visual images from brain activity has significant potential for advancing brain-computer interaction and enhancing the understanding of human perception. Recent approaches align the representation spaces of images and brain…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Nona Rajabi , Antônio H. Ribeiro , Miguel Vasco , Farzaneh Taleb , Mårten Björkman , Danica Kragic

Every day, the human brain processes an immense volume of visual information, relying on intricate neural mechanisms to perceive and interpret these stimuli. Recent breakthroughs in functional magnetic resonance imaging (fMRI) have enabled…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Matteo Ferrante , Furkan Ozcelik , Tommaso Boccato , Rufin VanRullen , Nicola Toschi

Reconstructing visual stimuli from functional Magnetic Resonance Imaging fMRI enables fine-grained retrieval of brain activity. However, the accurate reconstruction of diverse details, including structure, background, texture, color, and…

Neural and Evolutionary Computing · Computer Science 2025-01-09 Haoyu Li , Hao Wu , Badong Chen

Vision science, particularly machine vision, has been revolutionized by introducing large-scale image datasets and statistical learning approaches. Yet, human neuroimaging studies of visual perception still rely on small numbers of images…

Neurons and Cognition · Quantitative Biology 2020-01-23 Nadine Chang , John A. Pyles , Abhinav Gupta , Michael J. Tarr , Elissa M. Aminoff

Reconstructing visual stimuli from human brain activities provides a promising opportunity to advance our understanding of the brain's visual system and its connection with computer vision models. Although deep generative models have been…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Jingyuan Sun , Mingxiao Li , Marie-Francine Moens

Recent progress in visual brain decoding from fMRI has been enabled by large-scale datasets such as the Natural Scenes Dataset (NSD) and powerful diffusion-based generative models. While current pipelines are primarily optimized for…

Neurons and Cognition · Quantitative Biology 2026-04-20 Fabrizio Spera , Tommaso Boccato , Michal Olak , Sara Cammarota , Matteo Ciferri , Michelangelo Tronti , Nicola Toschi , Matteo Ferrante

In this work, we explore the decoding of mental imagery from subjects using their fMRI measurements. In order to achieve this decoding, we first created a mapping between a subject's fMRI signals elicited by the videos the subjects watched.…

Image and Video Processing · Electrical Eng. & Systems 2024-10-02 Arman Afrasiyabi , Erica Busch , Rahul Singh , Dhananjay Bhaskar , Laurent Caplette , Nicholas Turk-Browne , Smita Krishnaswamy

Deciphering visual content from functional Magnetic Resonance Imaging (fMRI) helps illuminate the human vision system. However, the scarcity of fMRI data and noise hamper brain decoding model performance. Previous approaches primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Yulong Liu , Yongqiang Ma , Guibo Zhu , Haodong Jing , Nanning Zheng

Neural coding is one of the central questions in systems neuroscience for understanding how the brain processes stimulus from the environment, moreover, it is also a cornerstone for designing algorithms of brain-machine interface, where…

Neurons and Cognition · Quantitative Biology 2020-01-29 Yichen Zhang , Shanshan Jia , Yajing Zheng , Zhaofei Yu , Yonghong Tian , Siwei Ma , Tiejun Huang , Jian K. Liu

The integration of deep learning and neuroscience has been advancing rapidly, which has led to improvements in the analysis of brain activity and the understanding of deep learning models from a neuroscientific perspective. The…

Neurons and Cognition · Quantitative Biology 2023-06-21 Yu Takagi , Shinji Nishimoto

Computational neuroimaging involves analyzing brain images or signals to provide mechanistic insights and predictive tools for human cognition and behavior. While diffusion models have shown stability and high-quality generation in natural…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Haokai Zhao , Haowei Lou , Lina Yao , Wei Peng , Ehsan Adeli , Kilian M Pohl , Yu Zhang

The analysis of neural power spectra plays a crucial role in understanding brain function and dysfunction. While recent efforts have led to the development of methods for decomposing spectral data, challenges remain in performing…

Neurons and Cognition · Quantitative Biology 2024-10-29 Johan Medrano , Nicholas A. Alexander , Robert A. Seymour , Peter Zeidman

A fundamental challenge in neuroscience is to decode mental states from brain activity. While functional magnetic resonance imaging (fMRI) offers a non-invasive approach to capture brain-wide neural dynamics with high spatial precision,…

Image and Video Processing · Electrical Eng. & Systems 2025-07-31 Yueh-Po Peng , Vincent K. M. Cheung , Li Su

Recent research has explored using neural networks to reconstruct undersampled magnetic resonance imaging (MRI) data. Because of the complexity of the artifacts in the reconstructed images, there is a need to develop task-based approaches…

Image and Video Processing · Electrical Eng. & Systems 2022-10-25 Joshua D. Herman , Rachel E. Roca , Alexandra G. O'Neill , Marcus L. Wong , Sajan G. Lingala , Angel R. Pineda

Recent advances in fMRI-based image reconstruction have achieved remarkable photo-realistic fidelity. Yet, a persistent limitation remains: while reconstructed images often appear naturalistic and holistically similar to the target stimuli,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Lan Yang , Minghan Yang , Ke Li , Honggang Zhang , Kaiyue Pang , Yi-Zhe Song

Decoding non-invasive brain recordings is pivotal for advancing our understanding of human cognition but faces challenges due to individual differences and complex neural signal representations. Traditional methods often require customized…

Neural and Evolutionary Computing · Computer Science 2024-10-15 Guobin Shen , Dongcheng Zhao , Xiang He , Linghao Feng , Yiting Dong , Jihang Wang , Qian Zhang , Yi Zeng

In the past five years, the use of generative and foundational AI systems has greatly improved the decoding of brain activity. Visual perception, in particular, can now be decoded from functional Magnetic Resonance Imaging (fMRI) with…

Image and Video Processing · Electrical Eng. & Systems 2024-03-15 Yohann Benchetrit , Hubert Banville , Jean-Rémi King

In this paper, we introduce Recon3DMind, an innovative task aimed at reconstructing 3D visuals from Functional Magnetic Resonance Imaging (fMRI) signals, marking a significant advancement in the fields of cognitive neuroscience and computer…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Jianxiong Gao , Yuqian Fu , Yun Wang , Xuelin Qian , Jianfeng Feng , Yanwei Fu

In the pursuit to understand the intricacies of human brain's visual processing, reconstructing dynamic visual experiences from brain activities emerges as a challenging yet fascinating endeavor. While recent advancements have achieved…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Jingyuan Sun , Mingxiao Li , Zijiao Chen , Marie-Francine Moens