中文
相关论文

相关论文: NSD-Imagery: A benchmark dataset for extending fMR…

200 篇论文

Two recent developments have accelerated progress in image reconstruction from human brain activity: large datasets that offer samples of brain activity in response to many thousands of natural scenes, and the open-sourcing of powerful…

神经元与认知 · 定量生物学 2023-06-02 Reese Kneeland , Jordyn Ojeda , Ghislain St-Yves , Thomas Naselaris

Decoding visual images from brain activity has significant potential for advancing brain-computer interaction and enhancing the understanding of human perception. Recent approaches align the representation spaces of images and brain…

计算机视觉与模式识别 · 计算机科学 2025-06-11 Nona Rajabi , Antônio H. Ribeiro , Miguel Vasco , Farzaneh Taleb , Mårten Björkman , Danica Kragic

Every day, the human brain processes an immense volume of visual information, relying on intricate neural mechanisms to perceive and interpret these stimuli. Recent breakthroughs in functional magnetic resonance imaging (fMRI) have enabled…

计算机视觉与模式识别 · 计算机科学 2023-05-22 Matteo Ferrante , Furkan Ozcelik , Tommaso Boccato , Rufin VanRullen , Nicola Toschi

Reconstructing visual stimuli from functional Magnetic Resonance Imaging fMRI enables fine-grained retrieval of brain activity. However, the accurate reconstruction of diverse details, including structure, background, texture, color, and…

神经与进化计算 · 计算机科学 2025-01-09 Haoyu Li , Hao Wu , Badong Chen

Vision science, particularly machine vision, has been revolutionized by introducing large-scale image datasets and statistical learning approaches. Yet, human neuroimaging studies of visual perception still rely on small numbers of images…

神经元与认知 · 定量生物学 2020-01-23 Nadine Chang , John A. Pyles , Abhinav Gupta , Michael J. Tarr , Elissa M. Aminoff

Reconstructing visual stimuli from human brain activities provides a promising opportunity to advance our understanding of the brain's visual system and its connection with computer vision models. Although deep generative models have been…

计算机视觉与模式识别 · 计算机科学 2023-10-03 Jingyuan Sun , Mingxiao Li , Marie-Francine Moens

Recent progress in visual brain decoding from fMRI has been enabled by large-scale datasets such as the Natural Scenes Dataset (NSD) and powerful diffusion-based generative models. While current pipelines are primarily optimized for…

In this work, we explore the decoding of mental imagery from subjects using their fMRI measurements. In order to achieve this decoding, we first created a mapping between a subject's fMRI signals elicited by the videos the subjects watched.…

图像与视频处理 · 电气工程与系统科学 2024-10-02 Arman Afrasiyabi , Erica Busch , Rahul Singh , Dhananjay Bhaskar , Laurent Caplette , Nicholas Turk-Browne , Smita Krishnaswamy

Deciphering visual content from functional Magnetic Resonance Imaging (fMRI) helps illuminate the human vision system. However, the scarcity of fMRI data and noise hamper brain decoding model performance. Previous approaches primarily…

计算机视觉与模式识别 · 计算机科学 2024-06-14 Yulong Liu , Yongqiang Ma , Guibo Zhu , Haodong Jing , Nanning Zheng

Neural coding is one of the central questions in systems neuroscience for understanding how the brain processes stimulus from the environment, moreover, it is also a cornerstone for designing algorithms of brain-machine interface, where…

神经元与认知 · 定量生物学 2020-01-29 Yichen Zhang , Shanshan Jia , Yajing Zheng , Zhaofei Yu , Yonghong Tian , Siwei Ma , Tiejun Huang , Jian K. Liu

The integration of deep learning and neuroscience has been advancing rapidly, which has led to improvements in the analysis of brain activity and the understanding of deep learning models from a neuroscientific perspective. The…

神经元与认知 · 定量生物学 2023-06-21 Yu Takagi , Shinji Nishimoto

Computational neuroimaging involves analyzing brain images or signals to provide mechanistic insights and predictive tools for human cognition and behavior. While diffusion models have shown stability and high-quality generation in natural…

计算机视觉与模式识别 · 计算机科学 2025-02-11 Haokai Zhao , Haowei Lou , Lina Yao , Wei Peng , Ehsan Adeli , Kilian M Pohl , Yu Zhang

The analysis of neural power spectra plays a crucial role in understanding brain function and dysfunction. While recent efforts have led to the development of methods for decomposing spectral data, challenges remain in performing…

神经元与认知 · 定量生物学 2024-10-29 Johan Medrano , Nicholas A. Alexander , Robert A. Seymour , Peter Zeidman

A fundamental challenge in neuroscience is to decode mental states from brain activity. While functional magnetic resonance imaging (fMRI) offers a non-invasive approach to capture brain-wide neural dynamics with high spatial precision,…

图像与视频处理 · 电气工程与系统科学 2025-07-31 Yueh-Po Peng , Vincent K. M. Cheung , Li Su

Recent research has explored using neural networks to reconstruct undersampled magnetic resonance imaging (MRI) data. Because of the complexity of the artifacts in the reconstructed images, there is a need to develop task-based approaches…

图像与视频处理 · 电气工程与系统科学 2022-10-25 Joshua D. Herman , Rachel E. Roca , Alexandra G. O'Neill , Marcus L. Wong , Sajan G. Lingala , Angel R. Pineda

Recent advances in fMRI-based image reconstruction have achieved remarkable photo-realistic fidelity. Yet, a persistent limitation remains: while reconstructed images often appear naturalistic and holistically similar to the target stimuli,…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Lan Yang , Minghan Yang , Ke Li , Honggang Zhang , Kaiyue Pang , Yi-Zhe Song

Decoding non-invasive brain recordings is pivotal for advancing our understanding of human cognition but faces challenges due to individual differences and complex neural signal representations. Traditional methods often require customized…

神经与进化计算 · 计算机科学 2024-10-15 Guobin Shen , Dongcheng Zhao , Xiang He , Linghao Feng , Yiting Dong , Jihang Wang , Qian Zhang , Yi Zeng

In the past five years, the use of generative and foundational AI systems has greatly improved the decoding of brain activity. Visual perception, in particular, can now be decoded from functional Magnetic Resonance Imaging (fMRI) with…

图像与视频处理 · 电气工程与系统科学 2024-03-15 Yohann Benchetrit , Hubert Banville , Jean-Rémi King

In this paper, we introduce Recon3DMind, an innovative task aimed at reconstructing 3D visuals from Functional Magnetic Resonance Imaging (fMRI) signals, marking a significant advancement in the fields of cognitive neuroscience and computer…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Jianxiong Gao , Yuqian Fu , Yun Wang , Xuelin Qian , Jianfeng Feng , Yanwei Fu

In the pursuit to understand the intricacies of human brain's visual processing, reconstructing dynamic visual experiences from brain activities emerges as a challenging yet fascinating endeavor. While recent advancements have achieved…

计算机视觉与模式识别 · 计算机科学 2024-05-14 Jingyuan Sun , Mingxiao Li , Zijiao Chen , Marie-Francine Moens