English
Related papers

Related papers: NSD-Imagery: A benchmark dataset for extending fMR…

200 papers

Neural encoding and decoding, which aim to characterize the relationship between stimuli and brain activities, have emerged as an important area in cognitive neuroscience. Traditional encoding models, which focus on feature extraction and…

Neurons and Cognition · Quantitative Biology 2019-08-26 Hao Wu , Ziyu Zhu , Jiayi Wang , Nanning Zheng , Badong Chen

The advancement of imaging devices and countless images generated everyday pose an increasingly high demand on image denoising, which still remains a challenging task in terms of both effectiveness and efficiency. To improve denoising…

Image and Video Processing · Electrical Eng. & Systems 2023-05-10 Zhaoming Kong , Fangxi Deng , Haomin Zhuang , Jun Yu , Lifang He , Xiaowei Yang

Current AI frameworks for brain decoding and encoding, typically train and test models within the same datasets. This limits their utility for brain computer interfaces (BCI) or neurofeedback, for which it would be useful to pool…

In recent years, research on decoding brain activity based on functional magnetic resonance imaging (fMRI) has made remarkable achievements. However, constraint-free natural image reconstruction from brain activity is still a challenge. The…

Computer Vision and Pattern Recognition · Computer Science 2018-01-17 Chi Zhang , Kai Qiao , Linyuan Wang , Li Tong , Ying Zeng , Bin Yan

Convolutional neural networks have been the focus of research aiming to solve image denoising problems, but their performance remains unsatisfactory for most applications. These networks are trained with synthetic noise distributions that…

Image and Video Processing · Electrical Eng. & Systems 2020-05-06 Benoit Brummer , Christophe De Vleeschouwer

Functional MRI (fMRI) is crucial for studying brain function and diagnosing neurological disorders. However, existing analysis methods suffer from reproducibility and transferability challenges due to complex preprocessing pipelines and…

Decoding visual stimuli from neural responses recorded by functional Magnetic Resonance Imaging (fMRI) presents an intriguing intersection between cognitive neuroscience and machine learning, promising advancements in understanding human…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Jingyuan Sun , Mingxiao Li , Zijiao Chen , Yunhao Zhang , Shaonan Wang , Marie-Francine Moens

Functional MRI (fMRI) has become the most common method for investigating the human brain. However, fMRI data present some complications for statistical analysis and modeling. One recently developed approach to these data focuses on…

Applications · Statistics 2015-03-19 Vincent Q. Vu , Pradeep Ravikumar , Thomas Naselaris , Kendrick N. Kay , Jack L. Gallant , Bin Yu

We present MindEye, a novel fMRI-to-image approach to retrieve and reconstruct viewed images from brain activity. Our model comprises two parallel submodules that are specialized for retrieval (using contrastive learning) and reconstruction…

Understanding how the brain encodes external stimuli and how these stimuli can be decoded from the measured brain activities are long-standing and challenging questions in neuroscience. In this paper, we focus on reconstructing the complex…

Neurons and Cognition · Quantitative Biology 2022-10-05 Sikun Lin , Thomas Sprague , Ambuj K Singh

Functional magnetic resonance imaging (fMRI) based image reconstruction plays a pivotal role in decoding human perception, with applications in neuroscience and brain-computer interfaces. While recent advancements in deep learning and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Weiyu Guo , Guoying Sun , JianXiang He , Tong Shao , Shaoguang Wang , Ziyang Chen , Meisheng Hong , Ying Sun , Hui Xiong

Decoding brain functional states underlying different cognitive processes using multivariate pattern recognition techniques has attracted increasing interests in brain imaging studies. Promising performance has been achieved using brain…

Computer Vision and Pattern Recognition · Computer Science 2018-09-18 Hongming Li , Yong Fan

The human brain possesses remarkable abilities in visual processing, including image recognition and scene summarization. Efforts have been made to understand the cognitive capacities of the visual brain, but a comprehensive understanding…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Subhrasankar Chatterjee , Debasis Samanta

Recent advances in brain-vision decoding have driven significant progress, reconstructing with high fidelity perceived visual stimuli from neural activity, e.g., functional magnetic resonance imaging (fMRI), in the human visual cortex. Most…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Le Xu , Qi Zhang , Qixian Zhang , Hongyun Zhang , Duoqian Miao , Cairong Zhao

Visual image reconstruction from functional Magnetic Resonance Imaging (fMRI) is a fundamental task in brain decoding, providing a crucial pathway for understanding human perceptual mechanisms and developing advanced brain-computer…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Yudan Ren , Pengcheng Shi , Zihan Ma , Xiaowei He , Xiao Li

While computer vision models have made incredible strides in static image recognition, they still do not match human performance in tasks that require the understanding of complex, dynamic motion. This is notably true for real-world…

Neurons and Cognition · Quantitative Biology 2025-04-09 Jacob Yeung , Andrew F. Luo , Gabriel Sarch , Margaret M. Henderson , Deva Ramanan , Michael J. Tarr

Denoising is a fundamental challenge in scientific imaging. Deep convolutional neural networks (CNNs) provide the current state of the art in denoising natural images, where they produce impressive results. However, their potential has…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Sreyas Mohan , Ramon Manzorro , Joshua L. Vincent , Binh Tang , Dev Yashpal Sheth , Eero P. Simoncelli , David S. Matteson , Peter A. Crozier , Carlos Fernandez-Granda

Skull stripping magnetic resonance images (MRI) of the human brain is an important process in many image processing techniques, such as automatic segmentation of brain structures. Numerous methods have been developed to perform this task,…

Image and Video Processing · Electrical Eng. & Systems 2026-04-16 Hjalti Thrastarson , Lotta M. Ellingsen

Visual image reconstruction, the decoding of perceptual content from brain activity into images, has advanced significantly with the integration of deep neural networks (DNNs) and generative models. This review traces the field's evolution…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Yukiyasu Kamitani , Misato Tanaka , Ken Shirakawa

Data-hungry neuro-AI modelling requires ever larger neuroimaging datasets. CNeuroMod-THINGS meets this need by capturing neural representations for a wide set of semantic concepts using well-characterized images in a new densely-sampled,…