English
Related papers

Related papers: Deep Neural Encoder-Decoder Model to Relate fMRI B…

200 papers

Reconstructing perceived images from human brain activity monitored by functional magnetic resonance imaging (fMRI) is hard, especially for natural images. Existing methods often result in blurry and unintelligible reconstructions with low…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Mali Halac , Murat Isik , Hasan Ayaz , Anup Das

In the pursuit to understand the intricacies of human brain's visual processing, reconstructing dynamic visual experiences from brain activities emerges as a challenging yet fascinating endeavor. While recent advancements have achieved…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Jingyuan Sun , Mingxiao Li , Zijiao Chen , Marie-Francine Moens

Brain decoding is a key neuroscience field that reconstructs the visual stimuli from brain activity with fMRI, which helps illuminate how the brain represents the world. fMRI-to-image reconstruction has achieved impressive progress by…

Neurons and Cognition · Quantitative Biology 2025-10-27 Guoying Sun , Weiyu Guo , Tong Shao , Yang Yang , Haijin Zeng , Jie Liu , Jingyong Su

Decoding brain functional states underlying different cognitive processes using multivariate pattern recognition techniques has attracted increasing interests in brain imaging studies. Promising performance has been achieved using brain…

Computer Vision and Pattern Recognition · Computer Science 2018-09-18 Hongming Li , Yong Fan

The development of algorithms to accurately decode neural information has long been a research focus in the field of neuroscience. Brain decoding typically involves training machine learning models to map neural data onto a preestablished…

This literature review will discuss the use of deep learning methods for image reconstruction using fMRI data. More specifically, the quality of image reconstruction will be determined by the choice in decoding and reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Madison Van Horn

The connection between brain activity and corresponding visual stimuli is crucial in comprehending the human brain. While deep generative models have exhibited advancement in recovering brain recordings by generating images conditioned on…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Xuelin Qian , Yikai Wang , Yanwei Fu , Xinwei Sun , Xiangyang Xue , Jianfeng Feng

Functional magnetic resonance imaging produces high dimensional data, with a less then ideal number of labelled samples for brain decoding tasks (predicting brain states). In this study, we propose a new deep temporal convolutional neural…

Machine Learning · Computer Science 2015-01-13 Orhan Firat , Emre Aksan , Ilke Oztekin , Fatos T. Yarman Vural

AI-based neural decoding reconstructs visual perception by leveraging generative models to map brain activity, measured through functional MRI (fMRI), into latent hierarchical representations. Traditionally, ridge linear models transform…

Image and Video Processing · Electrical Eng. & Systems 2025-09-04 Lorenzo Veronese , Andrea Moglia , Luca Mainardi , Pietro Cerveri

Brain encoder models predict cortical fMRI responses from the internal activations of pretrained vision and language networks, and are typically evaluated by held-out prediction accuracy. This is a useful signal for training but a poor one…

Neurons and Cognition · Quantitative Biology 2026-05-15 Stuart Bladon , Brinnae Bent

Decoding visual stimuli from neural population activity is crucial for understanding the brain and for applications in brain-machine interfaces. However, such biological data is often scarce, particularly in primates or humans, where…

Machine Learning · Computer Science 2025-10-24 Jan Sobotka , Luca Baroni , Ján Antolík

Understanding how the brain encodes visual information is a central challenge in neuroscience and machine learning. A promising approach is to reconstruct visual stimuli, essentially images, from functional Magnetic Resonance Imaging (fMRI)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zheng Huang , Enpei Zhang , Weikang Qiu , Yinghao Cai , Carl Yang , Elynn Chen , Xiang Zhang , Rex Ying , Dawei Zhou , Yujun Yan

fMRI semantic category understanding using linguistic encoding models attempts to learn a forward mapping that relates stimuli to the corresponding brain activation. State-of-the-art encoding models use a single global model (linear or…

Machine Learning · Computer Science 2020-06-02 Subba Reddy Oota , Naresh Manwani , Raju S. Bapi

Understanding how spontaneous brain activity relates to stimulus-driven neural responses is a fundamental challenge in cognitive neuroscience. While task-based functional magnetic resonance imaging (fMRI) captures localized stimulus-evoked…

Neurons and Cognition · Quantitative Biology 2025-09-18 Chuyang Zhou , Ziao Ji , Daochang Liu , Dongang Wang , Chenyu Wang , Chang Xu

Current non-invasive neuroimaging techniques trade off between spatial resolution and temporal resolution. While magnetoencephalography (MEG) can capture rapid neural dynamics and functional magnetic resonance imaging (fMRI) can spatially…

Neurons and Cognition · Quantitative Biology 2025-10-13 Beige Jerry Jin , Leila Wehbe

Encoding models are used for predicting brain activity in response to sensory stimuli with the objective of elucidating how sensory information is represented in the brain. Encoding models typically comprise a nonlinear transformation of…

Neurons and Cognition · Quantitative Biology 2017-03-13 Umut Güçlü , Marcel A. J. van Gerven

Quantitative modeling of human brain activity based on language representations has been actively studied in systems neuroscience. However, previous studies examined word-level representation, and little is known about whether we could…

Computer Vision and Pattern Recognition · Computer Science 2018-02-08 Eri Matsuo , Ichiro Kobayashi , Shinji Nishimoto , Satoshi Nishida , Hideki Asoh

While computer vision models have made incredible strides in static image recognition, they still do not match human performance in tasks that require the understanding of complex, dynamic motion. This is notably true for real-world…

Neurons and Cognition · Quantitative Biology 2025-04-09 Jacob Yeung , Andrew F. Luo , Gabriel Sarch , Margaret M. Henderson , Deva Ramanan , Michael J. Tarr

Reconstructing visual stimuli from human brain activities provides a promising opportunity to advance our understanding of the brain's visual system and its connection with computer vision models. Although deep generative models have been…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Jingyuan Sun , Mingxiao Li , Marie-Francine Moens

fMRI semantic category understanding using linguistic encoding models attempt to learn a forward mapping that relates stimuli to the corresponding brain activation. Classical encoding models use linear multi-variate methods to predict the…

Machine Learning · Computer Science 2018-12-04 Subba Reddy Oota , Adithya Avvaru , Naresh Manwani , Raju S. Bapi