English
Related papers

Related papers: Rest2Visual: Predicting Visually Evoked fMRI from …

200 papers

The reconstruction of images observed by subjects from fMRI data collected during visual stimuli has made strong progress in the past decade, thanks to the availability of extensive fMRI datasets and advancements in generative models for…

While computer vision models have made incredible strides in static image recognition, they still do not match human performance in tasks that require the understanding of complex, dynamic motion. This is notably true for real-world…

Neurons and Cognition · Quantitative Biology 2025-04-09 Jacob Yeung , Andrew F. Luo , Gabriel Sarch , Margaret M. Henderson , Deva Ramanan , Michael J. Tarr

Contemporary neuroscience has embraced network science to study the complex and self-organized structure of the human brain; one of the main outstanding issues is that of inferring from measure data, chiefly functional Magnetic Resonance…

Optimization and Control · Mathematics 2017-03-31 Giulia Prando , Mattia Zorzi , Alessandra Bertoldo , Alessandro Chiuso

Deep learning methods are increasingly being used with neuroimaging data like structural and function magnetic resonance imaging (MRI) to predict the diagnosis of neuropsychiatric and neurological disorders. For psychiatric disorders in…

Neurons and Cognition · Quantitative Biology 2019-07-03 Ahmed El Gazzar , Leonardo Cerliani , Guido van Wingen , Rajat Mani Thomas

Brain decoding is a field of computational neuroscience that uses measurable brain activity to infer mental states or internal representations of perceptual inputs. Therefore, we propose a novel approach to brain decoding that also relies…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Matteo Ferrante , Tommaso Boccato , Nicola Toschi

The goal of emotional brain state classification on functional MRI (fMRI) data is to recognize brain activity patterns related to specific emotion tasks performed by subjects during an experiment. Distinguishing emotional brain states from…

Image and Video Processing · Electrical Eng. & Systems 2022-11-01 Maxime Tchibozo , Donggeun Kim , Zijing Wang , Xiaofu He

Reconstructing human dynamic vision from brain activity is a challenging task with great scientific significance. Although prior video reconstruction methods have made substantial progress, they still suffer from several limitations,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Yizhuo Lu , Changde Du , Chong Wang , Xuanliu Zhu , Liuyun Jiang , Xujin Li , Huiguang He

Naturalistic fMRI characterizes the brain as a dynamic predictive engine driven by continuous sensory streams. However, modeling the causal forward evolution in realistic neural simulation is impeded by the timescale mismatch between…

Neurons and Cognition · Quantitative Biology 2026-02-05 Xuanhua Yin , Runkai Zhao , Lina Yao , Weidong Cai

Decoding visual stimuli from neural responses recorded by functional Magnetic Resonance Imaging (fMRI) presents an intriguing intersection between cognitive neuroscience and machine learning, promising advancements in understanding human…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Jingyuan Sun , Mingxiao Li , Zijiao Chen , Yunhao Zhang , Shaonan Wang , Marie-Francine Moens

Functional Magnetic Resonance Imaging (fMRI) provides dynamical access into the complex functioning of the human brain, detailing the hemodynamic activity of thousands of voxels during hundreds of sequential time points. One approach…

Neurons and Cognition · Quantitative Biology 2008-01-16 Francois G. Meyer , Greg J. Stephens

Functional magnetic resonance imaging (fMRI) enables indirect detection of brain activity changes via the blood-oxygen-level-dependent (BOLD) signal. Conventional analysis methods mainly rely on the real-valued magnitude of these signals.…

Methodology · Statistics 2023-10-31 Zhengxin Wang , Daniel B. Rowe , Xinyi Li , D. Andrew Brown

Reconstructing visual stimulus images is a significant task in neural decoding, and up to now, most studies consider the functional magnetic resonance imaging (fMRI) as the signal source. However, the fMRI-based image reconstruction methods…

Image and Video Processing · Electrical Eng. & Systems 2024-03-12 Hongguang Pan , Zhuoyi Li , Yunpeng Fu , Xuebin Qin , Jianchen Hu

Functional magnetic resonance imaging (fMRI) is a neuroimaging modality that captures the blood oxygen level in a subject's brain while the subject either rests or performs a variety of functional tasks under different conditions. Given…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 Sam Nguyen , Brenda Ng , Alan D. Kaplan , Priyadip Ray

This study explores the use of text-prompted MRI image generation with the Stable Diffusion (SD) model to address challenges in acquiring real MRI datasets, such as high costs, limited rare case samples, and privacy concerns. The SD model,…

Image and Video Processing · Electrical Eng. & Systems 2025-05-30 Xinxian Fan , Mengye Lyu

Multivariate Pattern (MVP) classification holds enormous potential for decoding visual stimuli in the human brain by employing task-based fMRI data sets. There is a wide range of challenges in the MVP techniques, i.e. decreasing noise and…

Machine Learning · Statistics 2016-12-28 Muhammad Yousefnezhad , Daoqiang Zhang

Resting-state functional Magnetic Resonance Imaging (fMRI) is a powerful imaging technique for studying functional development of the brain in utero. However, unpredictable and excessive movement of fetuses has limited clinical application…

Brain encoder models predict cortical fMRI responses from the internal activations of pretrained vision and language networks, and are typically evaluated by held-out prediction accuracy. This is a useful signal for training but a poor one…

Neurons and Cognition · Quantitative Biology 2026-05-15 Stuart Bladon , Brinnae Bent

Neural decoding, the process of understanding how brain activity corresponds to different stimuli, has been a primary objective in cognitive sciences. Over the past three decades, advances in functional Magnetic Resonance Imaging (fMRI) and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Yanchen Wang , Adam Turnbull , Tiange Xiang , Yunlong Xu , Sa Zhou , Adnan Masoud , Shekoofeh Azizi , Feng Vankee Lin , Ehsan Adeli

Quantitative modeling of human brain activity based on language representations has been actively studied in systems neuroscience. However, previous studies examined word-level representation, and little is known about whether we could…

Computer Vision and Pattern Recognition · Computer Science 2018-02-08 Eri Matsuo , Ichiro Kobayashi , Shinji Nishimoto , Satoshi Nishida , Hideki Asoh

Neuroradiologists and neurosurgeons increasingly opt to use functional magnetic resonance imaging (fMRI) to map functionally relevant brain regions for noninvasive presurgical planning and intraoperative neuronavigation. This application…

Methodology · Statistics 2023-06-07 Andrew S. Whiteman , Andreas J. Bartsch , Jian Kang , Timothy D. Johnson