English
Related papers

Related papers: Hi-DREAM: Brain Inspired Hierarchical Diffusion fo…

200 papers

The release of large datasets and developments in AI have led to dramatic improvements in decoding methods that reconstruct seen images from human brain activity. We evaluate the prospect of further improving recent decoding methods by…

Neurons and Cognition · Quantitative Biology 2023-12-14 Reese Kneeland , Jordyn Ojeda , Ghislain St-Yves , Thomas Naselaris

Every day, the human brain processes an immense volume of visual information, relying on intricate neural mechanisms to perceive and interpret these stimuli. Recent breakthroughs in functional magnetic resonance imaging (fMRI) have enabled…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Matteo Ferrante , Furkan Ozcelik , Tommaso Boccato , Rufin VanRullen , Nicola Toschi

Understanding how the brain encodes visual information is a central challenge in neuroscience and machine learning. A promising approach is to reconstruct visual stimuli, essentially images, from functional Magnetic Resonance Imaging (fMRI)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zheng Huang , Enpei Zhang , Weikang Qiu , Yinghao Cai , Carl Yang , Elynn Chen , Xiang Zhang , Rex Ying , Dawei Zhou , Yujun Yan

Decoding visual experiences from fMRI offers a powerful avenue to understand human perception and develop advanced brain-computer interfaces. However, current progress often prioritizes maximizing reconstruction fidelity while overlooking…

Machine Learning · Computer Science 2025-10-09 Yuxiang Wei , Yanteng Zhang , Xi Xiao , Tianyang Wang , Xiao Wang , Vince D. Calhoun

Decoding brain states from functional magnetic resonance imaging (fMRI) data is vital for advancing neuroscience and clinical applications. While traditional machine learning and deep learning approaches have made strides in leveraging the…

Machine Learning · Computer Science 2025-12-10 Danial Jafarzadeh Jazi , Maryam Hajiesmaeili

Current AI frameworks for brain decoding and encoding, typically train and test models within the same datasets. This limits their utility for brain computer interfaces (BCI) or neurofeedback, for which it would be useful to pool…

Understanding how the brain encodes external stimuli and how these stimuli can be decoded from the measured brain activities are long-standing and challenging questions in neuroscience. In this paper, we focus on reconstructing the complex…

Neurons and Cognition · Quantitative Biology 2022-10-05 Sikun Lin , Thomas Sprague , Ambuj K Singh

Brain network analysis based on functional Magnetic Resonance Imaging (fMRI) is pivotal for diagnosing brain disorders. Existing approaches typically rely on predefined functional sub-networks to construct sub-network associations. However,…

Machine Learning · Computer Science 2026-03-11 Jingfeng Tang , Peng Cao , Guangqi Wen , Jinzhu Yang , Xiaoli Liu , Osmar R. Zaiane

Recent breakthroughs in understanding the human brain have revealed its impressive ability to efficiently process and interpret human thoughts, opening up possibilities for intervening in brain signals. In this paper, we aim to develop a…

Human-Computer Interaction · Computer Science 2024-08-15 Yasheng Sun , Bohan Li , Mingchen Zhuge , Deng-Ping Fan , Salman Khan , Fahad Shahbaz Khan , Hideki Koike

Deep learning analyses have offered sensitivity leaps in detection of cognitive states from functional MRI (fMRI) measurements across the brain. Yet, as deep models perform hierarchical nonlinear transformations on their input, interpreting…

Signal Processing · Electrical Eng. & Systems 2023-07-20 Hasan Atakan Bedel , Tolga Çukur

Understanding functional representations within higher visual cortex is a fundamental question in computational neuroscience. While artificial neural networks pretrained on large-scale datasets exhibit striking representational alignment…

Images with abnormal brain anatomy produce problems for automatic segmentation techniques, and as a result poor ROI detection affects both quantitative measurements and visual assessment of perfusion data. This paper presents a new approach…

Image and Video Processing · Electrical Eng. & Systems 2019-02-19 Svitlana M Alkhimova

Understanding the encoding and decoding mechanisms of dynamic neural responses to different visual stimuli is an important topic in exploring how the brain represents visual information. Currently, hierarchically deep neural networks (DNNs)…

Neurons and Cognition · Quantitative Biology 2025-12-24 Jingyi Feng , Xiang Feng

fMRI (functional Magnetic Resonance Imaging) visual decoding involves decoding the original image from brain signals elicited by visual stimuli. This often relies on manually labeled ROIs (Regions of Interest) to select brain voxels.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Ziyu Wang , Tengyu Pan , Zhenyu Li , Ji Wu , Xiuxing Li , Jianyong Wang

Due to the low signal-to-noise ratio and limited resolution of functional MRI data, and the high complexity of natural images, reconstructing a visual stimulus from human brain fMRI measurements is a challenging task. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Zijin Gu , Keith Jamison , Amy Kuceyeski , Mert Sabuncu

Deciphering visual content from functional Magnetic Resonance Imaging (fMRI) helps illuminate the human vision system. However, the scarcity of fMRI data and noise hamper brain decoding model performance. Previous approaches primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Yulong Liu , Yongqiang Ma , Guibo Zhu , Haodong Jing , Nanning Zheng

Brain decoding, a pivotal field in neuroscience, aims to reconstruct stimuli from acquired brain signals, primarily utilizing functional magnetic resonance imaging (fMRI). Currently, brain decoding is confined to a per-subject-per-model…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Shizun Wang , Songhua Liu , Zhenxiong Tan , Xinchao Wang

Magnetic Resonance Imaging (MRI) is a critical tool in modern medical diagnostics, yet its prolonged acquisition time remains a critical limitation, especially in time-sensitive clinical scenarios. While undersampling strategies can…

Image and Video Processing · Electrical Eng. & Systems 2025-10-09 Mohammed Alsubaie , Wenxi Liu , Linxia Gu , Ovidiu C. Andronesi , Sirani M. Perera , Xianqi Li

Reasoning about images/objects and their hierarchical interactions is a key concept for the next generation of computer vision approaches. Here we present a new framework to deal with it through a visual hierarchical context-based…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Pedro H. Bugatti , Priscila T. M. Saito , Larry S. Davis

Dreaming is generally thought to be generated by spontaneous brain activity during sleep with patterns common to waking experience. This view is supported by a recent study demonstrating that dreamed objects can be predicted from brain…

Neurons and Cognition · Quantitative Biology 2017-01-24 Tomoyasu Horikawa , Yukiyasu Kamitani