English
Related papers

Related papers: Reconstructing the Mind's Eye: fMRI-to-Image with …

200 papers

Blind face restoration methods have shown remarkable performance, particularly when trained on large-scale synthetic datasets with supervised learning. These datasets are often generated by simulating low-quality face images with a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Tianshu Kuai , Sina Honari , Igor Gilitschenski , Alex Levinshtein

Visual reconstruction algorithms are an interpretive tool that map brain activity to pixels. Past reconstruction algorithms employed brute-force search through a massive library to select candidate images that, when passed through an…

Neurons and Cognition · Quantitative Biology 2023-05-03 Reese Kneeland , Jordyn Ojeda , Ghislain St-Yves , Thomas Naselaris

Human body restoration plays a vital role in various applications related to the human body. Despite recent advances in general image restoration using generative models, their performance in human body restoration remains mediocre, often…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Yiming Zhang , Zhe Wang , Xinjie Li , Yunchen Yuan , Chengsong Zhang , Xiao Sun , Zhihang Zhong , Jian Wang

Reconstructing visual stimuli from functional Magnetic Resonance Imaging fMRI enables fine-grained retrieval of brain activity. However, the accurate reconstruction of diverse details, including structure, background, texture, color, and…

Neural and Evolutionary Computing · Computer Science 2025-01-09 Haoyu Li , Hao Wu , Badong Chen

Recent advances in MRI have led to the creation of large datasets. With the increase in data volume, it has become difficult to locate previous scans of the same patient within these datasets (a process known as re-identification). To…

Image and Video Processing · Electrical Eng. & Systems 2023-09-26 Lemuel Puglisi , Frederik Barkhof , Daniel C. Alexander , Geoffrey JM Parker , Arman Eshaghi , Daniele Ravì

With the goal of recovering high-quality image content from its degraded version, image restoration enjoys numerous applications, such as in surveillance, computational photography, medical imaging, and remote sensing. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-09 Syed Waqas Zamir , Aditya Arora , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Ming-Hsuan Yang , Ling Shao

The release of large datasets and developments in AI have led to dramatic improvements in decoding methods that reconstruct seen images from human brain activity. We evaluate the prospect of further improving recent decoding methods by…

Neurons and Cognition · Quantitative Biology 2023-12-14 Reese Kneeland , Jordyn Ojeda , Ghislain St-Yves , Thomas Naselaris

Recent learning-based approaches have made astonishing advances in calibrated medical imaging like computerized tomography (CT), yet they struggle to generalize in uncalibrated modalities -- notably magnetic resonance (MR) imaging, where…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Peirong Liu , Oula Puonti , Xiaoling Hu , Daniel C. Alexander , Juan E. Iglesias

Recent advances in fMRI-based image reconstruction have achieved remarkable photo-realistic fidelity. Yet, a persistent limitation remains: while reconstructed images often appear naturalistic and holistically similar to the target stimuli,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Lan Yang , Minghan Yang , Ke Li , Honggang Zhang , Kaiyue Pang , Yi-Zhe Song

We propose ReMiDi, a novel method for inferring neuronal microstructure as arbitrary 3D meshes using a differentiable diffusion Magnetic Resonance Imaging (dMRI) simulator. We first implemented in PyTorch a differentiable dMRI simulator…

Image and Video Processing · Electrical Eng. & Systems 2025-03-03 Prathamesh Pradeep Khole , Zahra Kais Petiwala , Shri Prathaa Magesh , Ehsan Mirafzali , Utkarsh Gupta , Jing-Rebecca Li , Andrada Ianus , Razvan Marinescu

Every day, the human brain processes an immense volume of visual information, relying on intricate neural mechanisms to perceive and interpret these stimuli. Recent breakthroughs in functional magnetic resonance imaging (fMRI) have enabled…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Matteo Ferrante , Furkan Ozcelik , Tommaso Boccato , Rufin VanRullen , Nicola Toschi

Image reconstruction and captioning from brain activity evoked by visual stimuli allow researchers to further understand the connection between the human brain and the visual perception system. While deep generative models have recently…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Weijian Mai , Zhijun Zhang

In neural decoding research, one of the most intriguing topics is the reconstruction of perceived natural images based on fMRI signals. Previous studies have succeeded in re-creating different aspects of the visuals, such as low-level…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Furkan Ozcelik , Rufin VanRullen

Decoding images from non-invasive electroencephalographic (EEG) signals has been a grand challenge in understanding how the human brain process visual information in real-world scenarios. To cope with the issues of signal-to-noise ratio and…

Signal Processing · Electrical Eng. & Systems 2024-06-26 Chi-Sheng Chen , Chun-Shu Wei

Understanding how the brain encodes visual information is a central challenge in neuroscience and machine learning. A promising approach is to reconstruct visual stimuli, essentially images, from functional Magnetic Resonance Imaging (fMRI)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zheng Huang , Enpei Zhang , Weikang Qiu , Yinghao Cai , Carl Yang , Elynn Chen , Xiang Zhang , Rex Ying , Dawei Zhou , Yujun Yan

Diffusion models have recently emerged as powerful generative models in medical imaging. However, it remains a major challenge to combine these data-driven models with domain knowledge to guide brain imaging problems. In neuroimaging,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Ana Lawry Aguila , Dina Zemlyanker , You Cheng , Sudeshna Das , Daniel C. Alexander , Oula Puonti , Annabel Sorby-Adams , W. Taylor Kimberly , Juan Eugenio Iglesias

Fast and accurate MRI reconstruction is a key concern in modern clinical practice. Recently, numerous Deep-Learning methods have been proposed for MRI reconstruction, however, they usually fail to reconstruct sharp details from the…

Image and Video Processing · Electrical Eng. & Systems 2023-06-21 Hanhui Yang , Juncheng Li , Lok Ming Lui , Shihui Ying , Jun Shi , Tieyong Zeng

Visual image reconstruction from functional Magnetic Resonance Imaging (fMRI) is a fundamental task in brain decoding, providing a crucial pathway for understanding human perceptual mechanisms and developing advanced brain-computer…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Yudan Ren , Pengcheng Shi , Zihan Ma , Xiaowei He , Xiao Li

Diffusion MRI is commonly performed using echo-planar imaging (EPI) due to its rapid acquisition time. However, the resolution of diffusion-weighted images is often limited by magnetic field inhomogeneity-related artifacts and blurring…

Image and Video Processing · Electrical Eng. & Systems 2023-09-26 Jaejin Cho , Yohan Jun , Xiaoqing Wang , Caique Kobayashi , Berkin Bilgic

Reconstructing visual stimulus (image) only from human brain activity measured with functional Magnetic Resonance Imaging (fMRI) is a significant and meaningful task in Human-AI collaboration. However, the inconsistent distribution and…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Ziqi Ren , Jie Li , Xuetong Xue , Xin Li , Fan Yang , Zhicheng Jiao , Xinbo Gao