English
Related papers

Related papers: Contrast, Attend and Diffuse to Decode High-Resolu…

200 papers

Neuroscience studies have revealed that the brain encodes visual content and embeds information in neural activity. Recently, deep learning techniques have facilitated attempts to address visual reconstructions by mapping brain activity to…

Image and Video Processing · Electrical Eng. & Systems 2022-07-05 Pei-Chun Chang , Yan-Yu Tien , Chia-Lin Chen , Li-Fen Chen , Yong-Sheng Chen , Hui-Ling Chan

In neural decoding research, one of the most intriguing topics is the reconstruction of perceived natural images based on fMRI signals. Previous studies have succeeded in re-creating different aspects of the visuals, such as low-level…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Furkan Ozcelik , Rufin VanRullen

Functional MRI (fMRI) is a powerful technique that has allowed us to characterize visual cortex responses to stimuli, yet such experiments are by nature constructed based on a priori hypotheses, limited to the set of images presented to the…

Neurons and Cognition · Quantitative Biology 2021-05-18 Zijin Gu , Keith W. Jamison , Meenakshi Khosla , Emily J. Allen , Yihan Wu , Thomas Naselaris , Kendrick Kay , Mert R. Sabuncu , Amy Kuceyeski

Visual decoding from brain signals is a key challenge at the intersection of computer vision and neuroscience, requiring methods that bridge neural representations and computational models of vision. A field-wide goal is to achieve…

This literature review will discuss the use of deep learning methods for image reconstruction using fMRI data. More specifically, the quality of image reconstruction will be determined by the choice in decoding and reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Madison Van Horn

Brain-to-image decoding has been recently propelled by the progress in generative AI models and the availability of large ultra-high field functional Magnetic Resonance Imaging (fMRI). However, current approaches depend on complicated…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Marlène Careil , Yohann Benchetrit , Jean-Rémi King

Understanding how humans process visual information is one of the crucial steps for unraveling the underlying mechanism of brain activity. Recently, this curiosity has motivated the fMRI-to-image reconstruction task; given the fMRI data…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Jaehoon Joo , Taejin Jeong , Seongjae Hwang

Magnetic Resonance Imaging (MRI) is essential for noninvasive generation of high-quality images of human tissues. Accurate segmentation of MRI data is critical for medical applications like brain anatomy analysis and disease detection.…

Optimization and Control · Mathematics 2025-10-17 Laura Antonelli , Valentina De Simone , Marco Viola

Decoding sensory experiences from neural activity to reconstruct human-perceived visual stimuli and semantic content remains a challenge in neuroscience and artificial intelligence. Despite notable progress in current brain decoding models,…

Neurons and Cognition · Quantitative Biology 2025-10-13 Feihan Feng , Jingxin Nie

Decoding visual experiences from brain activity is a significant challenge. Existing fMRI-to-video methods often focus on semantic content while overlooking spatial and motion information. However, these aspects are all essential and are…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Chong Li , Jingyang Huo , Weikang Gong , Yanwei Fu , Xiangyang Xue , Jianfeng Feng

Deep neural networks have been developed drawing inspiration from the brain visual pathway, implementing an end-to-end approach: from image data to video object classes. However building an fMRI decoder with the typical structure of…

Machine Learning · Statistics 2017-01-10 Michele Svanera , Sergio Benini , Gal Raz , Talma Hendler , Rainer Goebel , Giancarlo Valente

Addressing the question of visualising human mind could help us to find regions that are associated with observed cognition and responsible for expressing the elusive mental image, leading to a better understanding of cognitive function.…

Neurons and Cognition · Quantitative Biology 2021-02-11 Pan Wang , Rui Zhou , Shuo Wang , Ling Li , Wenjia Bai , Jialu Fan , Chunlin Li , Peter Childs , Yike Guo

Functional magnetic resonance imaging (fMRI) is a neuroimaging modality that captures the blood oxygen level in a subject's brain while the subject either rests or performs a variety of functional tasks under different conditions. Given…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 Sam Nguyen , Brenda Ng , Alan D. Kaplan , Priyadip Ray

Magnetic resonance imaging (MRI) relies on radiofrequency (RF) excitation of proton spin. Clinical diagnosis requires a comprehensive collation of biophysical data via multiple MRI contrasts, acquired using a series of RF sequences that…

Medical Physics · Physics 2025-12-24 Dinor Nagar , Moritz Zaiss , Or Perlman

While computer vision models have made incredible strides in static image recognition, they still do not match human performance in tasks that require the understanding of complex, dynamic motion. This is notably true for real-world…

Neurons and Cognition · Quantitative Biology 2025-04-09 Jacob Yeung , Andrew F. Luo , Gabriel Sarch , Margaret M. Henderson , Deva Ramanan , Michael J. Tarr

A long-standing topic in artificial intelligence is the effective recognition of patterns from noisy images. In this regard, the recent data-driven paradigm considers 1) improving the representation robustness by adding noisy samples in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Shuren Qi , Yushu Zhang , Chao Wang , Tao Xiang , Xiaochun Cao , Yong Xiang

In recent years, research on decoding brain activity based on functional magnetic resonance imaging (fMRI) has made remarkable achievements. However, constraint-free natural image reconstruction from brain activity is still a challenge. The…

Computer Vision and Pattern Recognition · Computer Science 2018-01-17 Chi Zhang , Kai Qiao , Linyuan Wang , Li Tong , Ying Zeng , Bin Yan

Understanding how the brain responds to external stimuli and decoding this process has been a significant challenge in neuroscience. While previous studies typically concentrated on brain-to-image and brain-to-language reconstruction, our…

Artificial Intelligence · Computer Science 2025-12-02 Chunzheng Zhu , Jialin Shao , Jianxin Lin , Yijun Wang , Jing Wang , Jinhui Tang , Kenli Li

Visual image reconstruction from functional Magnetic Resonance Imaging (fMRI) is a fundamental task in brain decoding, providing a crucial pathway for understanding human perceptual mechanisms and developing advanced brain-computer…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Yudan Ren , Pengcheng Shi , Zihan Ma , Xiaowei He , Xiao Li

Diffusion MRI is a powerful tool that serves as a bridge between brain microstructure and cognition. Recent advancements in cognitive neuroscience have highlighted the persistent challenge of understanding how individual differences in…

Neurons and Cognition · Quantitative Biology 2024-09-25 Gabriela Gómez Jiménez , Demian Wassermann