English
Related papers

Related papers: Natural Image Reconstruction from fMRI using Deep …

200 papers

While objects from different categories can be reliably decoded from fMRI brain response patterns, it has proved more difficult to distinguish visually similar inputs, such as different instances of the same category. Here, we apply a…

Human-Computer Interaction · Computer Science 2021-02-23 Rufin VanRullen , Leila Reddy

Diffusion magnetic resonance imaging (dMRI) is a crucial non-invasive technique for exploring the microstructure of the living human brain. Traditional hand-crafted and model-based tissue microstructure reconstruction methods often require…

Image and Video Processing · Electrical Eng. & Systems 2025-02-26 Xinrui Ma , Jian Cheng , Wenxin Fan , Ruoyou Wu , Yongquan Ye , Shanshan Wang

Decoding behavior, perception, or cognitive state directly from neural signals has applications in brain-computer interface research as well as implications for systems neuroscience. In the last decade, deep learning has become the…

Neurons and Cognition · Quantitative Biology 2020-05-21 Jesse A. Livezey , Joshua I. Glaser

Following the success of deep learning in a wide range of applications, neural network-based machine learning techniques have received interest as a means of accelerating magnetic resonance imaging (MRI). A number of ideas inspired by deep…

Signal Processing · Electrical Eng. & Systems 2019-04-03 Florian Knoll , Kerstin Hammernik , Chi Zhang , Steen Moeller , Thomas Pock , Daniel K. Sodickson , Mehmet Akcakaya

Motion represents one of the major challenges in magnetic resonance imaging (MRI). Since the MR signal is acquired in frequency space, any motion of the imaged object leads to complex artefacts in the reconstructed image in addition to…

Image and Video Processing · Electrical Eng. & Systems 2023-10-24 Veronika Spieker , Hannah Eichhorn , Kerstin Hammernik , Daniel Rueckert , Christine Preibisch , Dimitrios C. Karampinos , Julia A. Schnabel

Deep learning methods have recently made notable advances in the tasks of classification and representation learning. These tasks are important for brain imaging and neuroscience discovery, making the methods attractive for porting to a…

Neural and Evolutionary Computing · Computer Science 2014-02-20 Sergey M. Plis , Devon R. Hjelm , Ruslan Salakhutdinov , Vince D. Calhoun

The study of neurodegenerative diseases relies on the reconstruction and analysis of the brain cortex from magnetic resonance imaging (MRI). Traditional frameworks for this task like FreeSurfer demand lengthy runtimes, while its accelerated…

Image and Video Processing · Electrical Eng. & Systems 2020-10-23 Rodrigo Santa Cruz , Leo Lebrat , Pierrick Bourgeat , Clinton Fookes , Jurgen Fripp , Olivier Salvado

Neuroscience studies have revealed that the brain encodes visual content and embeds information in neural activity. Recently, deep learning techniques have facilitated attempts to address visual reconstructions by mapping brain activity to…

Image and Video Processing · Electrical Eng. & Systems 2022-07-05 Pei-Chun Chang , Yan-Yu Tien , Chia-Lin Chen , Li-Fen Chen , Yong-Sheng Chen , Hui-Ling Chan

We investigate optimal strategies for decoding perceived natural speech from fMRI data acquired from a limited number of participants. Leveraging Lebel et al. (2023)'s dataset of 8 participants, we first demonstrate the effectiveness of…

Neurons and Cognition · Quantitative Biology 2025-05-28 Louis Jalouzot , Alexis Thual , Yair Lakretz , Christophe Pallier , Bertrand Thirion

Physics-driven deep learning methods have emerged as a powerful tool for computational magnetic resonance imaging (MRI) problems, pushing reconstruction performance to new limits. This article provides an overview of the recent developments…

Image and Video Processing · Electrical Eng. & Systems 2022-10-17 Kerstin Hammernik , Thomas Küstner , Burhaneddin Yaman , Zhengnan Huang , Daniel Rueckert , Florian Knoll , Mehmet Akçakaya

Deep learning-based 3-dimensional (3D) shape reconstruction from 2-dimensional (2D) magnetic resonance imaging (MRI) has become increasingly important in medical disease diagnosis, treatment planning, and computational modeling. This review…

Machine Learning · Computer Science 2025-10-03 Emma McMillian , Abhirup Banerjee , Alfonso Bueno-Orovio

This paper studies the brave new idea for Multimedia community, and proposes a novel framework to convert dreams into coherent video narratives using fMRI data. Essentially, dreams have intrigued humanity for centuries, offering glimpses…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Yanwei Fu , Jianxiong Gao , Baofeng Yang , Jianfeng Feng

Decoding visual stimuli from neural activity is essential for understanding the human brain. While fMRI methods have successfully reconstructed static images, fMRI-to-video reconstruction faces challenges due to the need for capturing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Haonan Wang , Qixiang Zhang , Lehan Wang , Xuanqi Huang , Xiaomeng Li

Magnetic Resonance Imaging (MRI) is a principal diagnostic approach used in the field of radiology to create images of the anatomical and physiological structure of patients. MRI is the prevalent medical imaging practice to find…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Yusuf Brima , Mossadek Hossain Kamal Tushar , Upama Kabir , Tariqul Islam

Among the most impressive recent applications of neural decoding is the visual representation decoding, where the category of an object that a subject either sees or imagines is inferred by observing his/her brain activity. Even though…

Neural and Evolutionary Computing · Computer Science 2018-11-06 Angeliki Papadimitriou , Nikolaos Passalis , Anastasios Tefas

Deep neural networks have been developed drawing inspiration from the brain visual pathway, implementing an end-to-end approach: from image data to video object classes. However building an fMRI decoder with the typical structure of…

Machine Learning · Statistics 2017-01-10 Michele Svanera , Sergio Benini , Gal Raz , Talma Hendler , Rainer Goebel , Giancarlo Valente

We propose an end-to-end deep neural encoder-decoder model to encode and decode brain activity in response to naturalistic stimuli using functional magnetic resonance imaging (fMRI) data. Leveraging temporally correlated input from…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Florian David , Michael Chan , Elenor Morgenroth , Patrik Vuilleumier , Dimitri Van De Ville

In recent years, the rapid development of neuroimaging technology has been providing many powerful tools for cognitive neuroscience research. Among them, the functional magnetic resonance imaging (fMRI), which has high spatial resolution,…

Human-Computer Interaction · Computer Science 2018-08-20 Yang Wang , Dongrui Wu

Neural decoding, the process of understanding how brain activity corresponds to different stimuli, has been a primary objective in cognitive sciences. Over the past three decades, advances in functional Magnetic Resonance Imaging (fMRI) and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Yanchen Wang , Adam Turnbull , Tiange Xiang , Yunlong Xu , Sa Zhou , Adnan Masoud , Shekoofeh Azizi , Feng Vankee Lin , Ehsan Adeli

Deep learning (DL) has recently emerged as a pivotal technology for enhancing magnetic resonance imaging (MRI), a critical tool in diagnostic radiology. This review paper provides a comprehensive overview of recent advances in DL for MRI…

Machine Learning · Computer Science 2024-04-25 Reinhard Heckel , Mathews Jacob , Akshay Chaudhari , Or Perlman , Efrat Shimron