English
Related papers

Related papers: Reconstructing the Mind's Eye: fMRI-to-Image with …

200 papers

In recent years, Multi-Modality Image Fusion (MMIF) has been applied to many fields, which has attracted many scholars to endeavour to improve the fusion performance. However, the prevailing focus has predominantly been on the architecture…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Yanglin Deng , Tianyang Xu , Chunyang Cheng , Xiao-Jun Wu , Josef Kittler

Incoherent k-space undersampling and deep learning-based reconstruction methods have shown great success in accelerating MRI. However, the performance of most previous methods will degrade dramatically under high acceleration factors, e.g.,…

Image and Video Processing · Electrical Eng. & Systems 2026-01-21 Jin Liu , Qing Lin , Zhuang Xiong , Shanshan Shan , Chunyi Liu , Min Li , Feng Liu , G. Bruce Pike , Hongfu Sun , Yang Gao

Image restoration is a typical ill-posed problem, and it contains various tasks. In the medical imaging field, an ill-posed image interrupts diagnosis and even following image processing. Both traditional iterative and up-to-date deep…

Image and Video Processing · Electrical Eng. & Systems 2021-02-12 Moran Xu , Dianlin Hu , Weifei Wu , Weiwen Wu

Neuroradiologists and neurosurgeons increasingly opt to use functional magnetic resonance imaging (fMRI) to map functionally relevant brain regions for noninvasive presurgical planning and intraoperative neuronavigation. This application…

Methodology · Statistics 2023-06-07 Andrew S. Whiteman , Andreas J. Bartsch , Jian Kang , Timothy D. Johnson

Decoding visual representations from brain signals has attracted significant attention in both neuroscience and artificial intelligence. However, the degree to which brain signals truly encode visual information remains unclear. Current…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Jiawen Zheng , Haonan Jia , Ming Li , Yuhui Zheng , Yufeng Zeng , Yang Gao , Chen Liang

In multi-contrast magnetic resonance imaging (MRI), compressed sensing theory can accelerate imaging by sampling fewer measurements within each contrast. The conventional optimization-based models suffer several limitations: strict…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Liyan Sun , Zhiwen Fan , Yue Huang , Xinghao Ding , John Paisley

Diffusion MRI (dMRI) is a valuable tool to map brain microstructure and connectivity by analyzing water molecule diffusion in tissue. However, acquiring dMRI data requires to capture multiple 3D brain volumes in a short time, often leading…

Image and Video Processing · Electrical Eng. & Systems 2025-08-29 Sedigheh Dargahi , Sylvain Bouix , Christian Desrosiers

In this paper, we propose MINE to perform novel view synthesis and depth estimation via dense 3D reconstruction from a single image. Our approach is a continuous depth generalization of the Multiplane Images (MPI) by introducing the NEural…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Jiaxin Li , Zijian Feng , Qi She , Henghui Ding , Changhu Wang , Gim Hee Lee

Deep generative models have gained recent traction in accelerated MRI reconstruction. Diffusion priors are particularly promising given their representational fidelity. Instead of the target transformation from undersampled to fully-sampled…

Image and Video Processing · Electrical Eng. & Systems 2023-12-19 Muhammad U. Mirza , Onat Dalmaz , Hasan A. Bedel , Gokberk Elmas , Yilmaz Korkmaz , Alper Gungor , Salman UH Dar , Tolga Çukur

Neuroscience studies have revealed that the brain encodes visual content and embeds information in neural activity. Recently, deep learning techniques have facilitated attempts to address visual reconstructions by mapping brain activity to…

Image and Video Processing · Electrical Eng. & Systems 2022-07-05 Pei-Chun Chang , Yan-Yu Tien , Chia-Lin Chen , Li-Fen Chen , Yong-Sheng Chen , Hui-Ling Chan

Motion artifacts remain a significant challenge in Magnetic Resonance Imaging (MRI), compromising diagnostic quality and potentially leading to misdiagnosis or repeated scans. Existing deep learning approaches for motion artifact correction…

Image and Video Processing · Electrical Eng. & Systems 2025-11-24 Paolo Angella , Luca Balbi , Fabrizio Ferrando , Paolo Traverso , Rosario Varriale , Vito Paolo Pastore , Matteo Santacesaria

Degradation-agnostic image restoration aims to handle diverse corruptions with one unified model, but faces fundamental challenges in balancing efficiency and performance across different degradation types. Existing approaches either…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Bin Ren , Yawei Li , Xu Zheng , Yuqian Fu , Danda Pani Paudel , Hong Liu , Ming-Hsuan Yang , Luc Van Gool , Nicu Sebe

Blind face restoration is an important task in computer vision and has gained significant attention due to its wide-range applications. Previous works mainly exploit facial priors to restore face images and have demonstrated high-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Xiaoxu Chen , Jingfan Tan , Tao Wang , Kaihao Zhang , Wenhan Luo , Xiaochun Cao

Like masked language modeling (MLM) in natural language processing, masked image modeling (MIM) aims to extract valuable insights from image patches to enhance the feature extraction capabilities of the underlying deep neural network (DNN).…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Yixuan Luo , Mengye Ren , Sai Qian Zhang

\hspace{2mm} Diffusion-weighted magnetic resonance imaging (dMRI) of the brain offers unique capabilities including noninvasive probing of tissue microstructure and structural connectivity. It is widely used for clinical assessment of…

Image and Video Processing · Electrical Eng. & Systems 2025-12-30 Davood Karimi , Simon K. Warfield

Diffusion MRI (dMRI) is sensitive to microstructural barriers, yet most existing methods either assume impermeable boundaries or estimate voxel-level parameters without recovering explicit interfaces. We present Spinverse, a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Prathamesh Pradeep Khole , Mario M. Brenes , Zahra Kais Petiwala , Ehsan Mirafzali , Utkarsh Gupta , Jing-Rebecca Li , Andrada Ianus , Razvan Marinescu

Purpose: Although recent deep energy-based generative models (EBMs) have shown encouraging results in many image generation tasks, how to take advantage of the self-adversarial cogitation in deep EBMs to boost the performance of Magnetic…

Image and Video Processing · Electrical Eng. & Systems 2021-09-10 Yu Guan , Zongjiang Tu , Shanshan Wang , Qiegen Liu , Yuhao Wang , Dong Liang

Multi-institutional efforts can facilitate training of deep MRI reconstruction models, albeit privacy risks arise during cross-site sharing of imaging data. Federated learning (FL) has recently been introduced to address privacy concerns by…

Image and Video Processing · Electrical Eng. & Systems 2022-04-08 Gokberk Elmas , Salman UH Dar , Yilmaz Korkmaz , Emir Ceyani , Burak Susam , Muzaffer Özbey , Salman Avestimehr , Tolga Çukur

Magnetic Resonance Imaging (MRI) scans are time consuming and precarious, since the patients remain still in a confined space for extended periods of time. To reduce scanning time, some experts have experimented with undersampled k spaces,…

Image and Video Processing · Electrical Eng. & Systems 2022-08-25 Kyler Larsen , Arghya Pal , Yogesh Rathi

Visual prostheses hold great promise for restoring vision in blind individuals. While researchers have successfully utilized M/EEG signals to evoke visual perceptions during the brain decoding stage of visual prostheses, the complementary…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Ganxi Xu , Zhao-Rong Lai , Yuting Tang , Yonghao Song , Guoxu Zhou , Boyu wang , Jian Zhu , Jinyi Long