English
Related papers

Related papers: MindDiffuser: Controlled Image Reconstruction from…

200 papers

Multimodal medical images play a crucial role in the precise and comprehensive clinical diagnosis. Diffusion model is a powerful strategy to synthesize the required medical images. However, existing approaches still suffer from the problem…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Jiahua Xu , Dawei Zhou , Lei Hu , Zaiyi Liu , Nannan Wang , Xinbo Gao

Recent months have witnessed rapid progress in 3D generation based on diffusion models. Most advances require fine-tuning existing 2D Stable Diffsuions into multi-view settings or tedious distilling operations and hence fall short of 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Suyi Jiang , Haimin Luo , Haoran Jiang , Ziyu Wang , Jingyi Yu , Lan Xu

Image deblurring is an ill-posed problem with multiple plausible solutions for a given input image. However, most existing methods produce a deterministic estimate of the clean image and are trained to minimize pixel-level distortion. These…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Jay Whang , Mauricio Delbracio , Hossein Talebi , Chitwan Saharia , Alexandros G. Dimakis , Peyman Milanfar

Most existing MRI reconstruction methods perform tar-geted reconstruction of the entire MR image without tak-ing specific tissue regions into consideration. This may fail to emphasize the reconstruction accuracy on im-portant tissues for…

Image and Video Processing · Electrical Eng. & Systems 2023-09-06 Yu Guan , Chuanming Yu , Shiyu Lu , Zhuoxu Cui , Dong Liang , Qiegen Liu

Diffusion Magnetic Resonance Imaging (dMRI) plays a critical role in studying microstructural changes in the brain. It is, therefore, widely used in clinical practice; yet progress in learning general-purpose representations from dMRI has…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Gustavo Chau Loo Kung , Mohammad Abbasi , Camila Blank , Juze Zhang , Alan Q. Wang , Sophie Ostmeier , Akshay Chaudhari , Kilian Pohl , Ehsan Adeli

Recent advancements in deep learning for medical image segmentation are often limited by the scarcity of high-quality training data.While diffusion models provide a potential solution by generating synthetic images, their effectiveness in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Jianhao Xie , Ziang Zhang , Zhenyu Weng , Yuesheng Zhu , Guibo Luo

Diffusion models have recently gained traction as a powerful class of deep generative priors, excelling in a wide range of image restoration tasks due to their exceptional ability to model data distributions. To solve image restoration…

Image and Video Processing · Electrical Eng. & Systems 2025-06-10 Xiang Li , Soo Min Kwon , Shijun Liang , Ismail R. Alkhouri , Saiprasad Ravishankar , Qing Qu

Diffusion models have emerged as a leading methodology for image generation and have proven successful in the realm of magnetic resonance imaging (MRI) reconstruction. However, existing reconstruction methods based on diffusion models are…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Zhuo-Xu Cui , Chentao Cao , Yue Wang , Sen Jia , Jing Cheng , Xin Liu , Hairong Zheng , Dong Liang , Yanjie Zhu

Video-driven neural face reenactment aims to synthesize realistic facial images that successfully preserve the identity and appearance of a source face, while transferring the target head pose and facial expressions. Existing GAN-based…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Stella Bounareli , Christos Tzelepis , Vasileios Argyriou , Ioannis Patras , Georgios Tzimiropoulos

Implicit Neural Representations (INRs) are a learning-based approach to accelerate Magnetic Resonance Imaging (MRI) acquisitions, particularly in scan-specific settings when only data from the under-sampled scan itself are available.…

Image and Video Processing · Electrical Eng. & Systems 2024-12-11 Yamin Arefeen , Brett Levac , Zach Stoebner , Jonathan Tamir

Neural representations (NRs), such as neural fields and 3D Gaussians, effectively model volumetric data in computed tomography (CT) but suffer from severe artifacts under sparse-view settings. To address this, we propose DiffNR, a novel…

Image and Video Processing · Electrical Eng. & Systems 2026-04-24 Shiyan Su , Ruyi Zha , Danli Shi , Hongdong Li , Xuelian Cheng

Current subject-driven image generation methods encounter significant challenges in person-centric image generation. The reason is that they learn the semantic scene and person generation by fine-tuning a common pre-trained diffusion, which…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Yibin Wang , Weizhong Zhang , Jianwei Zheng , Cheng Jin

The purpose of this study is to present and compare three denoising diffusion probabilistic models (DDPMs) that generate 3D $T_1$-weighted MRI human brain images. Three DDPMs were trained using 80,675 image volumes from 42,406 subjects…

Image and Video Processing · Electrical Eng. & Systems 2025-11-03 Samuel W. Remedios , Aaron Carass , Jerry L. Prince , Blake E. Dewey

Unsupervised anomaly detection has gained significant attention in the field of medical imaging due to its capability of relieving the costly pixel-level annotation. To achieve this, modern approaches usually utilize generative models to…

Image and Video Processing · Electrical Eng. & Systems 2024-01-22 Rui Xu , Yunke Wang , Bo Du

Large-scale diffusion-based generative models have led to breakthroughs in text-conditioned high-resolution image synthesis. Starting from random noise, such text-to-image diffusion models gradually synthesize images in an iterative fashion…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Yogesh Balaji , Seungjun Nah , Xun Huang , Arash Vahdat , Jiaming Song , Qinsheng Zhang , Karsten Kreis , Miika Aittala , Timo Aila , Samuli Laine , Bryan Catanzaro , Tero Karras , Ming-Yu Liu

Anomaly detection in medical imaging plays a crucial role in identifying pathological regions across various imaging modalities, such as brain MRI, liver CT, and carotid ultrasound (US). However, training fully supervised segmentation…

Image and Video Processing · Electrical Eng. & Systems 2025-07-29 Yuan Bi , Lucie Huang , Ricarda Clarenbach , Reza Ghotbi , Angelos Karlas , Nassir Navab , Zhongliang Jiang

Accelerated MRI reconstruction plays a vital role in reducing scan time while preserving image quality. While most existing methods rely on complex-valued image-space or k-space data, these formats are often inaccessible in clinical…

Image and Video Processing · Electrical Eng. & Systems 2025-04-29 Tao Song , Yicheng Wu , Minhao Hu , Xiangde Luo , Guoting Luo , Guotai Wang , Yi Guo , Feng Xu , Shaoting Zhang

Humans can infer the missing parts of an occluded object by leveraging prior knowledge and visible cues. However, enabling deep learning models to accurately predict such occluded regions remains a challenging task. De-occlusion addresses…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Seung Young Noh , Ju Yong Chang

Recent advances in multimodal large language models (MLLMs) have enabled image-based question-answering capabilities. However, a key limitation is the use of CLIP as the visual encoder; while it can capture coarse global information, it…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Vatsal Agarwal , Matthew Gwilliam , Gefen Kohavi , Eshan Verma , Daniel Ulbricht , Abhinav Shrivastava

Dynamic Novel View Synthesis aims to generate photorealistic views of moving subjects from arbitrary viewpoints. This task is particularly challenging when relying on monocular video, where disentangling structure from motion is ill-posed…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Michal Nazarczuk , Sibi Catley-Chandar , Thomas Tanay , Zhensong Zhang , Gregory Slabaugh , Eduardo Pérez-Pellitero