English
Related papers

Related papers: Improving 2D Diffusion Models for 3D Medical Imagi…

200 papers

Diffusion models with continuous stochastic differential equations (SDEs) have shown superior performances in image generation. It can serve as a deep generative prior to solving the inverse problem in magnetic resonance (MR)…

Image and Video Processing · Electrical Eng. & Systems 2024-01-23 Chentao Cao , Zhuo-Xu Cui , Yue Wang , Shaonan Liu , Taijin Chen , Hairong Zheng , Dong Liang , Yanjie Zhu

Background. Fully automatic analysis of myocardial perfusion MRI datasets enables rapid and objective reporting of stress/rest studies in patients with suspected ischemic heart disease. Developing deep learning techniques that can analyze…

This paper proposes ConsistDreamer - a novel framework that lifts 2D diffusion models with 3D awareness and 3D consistency, thus enabling high-fidelity instruction-guided scene editing. To overcome the fundamental limitation of missing 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Jun-Kun Chen , Samuel Rota Bulò , Norman Müller , Lorenzo Porzi , Peter Kontschieder , Yu-Xiong Wang

Recent advances in computer vision have shown promising results in image generation. Diffusion probabilistic models in particular have generated realistic images from textual input, as demonstrated by DALL-E 2, Imagen and Stable Diffusion.…

Diffusion models (DMs) have become the dominant paradigm of generative modeling in a variety of domains by learning stochastic processes from noise to data. Recently, diffusion denoising bridge models (DDBMs), a new formulation of…

Machine Learning · Computer Science 2024-11-01 Guande He , Kaiwen Zheng , Jianfei Chen , Fan Bao , Jun Zhu

While achieving remarkable success for medical image segmentation, deep convolution neural networks (DCNNs) often fail to maintain their robustness when confronting test data with the novel distribution. To address such a drawback, the…

Image and Video Processing · Electrical Eng. & Systems 2022-05-09 Yuxin Kang , Hansheng Li , Xuan Zhao , Dongqing Hu , Feihong Liu , Lei Cui , Jun Feng , Lin Yang

Denoising diffusion models have emerged as the go-to generative framework for solving inverse problems in imaging. A critical concern regarding these models is their performance on out-of-distribution tasks, which remains an under-explored…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Riccardo Barbano , Alexander Denker , Hyungjin Chung , Tae Hoon Roh , Simon Arridge , Peter Maass , Bangti Jin , Jong Chul Ye

3D content creation via text-driven stylization has played a fundamental challenge to multimedia and graphics community. Recent advances of cross-modal foundation models (e.g., CLIP) have made this problem feasible. Those approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Haibo Yang , Yang Chen , Yingwei Pan , Ting Yao , Zhineng Chen , Tao Mei

Diffusion models have demonstrated their effectiveness across various generative tasks. However, when applied to medical image segmentation, these models encounter several challenges, including significant resource and time requirements.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Tianyu Lin , Zhiguang Chen , Zhonghao Yan , Weijiang Yu , Fudan Zheng

Diffusion models are powerful tools for sampling from high-dimensional distributions by progressively transforming pure noise into structured data through a denoising process. When equipped with a guidance mechanism, these models can also…

Machine Learning · Computer Science 2026-05-04 Saeed Mohseni-Sehdeh , Walid Saad , Kei Sakaguchi , Tao Yu

Score distillation sampling (SDS) has proven to be an important tool, enabling the use of large-scale diffusion priors for tasks operating in data-poor domains. Unfortunately, SDS has a number of characteristic artifacts that limit its…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 David McAllister , Songwei Ge , Jia-Bin Huang , David W. Jacobs , Alexei A. Efros , Aleksander Holynski , Angjoo Kanazawa

Score-based diffusion models have shown significant promise in the field of sparse-view CT reconstruction. However, the projection dataset is large and riddled with redundancy. Consequently, applying the diffusion model to unprocessed data…

Image and Video Processing · Electrical Eng. & Systems 2025-05-16 Pengfei Yu , Bin Huang , Minghui Zhang , Weiwen Wu , Shaoyu Wang , Qiegen Liu

High-resolution 3D medical image generation remains challenging because fully volumetric models are computationally expensive, while efficient 2D slice generators often fail to preserve anatomical consistency across the third dimension. We…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Xinhe Zhang , Yuyang Zhang , Pengfei Jin , Arnau Marin-Llobet , Na Li , Quanzheng Li

The scarcity and complexity of voxel-level annotations in 3D medical imaging present significant challenges, particularly due to the domain gap between labeled datasets from well-resourced centers and unlabeled datasets from less-resourced…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Haifan Gong , Yitao Wang , Yihan Wang , Jiashun Xiao , Xiang Wan , Haofeng Li

Magnetic resonance (MR) images collected in 2D scanning protocols typically have large inter-slice spacing, resulting in high in-plane resolution but reduced through-plane resolution. Super-resolution techniques can reduce the inter-slice…

Image and Video Processing · Electrical Eng. & Systems 2023-09-18 Xin Wang , Zhenrong Shen , Zhiyun Song , Sheng Wang , Mengjun Liu , Lichi Zhang , Kai Xuan , Qian Wang

Diffusion models are the current state-of-the-art for solving inverse problems in imaging. Their impressive generative capability allows them to approximate sampling from a prior distribution, which alongside a known likelihood function…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Samuel W. Remedios , Zhangxing Bian , Shuwen Wei , Aaron Carass , Jerry L. Prince , Blake E. Dewey

Computed Tomography (CT) scans are the standard-of-care for the visualization and diagnosis of many clinical ailments, and are needed for the treatment planning of external beam radiotherapy. Unfortunately, the availability of CT scanners…

Image and Video Processing · Electrical Eng. & Systems 2024-08-28 Yiran Sun , Hana Baroudi , Tucker Netherton , Laurence Court , Osama Mawlawi , Ashok Veeraraghavan , Guha Balakrishnan

Diffusion Posterior Sampling (DPS) can be used in Computed Tomography (CT) reconstruction by leveraging diffusion-based generative models for unconditional image synthesis while matching the observations (data) of a CT scan. Of particular…

Monitoring diseases that affect the brain's structural integrity requires automated analysis of magnetic resonance (MR) images, e.g., for the evaluation of volumetric changes. However, many of the evaluation tools are optimized for…

Poor performance of quantitative analysis in histopathological Whole Slide Images (WSI) has been a significant obstacle in clinical practice. Annotating large-scale WSIs manually is a demanding and time-consuming task, unlikely to yield the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Sarah Cechnicka , James Ball , Hadrien Reynaud , Callum Arthurs , Candice Roufosse , Bernhard Kainz