English
Related papers

Related papers: Local Patches Meet Global Context: Scalable 3D Dif…

200 papers

This paper presents a novel method for building scalable 3D generative models utilizing pre-trained video diffusion models. The primary obstacle in developing foundation 3D generative models is the limited availability of 3D data. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Junlin Han , Filippos Kokkinos , Philip Torr

We propose Diff-Shadow, a global-guided diffusion model for shadow removal. Previous transformer-based approaches can utilize global information to relate shadow and non-shadow regions but are limited in their synthesis ability and recover…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Jinting Luo , Ru Li , Chengzhi Jiang , Xiaoming Zhang , Mingyan Han , Ting Jiang , Haoqiang Fan , Shuaicheng Liu

Diffusion-based sparse-view CT (SVCT) imaging has achieved remarkable advancements in recent years, thanks to its more stable generative capability. However, recovering reliable image content and visually consistent textures is still a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Tianqi Wang , Wenchao Du , Hongyu Yang

Diffusion models have recently achieved significant success in various image manipulation tasks, including image super-resolution and perceptual quality enhancement. Pretrained text-to-image models, such as Stable Diffusion, have exhibited…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Sanchar Palit , Subhasis Chaudhuri , Biplab Banerjee

The use of supervised deep learning techniques to detect pathologies in brain MRI scans can be challenging due to the diversity of brain anatomy and the need for annotated data sets. An alternative approach is to use unsupervised anomaly…

Image and Video Processing · Electrical Eng. & Systems 2023-03-08 Finn Behrendt , Debayan Bhattacharya , Julia Krüger , Roland Opfer , Alexander Schlaefer

Diffusion models have achieved significant success in both natural image and medical image domains, encompassing a wide range of applications. Previous investigations in medical images have often been constrained to specific anatomical…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Yongrui Yu , Yannian Gu , Shaoting Zhang , Xiaofan Zhang

We propose an efficient approach to train large diffusion models with masked transformers. While masked transformers have been extensively explored for representation learning, their application to generative learning is less explored in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Hongkai Zheng , Weili Nie , Arash Vahdat , Anima Anandkumar

The reconstruction of X-rays CT images from sparse or limited-angle geometries is a highly challenging task. The lack of data typically results in artifacts in the reconstructed image and may even lead to object distortions. For this…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Davide Evangelista , Pasquale Cascarano , Elena Loli Piccolomini

Diffusion models currently achieve state-of-the-art performance for both conditional and unconditional image generation. However, so far, image diffusion models do not support tasks required for 3D understanding, such as view-consistent 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Titas Anciukevičius , Zexiang Xu , Matthew Fisher , Paul Henderson , Hakan Bilen , Niloy J. Mitra , Paul Guerrero

Diffusion models (DMs) have recently been introduced as a regularizing prior for PET image reconstruction, integrating DMs trained on high-quality PET images with unsupervised schemes that condition on measured data. While these approaches…

Medical Physics · Physics 2026-03-18 George Webber , Alexander Hammers , Andrew P King , Andrew J Reader

Computed Tomography (CT) is widely used in healthcare for detailed imaging. However, Low-dose CT, despite reducing radiation exposure, often results in images with compromised quality due to increased noise. Traditional methods, including…

Image and Video Processing · Electrical Eng. & Systems 2024-09-17 Herman Verinaz-Jadan , Su Yan

Recent works on text-to-3d generation show that using only 2D diffusion supervision for 3D generation tends to produce results with inconsistent appearances (e.g., faces on the back view) and inaccurate shapes (e.g., animals with extra…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Cheng Chen , Xiaofeng Yang , Fan Yang , Chengzeng Feng , Zhoujie Fu , Chuan-Sheng Foo , Guosheng Lin , Fayao Liu

Model-based learned iterative reconstruction methods have recently been shown to outperform classical reconstruction algorithms. Applicability of these methods to large scale inverse problems is however limited by the available memory for…

Image and Video Processing · Electrical Eng. & Systems 2020-04-21 Andreas Hauptmann , Jonas Adler , Simon Arridge , Ozan Öktem

Blind face restoration endeavors to restore a clear face image from a degraded counterpart. Recent approaches employing Generative Adversarial Networks (GANs) as priors have demonstrated remarkable success in this field. However, these…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Xiaobin Lu , Xiaobin Hu , Jun Luo , Ben Zhu , Yaping Ruan , Wenqi Ren

Diffusion models have emerged as powerful priors for solving inverse problems in computed tomography (CT). In certain applications, such as neutron CT, it can be expensive to collect large amounts of measurements even for a single scan,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Timofey Efimov , Singanallur Venkatakrishnan , Maliha Hossain , Haley Duba-Sullivan , Amirkoushyar Ziabari

Signal reconstruction is a challenging aspect of computational imaging as it often involves solving ill-posed inverse problems. Recently, deep feed-forward neural networks have led to state-of-the-art results in solving various inverse…

Computer Vision and Pattern Recognition · Computer Science 2018-04-25 Akshat Dave , Anil Kumar Vadathya , Ramana Subramanyam , Rahul Baburajan , Kaushik Mitra

Diffusion models, as powerful generative models, have found a wide range of applications and shown great potential in solving image reconstruction problems. Some works attempted to solve MRI reconstruction with diffusion models, but these…

Image and Video Processing · Electrical Eng. & Systems 2025-06-09 Xingjian Tang , Jingwei Guan , Linge Li , Ran Shi , Youmei Zhang , Mengye Lyu , Li Yan

Reducing scan times, radiation dose, and enhancing image quality for lower-performance scanners, are critical in low-dose PET imaging. Deep learning techniques have been investigated for PET image denoising. However, existing models have…

Deep learning-based 3D imaging, in particular magnetic resonance imaging (MRI), is challenging because of limited availability of 3D training data. Therefore, 2D diffusion models trained on 2D slices are starting to be leveraged for 3D MRI…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Anselm Krainovic , Stefan Ruschke , Reinhard Heckel

We propose a novel image editing technique that enables 3D manipulations on single images, such as object rotation and translation. Existing 3D-aware image editing approaches typically rely on synthetic multi-view datasets for training…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Ruicheng Wang , Jianfeng Xiang , Jiaolong Yang , Xin Tong