English
Related papers

Related papers: Parallel Diffusion Models of Operator and Image fo…

200 papers

Diffusion models have made remarkable progress in solving various inverse problems, attributing to the generative modeling capability of the data manifold. Posterior sampling from the conditional score function enable the precious data…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Jinghao Zhang , Zizheng Yang , Qi Zhu , Feng Zhao

Inverse problems have many applications in science and engineering. In Computer vision, several image restoration tasks such as inpainting, deblurring, and super-resolution can be formally modeled as inverse problems. Recently, methods have…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Sai Bharath Chandra Gutha , Ricardo Vinuesa , Hossein Azizpour

Inverse rendering, the process of inferring scene properties from images, is a challenging inverse problem. The task is ill-posed, as many different scene configurations can give rise to the same image. Most existing solutions incorporate…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Linjie Lyu , Ayush Tewari , Marc Habermann , Shunsuke Saito , Michael Zollhöfer , Thomas Leimkühler , Christian Theobalt

Two of the main challenges of image restoration in real-world scenarios are the accurate characterization of an image prior and the precise modeling of the image degradation operator. Pre-trained diffusion models have been very successfully…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Hamadi Chihaoui , Paolo Favaro

Blind image restoration remains a significant challenge in low-level vision tasks. Recently, denoising diffusion models have shown remarkable performance in image synthesis. Guided diffusion models, leveraging the potent generative priors…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Jun Xiao , Zihang Lyu , Hao Xie , Cong Zhang , Yakun Ju , Changjian Shui , Kin-Man Lam

Diffusion models have recently emerged as powerful generative priors for solving inverse problems. However, training diffusion models in the pixel space are both data-intensive and computationally demanding, which restricts their…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Bowen Song , Soo Min Kwon , Zecheng Zhang , Xinyu Hu , Qing Qu , Liyue Shen

Pre-trained diffusion models have been successfully used as priors in a variety of linear inverse problems, where the goal is to reconstruct a signal from noisy linear measurements. However, existing approaches require knowledge of the…

Machine Learning · Computer Science 2023-06-28 Naoki Murata , Koichi Saito , Chieh-Hsin Lai , Yuhta Takida , Toshimitsu Uesaka , Yuki Mitsufuji , Stefano Ermon

Recently it has been shown that using diffusion models for inverse problems can lead to remarkable results. However, these approaches require a closed-form expression of the degradation model and can not support complex degradations. To…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Di You , Andreas Floros , Pier Luigi Dragotti

Inverse design problems are common in engineering and materials science. The forward direction, i.e., computing output quantities from design parameters, typically requires running a numerical simulation, such as a FEM, as an intermediate…

Machine Learning · Computer Science 2026-02-18 Jens U. Kreber , Christian Weißenfels , Joerg Stueckler

This paper considers blind inverse image restoration, the task of predicting a target image from a degraded source when the degradation (i.e. the forward operator) is unknown. Existing solutions typically rely on restrictive assumptions…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Michail Dontas , Yutong He , Naoki Murata , Yuki Mitsufuji , J. Zico Kolter , Ruslan Salakhutdinov

Ill-posed inverse problems are fundamental in many domains, ranging from astrophysics to medical imaging. Emerging diffusion models provide a powerful prior for solving these problems. Existing maximum-a-posteriori (MAP) or posterior…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Minseo Kim , Axel Levy , Gordon Wetzstein

Diffusion models have recently gained traction as a powerful class of deep generative priors, excelling in a wide range of image restoration tasks due to their exceptional ability to model data distributions. To solve image restoration…

Image and Video Processing · Electrical Eng. & Systems 2025-06-10 Xiang Li , Soo Min Kwon , Shijun Liang , Ismail R. Alkhouri , Saiprasad Ravishankar , Qing Qu

Diffusion models have been used as priors for solving inverse problems. However, existing approaches typically overlook side information that could significantly improve reconstruction quality, especially in severely ill-posed settings. In…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Mahdi Farahbakhsh , Vishnu Teja Kunde , Dileep Kalathil , Krishna Narayanan , Jean-Francois Chamberland

Recently, diffusion models have been used to solve various inverse problems in an unsupervised manner with appropriate modifications to the sampling process. However, the current solvers, which recursively apply a reverse diffusion step…

Machine Learning · Computer Science 2024-05-21 Hyungjin Chung , Byeongsu Sim , Dohoon Ryu , Jong Chul Ye

Diffusion models have been recently studied as powerful generative inverse problem solvers, owing to their high quality reconstructions and the ease of combining existing iterative solvers. However, most works focus on solving simple linear…

Machine Learning · Statistics 2025-10-06 Hyungjin Chung , Jeongsol Kim , Michael T. Mccann , Marc L. Klasky , Jong Chul Ye

Optical imaging systems are inherently imperfect due to diffraction limits, lens manufacturing tolerances, assembly misalignment, and other physical constraints. In addition, unavoidable camera shake and object motion further introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Yanlong Yang , Guanxiong Luo

Diffusion models have shown significant progress in image translation tasks recently. However, due to their stochastic nature, there's often a trade-off between style transformation and content preservation. Current strategies aim to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-08 Gihyun Kwon , Jong Chul Ye

Previously, non-autoregressive models were widely perceived as being superior in generation efficiency but inferior in generation quality due to the difficulties of modeling multiple target modalities. To enhance the multi-modality modeling…

Computation and Language · Computer Science 2023-11-30 Lihua Qian , Mingxuan Wang , Yang Liu , Hao Zhou

Consistent improvement of image priors over the years has led to the development of better inverse problem solvers. Diffusion models are the newcomers to this arena, posing the strongest known prior to date. Recently, such models operating…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Ron Raphaeli , Sean Man , Michael Elad

Generative diffusion models are becoming one of the most popular prior in image restoration (IR) tasks due to their remarkable ability to generate realistic natural images. Despite achieving satisfactory results, IR methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Di You , Pier Luigi Dragotti