English
Related papers

Related papers: Solving Inverse Problems with Latent Diffusion Mod…

200 papers

Diffusion models have achieved remarkable success in imaging inverse problems owing to their powerful generative capabilities. However, existing approaches typically rely on models trained for specific degradation types, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Zhen Wang , Hongyi Liu , Zhihui Wei

Inverse problems describe the process of estimating the causal factors from a set of measurements or data. Mapping of often incomplete or degraded data to parameters is ill-posed, thus data-driven iterative solutions are required, for…

Artificial Intelligence · Computer Science 2024-06-21 Weitong Zhang , Chengqi Zang , Liu Li , Sarah Cechnicka , Cheng Ouyang , Bernhard Kainz

In image processing, solving inverse problems is the task of finding plausible reconstructions of an image that was corrupted by some (usually known) degradation operator. Commonly, this process is done using a generative image model that…

Image and Video Processing · Electrical Eng. & Systems 2025-08-22 Idan Achituve , Hai Victor Habi , Amir Rosenfeld , Arnon Netzer , Idit Diamant , Ethan Fetaya

This work aims to improve the applicability of diffusion models in realistic image restoration. Specifically, we enhance the diffusion model in several aspects such as network architecture, noise level, denoising steps, training image size,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Ziwei Luo , Fredrik K. Gustafsson , Zheng Zhao , Jens Sjölund , Thomas B. Schön

Diffusion generative models unlock new possibilities for inverse problems as they allow for the incorporation of strong empirical priors in scientific inference. Recently, diffusion models are repurposed for solving inverse problems using…

Diffusion models have become a popular approach for image generation and reconstruction due to their numerous advantages. However, most diffusion-based inverse problem-solving methods only deal with 2D images, and even recently published 3D…

Image and Video Processing · Electrical Eng. & Systems 2023-09-04 Suhyeon Lee , Hyungjin Chung , Minyoung Park , Jonghyuk Park , Wi-Sun Ryu , Jong Chul Ye

Generative diffusion models can provide powerful prior probability models for inverse problems in imaging, but existing implementations suffer from two key limitations: $(i)$ the prior density is represented implicitly, and $(ii)$ they rely…

Machine Learning · Computer Science 2026-05-19 Nicolas Zilberstein , Santiago Segarra , Eero Simoncelli , Florentin Guth

Diffusion models have shown an impressive ability to model complex data distributions, with several key advantages over GANs, such as stable training, better coverage of the training distribution's modes, and the ability to solve inverse…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Yinbo Chen , Oliver Wang , Richard Zhang , Eli Shechtman , Xiaolong Wang , Michael Gharbi

Recently, diffusion model-based inverse problem solvers (DIS) have emerged as state-of-the-art approaches for addressing inverse problems, including image super-resolution, deblurring, inpainting, etc. However, their application to video…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Taesung Kwon , Jong Chul Ye

Pretrained diffusion models have demonstrated strong capabilities in zero-shot inverse problem solving by incorporating observation information into the generation process of the diffusion models. However, this presents an inherent dilemma:…

Machine Learning · Computer Science 2026-05-05 Xun Su , Hiroyuki Kasai

Image harmonization, which involves adjusting the foreground of a composite image to attain a unified visual consistency with the background, can be conceptualized as an image-to-image translation task. Diffusion models have recently…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Pengfei Zhou , Fangxiang Feng , Xiaojie Wang

Diffusion models have achieved excellent success in solving inverse problems due to their ability to learn strong image priors, but existing approaches require a large training dataset of images that should come from the same distribution…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Jason Hu , Bowen Song , Jeffrey A. Fessler , Liyue Shen

In this paper, we propose a novel framework for solving high-definition video inverse problems using latent image diffusion models. Building on recent advancements in spatio-temporal optimization for video inverse problems using image…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Taesung Kwon , Jong Chul Ye

Image restoration aims to recover high-quality images from degraded observations. When the degradation process is known, the recovery problem can be formulated as an inverse problem, and in a Bayesian context, the goal is to sample a clean…

Image and Video Processing · Electrical Eng. & Systems 2025-10-13 Darshan Thaker , Abhishek Goyal , René Vidal

Inverse problems have many applications in science and engineering. In Computer vision, several image restoration tasks such as inpainting, deblurring, and super-resolution can be formally modeled as inverse problems. Recently, methods have…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Sai Bharath Chandra Gutha , Ricardo Vinuesa , Hossein Azizpour

The inverse problem of backward diffusion is known to be ill-posed and highly unstable. Backward diffusion processes appear naturally in image enhancement and deblurring applications. It is therefore greatly desirable to establish a…

Numerical Analysis · Mathematics 2020-06-18 Leif Bergerhoff , Marcelo Cárdenas , Joachim Weickert , Martin Welk

Latent Diffusion models (LDMs) have achieved remarkable results in synthesizing high-resolution images. However, the iterative sampling process is computationally intensive and leads to slow generation. Inspired by Consistency Models (song…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Simian Luo , Yiqin Tan , Longbo Huang , Jian Li , Hang Zhao

Diffusion models have shown strong performances in solving inverse problems through posterior sampling while they suffer from errors during earlier steps. To mitigate this issue, several Decoupled Posterior Sampling methods have been…

Machine Learning · Computer Science 2025-04-15 Zhi Qi , Shihong Yuan , Yulin Yuan , Linling Kuang , Yoshiyuki Kabashima , Xiangming Meng

Using image models naively for solving inverse video problems often suffers from flickering, texture-sticking, and temporal inconsistency in generated videos. To tackle these problems, in this paper, we view frames as continuous functions…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Giannis Daras , Weili Nie , Karsten Kreis , Alex Dimakis , Morteza Mardani , Nikola Borislavov Kovachki , Arash Vahdat

Recovering high-dimensional statistical structure from limited measurements is a fundamental challenge in hyperspectral imaging, where capturing full-resolution data is often infeasible due to sensor, bandwidth, or acquisition constraints.…

Image and Video Processing · Electrical Eng. & Systems 2025-08-01 Jonathan Monsalve , Kumar Vijay Mishra