English
Related papers

Related papers: Improving Diffusion Models for Inverse Problems us…

200 papers

Generative diffusions are a powerful class of Monte Carlo samplers that leverage bridging Markov processes to approximate complex, high-dimensional distributions, such as those found in image processing and language models. Despite their…

Machine Learning · Statistics 2025-02-20 Zheng Zhao , Ziwei Luo , Jens Sjölund , Thomas B. Schön

Hiding data using neural networks (i.e., neural steganography) has achieved remarkable success across both discriminative classifiers and generative adversarial networks. However, the potential of data hiding in diffusion models remains…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Haoyu Chen , Yunqiao Yang , Nan Zhong , Kede Ma

Diffusion models have shown remarkable empirical success in sampling from rich multi-modal distributions. Their inference relies on numerically solving a certain differential equation. This differential equation cannot be solved in closed…

Machine Learning · Computer Science 2026-01-16 Khashayar Gatmiry , Sitan Chen , Adil Salim

Most existing graph diffusion models have significant bias problems. We observe that the forward diffusion's maximum perturbation distribution in most models deviates from the standard Gaussian distribution, while reverse sampling…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Meng Yu , Kun Zhan

Diffusion models have emerged as powerful learned priors for solving inverse problems. However, current iterative solving approaches which alternate between diffusion sampling and data consistency steps typically require hundreds or…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Minwoo Kim , Hongki Lim

Diffusion models have become emerging generative models. Their sampling process involves multiple steps, and in each step the models predict the noise from a noisy sample. When the models make prediction, the output deviates from the ground…

Machine Learning · Computer Science 2025-10-28 Shifeng Xu , Yanzhu Liu , Adams Wai-Kin Kong

Diffusion and flow-based models have enabled significant progress in generation tasks across various modalities and have recently found applications in predictive learning. However, unlike typical generation tasks that encourage sample…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yu Zhang , Xingzhuo Guo , Haoran Xu , Jialong Wu , Mingsheng Long

In this paper we describe a novel framework for diffusion-based generative modeling on constrained spaces. In particular, we introduce manual bridges, a framework that expands the kinds of constraints that can be practically used to form…

Machine Learning · Computer Science 2025-02-28 Saeid Naderiparizi , Xiaoxuan Liang , Berend Zwartsenberg , Frank Wood

Part of the success of diffusion models stems from their ability to perform iterative refinement, i.e., repeatedly correcting outputs during generation. However, modern masked discrete diffusion lacks this capability: when a token is…

Machine Learning · Computer Science 2026-02-10 Guanghan Wang , Yair Schiff , Subham Sekhar Sahoo , Volodymyr Kuleshov

Diffusion models have recently emerged as powerful priors for solving inverse problems. While computed tomography (CT) is theoretically a linear inverse problem, it poses many practical challenges. These include correlated noise, artifact…

Image and Video Processing · Electrical Eng. & Systems 2026-02-24 Jiayang Shi , Daniel M. Pelt , K. Joost Batenburg

This work addresses image restoration tasks through the lens of inverse problems using unpaired datasets. In contrast to traditional approaches -- which typically assume full knowledge of the forward model or access to paired degraded and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Giacomo Meanti , Thomas Ryckeboer , Michael Arbel , Julien Mairal

Score Distillation Sampling (SDS) has been pivotal for leveraging pre-trained diffusion models in downstream tasks such as inverse problems, but it faces two major challenges: $(i)$ mode collapse and $(ii)$ latent space inversion, which…

Machine Learning · Computer Science 2024-10-15 Nicolas Zilberstein , Morteza Mardani , Santiago Segarra

We consider the inverse problem of estimating parameters of a driven diffusion (e.g., the underlying fluid flow, diffusion coefficient, or source terms) from point measurements of a passive scalar (e.g., the concentration of a pollutant).…

Numerical Analysis · Mathematics 2019-05-22 Jeff Borggaard , Nathan E. Glatt-Holtz , Justin A. Krometis

Using image models naively for solving inverse video problems often suffers from flickering, texture-sticking, and temporal inconsistency in generated videos. To tackle these problems, in this paper, we view frames as continuous functions…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Giannis Daras , Weili Nie , Karsten Kreis , Alex Dimakis , Morteza Mardani , Nikola Borislavov Kovachki , Arash Vahdat

Large denoising diffusion models, such as Stable Diffusion, have been trained on billions of image-caption pairs to perform text-conditioned image generation. As a byproduct of this training, these models have acquired general knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Alexandros Graikos , Nebojsa Jojic , Dimitris Samaras

Discrete diffusion models are a class of generative models that construct sequences by progressively denoising samples from a categorical noise distribution. Beyond their rapidly growing ability to generate coherent natural language, these…

Computation and Language · Computer Science 2025-12-11 Michael Cardei , Jacob K Christopher , Thomas Hartvigsen , Bhavya Kailkhura , Ferdinando Fioretto

We found that enforcing guidance throughout the sampling process is often counterproductive due to the model-fitting issue, where samples are 'tuned' to match the classifier's parameters rather than generalizing the expected condition. This…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Anh-Dung Dinh , Daochang Liu , Chang Xu

Conventional inverse optimization inputs a solution and finds the parameters of an optimization model that render a given solution optimal. The literature mostly focuses on inferring the objective function in linear problems when accepted…

Optimization and Control · Mathematics 2024-10-10 Houra Mahmoudzadeh , Kimia Ghobadi

Generative models are powerful tools for sampling from a learned distribution $\mathcal{P}(Y \mid X)$, and inverse-design methods invert this map to find an input $x$ that produces a desired point output $y^*$. However, many design goals…

Machine Learning · Computer Science 2026-05-12 Ori Meidler , Shaul Tolkovsky , Or Zuk

Score-based diffusion models achieve state-of-the-art performance for inverse problems, but their practical deployment is hindered by long inference times and cumbersome hyperparameter tuning. While pretrained diffusion models can be reused…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Julio Oscanoa , Irmak Sivgin , Cagan Alkan , Daniel Ennis , John Pauly , Mert Pilanci , Shreyas Vasanawala