English
Related papers

Related papers: Prototype Clustered Diffusion Models for Versatile…

200 papers

In image processing, solving inverse problems is the task of finding plausible reconstructions of an image that was corrupted by some (usually known) degradation operator. Commonly, this process is done using a generative image model that…

Image and Video Processing · Electrical Eng. & Systems 2025-08-22 Idan Achituve , Hai Victor Habi , Amir Rosenfeld , Arnon Netzer , Idit Diamant , Ethan Fetaya

Current deep learning-based solutions for image analysis tasks are commonly incapable of handling problems to which multiple different plausible solutions exist. In response, posterior-based methods such as conditional Diffusion Models and…

We present an novel framework for efficiently and effectively extending the powerful continuous diffusion processes to discrete modeling. Previous approaches have suffered from the discrepancy between discrete data and continuous modeling.…

Machine Learning · Computer Science 2024-10-31 Yuxuan Gu , Xiaocheng Feng , Lei Huang , Yingsheng Wu , Zekun Zhou , Weihong Zhong , Kun Zhu , Bing Qin

Classifier-guided diffusion models have emerged as a powerful approach for conditional image generation, but they suffer from overconfident predictions during early denoising steps, causing the guidance gradient to vanish. This paper…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Seyed Alireza Javid , Amirhossein Bagheri , Nuria González-Prelcic

Inferring seabed topography from wave height observations is fundamental to tsunami hazard assessment, coastal planning, and large scale ocean circulation modeling. Classical inversion models typically rely on direct sensing or optimization…

Atmospheric and Oceanic Physics · Physics 2025-09-03 Aoming Liang , Qi Liu , Weicheng Cui

Pretrained diffusion models have demonstrated strong capabilities in zero-shot inverse problem solving by incorporating observation information into the generation process of the diffusion models. However, this presents an inherent dilemma:…

Machine Learning · Computer Science 2026-05-05 Xun Su , Hiroyuki Kasai

We study a new family of inverse problems for recovering representations of corrupted data. We assume access to a pre-trained representation learning network R(x) that operates on clean images, like CLIP. The problem is to recover the…

Machine Learning · Computer Science 2021-10-28 Sriram Ravula , Georgios Smyrnis , Matt Jordan , Alexandros G. Dimakis

Recovering high-dimensional statistical structure from limited measurements is a fundamental challenge in hyperspectral imaging, where capturing full-resolution data is often infeasible due to sensor, bandwidth, or acquisition constraints.…

Image and Video Processing · Electrical Eng. & Systems 2025-08-01 Jonathan Monsalve , Kumar Vijay Mishra

We consider the inverse problem of reconstructing an effective model for a prototypical diffusion process in strongly heterogeneous media based on coarse measurements. The approach is motivated by quasi-local numerical effective forward…

Numerical Analysis · Mathematics 2020-05-05 Alfonso Caiazzo , Roland Maier , Daniel Peterseim

Diffusion models have indeed shown great promise in solving inverse problems in image processing. In this paper, we propose a novel, problem-agnostic diffusion model called the maximum a posteriori (MAP)-based guided term estimation method…

Image and Video Processing · Electrical Eng. & Systems 2026-03-10 Pingping Tao , Haixia Liu , Jing Su

Diffusion models have achieved remarkable progress in universal image restoration. While existing methods speed up inference by reducing sampling steps, substantial step intervals often introduce cumulative errors. Moreover, they struggle…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Hebaixu Wang , Jing Zhang , Haonan Guo , Di Wang , Jiayi Ma , Bo Du

Model-based reinforcement learning methods often use learning only for the purpose of estimating an approximate dynamics model, offloading the rest of the decision-making work to classical trajectory optimizers. While conceptually simple,…

Machine Learning · Computer Science 2022-12-22 Michael Janner , Yilun Du , Joshua B. Tenenbaum , Sergey Levine

As a dominant force in text-to-image generation tasks, Diffusion Probabilistic Models (DPMs) face a critical challenge in controllability, struggling to adhere strictly to complex, multi-faceted instructions. In this work, we aim to address…

Machine Learning · Computer Science 2024-02-27 Xuantong Liu , Tianyang Hu , Wenjia Wang , Kenji Kawaguchi , Yuan Yao

Diffusion models have emerged as powerful learned priors for solving inverse problems. However, current iterative solving approaches which alternate between diffusion sampling and data consistency steps typically require hundreds or…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Minwoo Kim , Hongki Lim

Bayesian inference for inverse problems hinges critically on the choice of priors. In the absence of specific prior information, population-level distributions can serve as effective priors for parameters of interest. With the advent of…

Instrumentation and Methods for Astrophysics · Physics 2025-02-11 Gabriel Missael Barco , Alexandre Adam , Connor Stone , Yashar Hezaveh , Laurence Perreault-Levasseur

Diffusion models have shown remarkable potential in planning and control tasks due to their ability to represent multimodal distributions over actions and trajectories. However, ensuring safety under constraints remains a critical challenge…

Systems and Control · Electrical Eng. & Systems 2025-06-17 Jichen Zhang , Liqun Zhao , Antonis Papachristodoulou , Jack Umenberger

Since their introduction, diffusion models have quickly become the prevailing approach to generative modeling in many domains. They can be interpreted as learning the gradients of a time-varying sequence of log-probability density…

Diffusion probabilistic models (DPMs) have emerged as a promising technique in generative modeling. The success of DPMs relies on two ingredients: time reversal of diffusion processes and score matching. In view of possibly unguaranteed…

Machine Learning · Computer Science 2024-10-15 Wenpin Tang , Hanyang Zhao

The choice of prior is central to solving ill-posed imaging inverse problems, making it essential to select one consistent with the measurements $y$ to avoid severe bias. In Bayesian inverse problems, this could be achieved by evaluating…

Machine Learning · Computer Science 2026-05-01 Frederic Wang , Katherine L. Bouman

Diffusion models can be used as learned priors for solving various inverse problems. However, most existing approaches are restricted to linear inverse problems, limiting their applicability to more general cases. In this paper, we build…

Image and Video Processing · Electrical Eng. & Systems 2022-11-28 Bahjat Kawar , Jiaming Song , Stefano Ermon , Michael Elad