English
Related papers

Related papers: Score-based sampling without diffusions: Guidance …

200 papers

Accurate imputation is essential for the reliability and success of downstream tasks. Recently, diffusion models have attracted great attention in this field. However, these models neglect the latent distribution in a lower-dimensional…

Machine Learning · Computer Science 2024-09-16 Guojun Liang , Najmeh Abiri , Atiye Sadat Hashemi , Jens Lundström , Stefan Byttner , Prayag Tiwari

We study zero-shot conditional sampling with pretrained diffusion models for linear inverse problems, including inpainting and super-resolution. In these problems, the observation determines only part of the unknown signal. The remaining…

Machine Learning · Computer Science 2026-05-08 Ahmad Aghapour , Erhan Bayraktar , Asaf Cohen

We study the problem of training diffusion and flow generative models to sample from target distributions defined by an exponential tilting of a base density; a formulation that subsumes both sampling from unnormalized densities and reward…

Machine Learning · Statistics 2026-05-04 Carles Domingo-Enrich , Yuanqi Du , Michael S. Albergo

We study the theoretical foundations of composition in diffusion models, with a particular focus on out-of-distribution extrapolation and length-generalization. Prior work has shown that composing distributions via linear score combination…

Machine Learning · Computer Science 2025-09-29 Arwen Bradley , Preetum Nakkiran , David Berthelot , James Thornton , Joshua M. Susskind

This study introduces a training-free conditional diffusion model for learning unknown stochastic differential equations (SDEs) using data. The proposed approach addresses key challenges in computational efficiency and accuracy for modeling…

Machine Learning · Computer Science 2024-10-07 Yanfang Liu , Yuan Chen , Dongbin Xiu , Guannan Zhang

Score-based diffusion models (SDMs) have emerged as a powerful tool for sampling from the posterior distribution in Bayesian inverse problems. However, existing methods often require multiple evaluations of the forward mapping to generate a…

Machine Learning · Statistics 2026-05-07 Fabian Schneider , Duc-Lam Duong , Matti Lassas , Maarten V. de Hoop , Tapio Helin

Recently, diffusion models have been used to solve various inverse problems in an unsupervised manner with appropriate modifications to the sampling process. However, the current solvers, which recursively apply a reverse diffusion step…

Machine Learning · Computer Science 2024-05-21 Hyungjin Chung , Byeongsu Sim , Dohoon Ryu , Jong Chul Ye

Strongly log-concave (SLC) distributions are a rich class of discrete probability distributions over subsets of some ground set. They are strictly more general than strongly Rayleigh (SR) distributions such as the well-known determinantal…

Machine Learning · Computer Science 2019-06-14 Joshua Robinson , Suvrit Sra , Stefanie Jegelka

Image deblurring is an ill-posed problem with multiple plausible solutions for a given input image. However, most existing methods produce a deterministic estimate of the clean image and are trained to minimize pixel-level distortion. These…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Jay Whang , Mauricio Delbracio , Hossein Talebi , Chitwan Saharia , Alexandros G. Dimakis , Peyman Milanfar

Discrete-time diffusion-based generative models and score matching methods have shown promising results in modeling high-dimensional image data. Recently, Song et al. (2021) show that diffusion processes that transform data into noise can…

Machine Learning · Computer Science 2021-10-01 Chin-Wei Huang , Jae Hyun Lim , Aaron Courville

Modelling partial differential equations (PDEs) is of crucial importance in science and engineering, and it includes tasks ranging from forecasting to inverse problems, such as data assimilation. However, most previous numerical and machine…

Training-free diffusion guidance offers a flexible framework for leveraging off-the-shelf classifiers without additional training. Yet, current approaches hinge on posterior approximations via Tweedie's formula, which often yield unreliable…

Machine Learning · Computer Science 2026-05-19 Van Khoa Nguyen , Lionel Blondé , Alexandros Kalousis

Sampling from a distribution $p(x) \propto e^{-\mathcal{E}(x)}$ known up to a normalising constant is an important and challenging problem in statistics. Recent years have seen the rise of a new family of amortised sampling algorithms,…

Machine Learning · Computer Science 2026-05-29 Arran Carter , Sanghyeok Choi , Kirill Tamogashev , Víctor Elvira , Esmeralda S. Whitammer

Diffusion models have recently demonstrated an impressive ability to address inverse problems in an unsupervised manner. While existing methods primarily focus on modifying the posterior sampling process, the potential of the forward…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Gongye Liu , Haoze Sun , Jiayi Li , Fei Yin , Yujiu Yang

Score-based generative modeling, implemented through probability flow ODEs, has shown impressive results in numerous practical settings. However, most convergence guarantees rely on restrictive regularity assumptions on the target…

Machine Learning · Statistics 2025-10-21 Gitte Kremling , Francesco Iafrate , Mahsa Taheri , Johannes Lederer

While working within the spatial domain can pose problems associated with ill-conditioned scores caused by power-law decay, recent advances in diffusion-based generative models have shown that transitioning to the wavelet domain offers a…

Artificial Intelligence · Computer Science 2024-11-15 Xiongye Xiao , Shixuan Li , Luzhe Huang , Gengshuo Liu , Trung-Kien Nguyen , Yi Huang , Di Chang , Mykel J. Kochenderfer , Paul Bogdan

Sampling from score-based diffusion models incurs bias due to both time discretisation and the approximation of the score function. A common strategy for reducing this bias is to apply corrector steps based on the unadjusted Langevin…

Machine Learning · Statistics 2026-05-12 Kevin H. Lam , Tyler Farghly , Christopher Williams , Jun Yang , Yee Whye Teh , Arnaud Doucet

Score-based generative models have demonstrated significant practical success in data-generating tasks. The models establish a diffusion process that perturbs the ground truth data to Gaussian noise and then learn the reverse process to…

Machine Learning · Computer Science 2024-05-24 Ziqing Wen , Xiaoge Deng , Ping Luo , Tao Sun , Dongsheng Li

Recent advances in diffusion models bring state-of-the-art performance on image generation tasks. However, empirical results from previous research in diffusion models imply an inverse correlation between density estimation and sample…

Machine Learning · Computer Science 2022-06-14 Dongjun Kim , Seungjae Shin , Kyungwoo Song , Wanmo Kang , Il-Chul Moon

Score-based diffusion models demonstrate superior performance in generative tasks but encounter fundamental bottlenecks in inverse problems due to the analytical intractability of the time-dependent likelihood score. To bridge this gap, we…

Optimization and Control · Mathematics 2026-05-28 Boyang Zhang , Zhiguo Wang , Ya-Feng Liu