English
Related papers

Related papers: Improved sampling via learned diffusions

200 papers

Generating samples from a probability distribution is a fundamental task in machine learning and statistics. This article proposes a novel scheme for sampling from a distribution for which the probability density $\mu({\bf x})$ for ${\bf…

Computation · Statistics 2024-05-22 Hanwen Huang

Diffusion models generate samples through an iterative denoising process, guided by a neural network. While training the denoiser on real-world data is computationally demanding, the sampling procedure itself is more flexible. This…

Machine Learning · Computer Science 2026-02-10 Constant Bourdrez , Alexandre Vérine , Olivier Cappé

Normalizing flows are a popular class of models for approximating probability distributions. However, their invertible nature limits their ability to model target distributions whose support have a complex topological structure, such as…

Machine Learning · Statistics 2022-02-25 Vincent Stimper , Bernhard Schölkopf , José Miguel Hernández-Lobato

We consider the problem of simulating diffusion bridges, which are diffusion processes that are conditioned to initialize and terminate at two given states. The simulation of diffusion bridges has applications in diverse scientific fields…

Computation · Statistics 2025-06-19 Jeremy Heng , Valentin De Bortoli , Arnaud Doucet , James Thornton

At the core of modern generative modeling frameworks, including diffusion models, score-based models, and flow matching, is the task of transforming a simple prior distribution into a complex target distribution through stochastic paths in…

Machine Learning · Computer Science 2026-03-20 Sophia Tang

Flow matching and diffusion bridge models have emerged as leading paradigms in generative speech enhancement, modeling stochastic processes between paired noisy and clean speech signals based on principles such as flow matching, score…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-23 Dahan Wang , Jun Gao , Tong Lei , Yuxiang Hu , Changbao Zhu , Kai Chen , Jing Lu

Diffusion models demonstrate remarkable capabilities in capturing complex data distributions and have achieved compelling results in many generative tasks. While they have recently been extended to dense prediction tasks such as depth…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Haorui Ji , Taojun Lin , Hongdong Li

We derive a new theoretical interpretation of the reweighted losses that are widely used for training diffusion models. Our method is based on constructing a cascade of time-dependent variational lower bounds on the data log-likelihood,…

Machine Learning · Computer Science 2025-11-26 Jiaxin Shi , Michalis K. Titsias

Transfer Learning aims to optimally aggregate samples from a target distribution, with related samples from a so-called source distribution to improve target risk. Multiple procedures have been proposed over the last two decades to address…

Machine Learning · Statistics 2025-04-29 Steve Hanneke , Samory Kpotufe

Generative diffusion models use time-forward and backward stochastic differential equations to connect the data and prior distributions. While conventional diffusion models (e.g., score-based models) only learn the backward process, more…

Machine Learning · Computer Science 2024-12-25 Kentaro Kaba , Reo Shimizu , Masayuki Ohzeki , Yuki Sughiyama

Denoising diffusion models are a popular class of generative models providing state-of-the-art results in many domains. One adds gradually noise to data using a diffusion to transform the data distribution into a Gaussian distribution.…

Machine Learning · Computer Science 2023-08-21 Francisco Vargas , Will Grathwohl , Arnaud Doucet

Metasurface inverse design is challenged by the intricate relationship between structural parameters and electromagnetic responses, as well as the high dimensionality of the optimization space. Local models, while commonly employed, quickly…

Computational methods for learning to sample from the Boltzmann distribution -- where the target distribution is known only up to an unnormalized energy function -- have advanced significantly recently. Due to the lack of explicit target…

Machine Learning · Statistics 2025-11-26 Guan-Horng Liu , Jaemoo Choi , Yongxin Chen , Benjamin Kurt Miller , Ricky T. Q. Chen

The dynamic Schr\"odinger bridge problem provides an appealing setting for solving constrained time-series data generation tasks posed as optimal transport problems. It consists of learning non-linear diffusion processes using efficient…

Machine Learning · Computer Science 2023-11-27 Ella Tamir , Martin Trapp , Arno Solin

Diffusion models are powerful generative models that map noise to data using stochastic processes. However, for many applications such as image editing, the model input comes from a distribution that is not random noise. As such, diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Linqi Zhou , Aaron Lou , Samar Khanna , Stefano Ermon

Recently, diffusion-based generative models have demonstrated remarkable performance in speech enhancement tasks. However, these methods still encounter challenges, including the lack of structural information and poor performance in low…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-16 Siyi Wang , Siyi Liu , Andrew Harper , Paul Kendrick , Mathieu Salzmann , Milos Cernak

Training neural samplers directly from unnormalized densities without access to target distribution samples presents a significant challenge. A critical desideratum in these settings is achieving comprehensive mode coverage, ensuring the…

Machine Learning · Computer Science 2025-05-27 Chenguang Wang , Xiaoyu Zhang , Kaiyuan Cui , Weichen Zhao , Yongtao Guan , Tianshu Yu

Schr\"odinger bridge (SB) has emerged as the go-to method for optimizing transportation plans in diffusion models. However, SB requires estimating the intractable forward score functions, inevitably resulting in the costly implicit training…

Machine Learning · Computer Science 2025-05-27 Wei Deng , Weijian Luo , Yixin Tan , Marin Biloš , Yu Chen , Yuriy Nevmyvaka , Ricky T. Q. Chen

Diffusion models (DMs) have become the dominant paradigm of generative modeling in a variety of domains by learning stochastic processes from noise to data. Recently, diffusion denoising bridge models (DDBMs), a new formulation of…

Machine Learning · Computer Science 2024-11-01 Guande He , Kaiwen Zheng , Jianfei Chen , Fan Bao , Jun Zhu

Recent advancements in optimization-based text-to-3D generation heavily rely on distilling knowledge from pre-trained text-to-image diffusion models using techniques like Score Distillation Sampling (SDS), which often introduce artifacts…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Ziying Li , Xuequan Lu , Xinkui Zhao , Guanjie Cheng , Shuiguang Deng , Jianwei Yin