English
Related papers

Related papers: One-Step Sampler for Boltzmann Distributions via D…

200 papers

We provide new convergence guarantees in Wasserstein distance for diffusion-based generative models, covering both stochastic (DDPM-like) and deterministic (DDIM-like) sampling methods. We introduce a simple framework to analyze…

Machine Learning · Computer Science 2025-11-14 Eliot Beyler , Francis Bach

Restricted Boltzmann Machines (RBMs) are one of the fundamental building blocks of deep learning. Approximate maximum likelihood training of RBMs typically necessitates sampling from these models. In many training scenarios, computationally…

Machine Learning · Computer Science 2014-10-02 Guillaume Desjardins , Heng Luo , Aaron Courville , Yoshua Bengio

Recently, a new paradigm named \emph{drifting model} has been proposed for mapping distributions, which achieves the SOTA image generation performance over ImageNet via one-step neural functional evaluation (NFE). The basic idea is to…

Machine Learning · Computer Science 2026-05-07 Guoqiang Zhang , Kenta Niwa , W. Bastiaan Kleijn

Predicting the intermediate trajectories between an initial and target distribution is a central problem in generative modeling. Existing approaches, such as flow matching and Schr\"odinger bridge matching, effectively learn mappings…

Machine Learning · Computer Science 2026-03-03 Sophia Tang , Yinuo Zhang , Alexander Tong , Pranam Chatterjee

Conventional frequentist learning, as assumed by existing federated learning protocols, is limited in its ability to quantify uncertainty, incorporate prior knowledge, guide active learning, and enable continual learning. Bayesian learning…

Information Theory · Computer Science 2021-08-31 Dongzhu Liu , Osvaldo Simeone

Due to their conjugate posteriors, Gaussian process priors are attractive for estimating the drift of stochastic differential equations with continuous time observations. However, their performance strongly depends on the choice of the…

Statistics Theory · Mathematics 2020-02-04 Jan van Waaij

The block bootstrap approximates sampling distributions from dependent data by resampling data blocks. A fundamental problem is establishing its consistency for the distribution of a sample mean, as a prototypical statistic. We use a…

Statistics Theory · Mathematics 2017-06-23 Johannes Tewes , Daniel J. Nordman , Dimitris N. Politis

In a celebrated paper \cite{noe2019boltzmann}, No\'e, Olsson, K\"ohler and Wu introduced an efficient method for sampling high-dimensional Boltzmann distributions arising in molecular dynamics via normalizing flow approximation of transport…

Machine Learning · Computer Science 2026-03-17 Zia Ur Rehman , Gero Friesecke

Monitoring for changes in a predictive relationship represented by a fitted supervised learning model (i.e., concept drift detection) is a widespread problem in modern data-driven applications. A general and powerful Fisher score-based…

Methodology · Statistics 2026-03-24 Jiezhong Wu , Daniel W. Apley

Restricted Boltzmann Machines are simple and powerful generative models that can encode any complex dataset. Despite all their advantages, in practice the trainings are often unstable and it is difficult to assess their quality because the…

Machine Learning · Computer Science 2023-03-16 Nicolas Béreux , Aurélien Decelle , Cyril Furtlehner , Beatriz Seoane

We propose multiplier bootstrap procedures for nonparametric inference and uncertainty quantification of the target mean function, based on a novel framework of integrating target and source data. We begin with the relatively easier…

Methodology · Statistics 2025-01-06 Zuofeng Shang , Peijun Sang , Chong Jin

Score-based diffusion models, while achieving remarkable empirical performance, often suffer from low sampling speed, due to extensive function evaluations needed during the sampling phase. Despite a flurry of recent activities towards…

Machine Learning · Computer Science 2024-03-07 Gen Li , Yu Huang , Timofey Efimov , Yuting Wei , Yuejie Chi , Yuxin Chen

Sampling conditional distributions is a fundamental task for Bayesian inference and density estimation. Generative models, such as normalizing flows and generative adversarial networks, characterize conditional distributions by learning a…

Sampling from diffusion models involves a slow iterative process that hinders their practical deployment, especially for interactive applications. To accelerate generation speed, recent approaches distill a multi-step diffusion model into a…

Machine Learning · Computer Science 2025-03-11 Yilun Xu , Weili Nie , Arash Vahdat

Sampling from unnormalized probability densities is a central challenge in computational science. Boltzmann generators are generative models that enable independent sampling from the Boltzmann distribution of physical systems at a given…

Machine Learning · Computer Science 2026-02-04 Henrik Schopmans , Christopher von Klitzing , Pascal Friederich

Normalizing flows are flexible, parameterized distributions that can be used to approximate expectations from intractable distributions via importance sampling. However, current flow-based approaches are limited on challenging targets where…

Machine Learning · Computer Science 2022-03-15 Laurence Illing Midgley , Vincent Stimper , Gregor N. C. Simm , José Miguel Hernández-Lobato

We propose a general and scalable approximate sampling strategy for probabilistic models with discrete variables. Our approach uses gradients of the likelihood function with respect to its discrete inputs to propose updates in a…

Machine Learning · Computer Science 2021-06-08 Will Grathwohl , Kevin Swersky , Milad Hashemi , David Duvenaud , Chris J. Maddison

In this paper, we develop a class of samplers for the diffusion model using the operator-splitting technique. The linear drift term and the nonlinear score-driven drift of the probability flow ordinary differential equation are split and…

Numerical Analysis · Mathematics 2026-01-27 Peiyi Liu , Zhaoqiang Liu , Yiqi Gu

Westling and Carone (2020) proposed a framework for studying the large sample distributional properties of generalized Grenander-type estimators, a versatile class of nonparametric estimators of monotone functions. The limiting distribution…

Statistics Theory · Mathematics 2024-07-08 Matias D. Cattaneo , Michael Jansson , Kenichi Nagasawa

In this paper, we present a new idea for Transfer Learning (TL) based on Gibbs Sampling. Gibbs sampling is an algorithm in which instances are likely to transfer to a new state with a higher possibility with respect to a probability…

Machine Learning · Computer Science 2020-06-26 Hossein Shahabadi Farahani , Alireza Fatehi , Mahdi Aliyari Shoorehdeli