English
Related papers

Related papers: SCORENF: Score-based Normalizing Flows for Samplin…

200 papers

Diffusion models are typically trained using score matching, a learning objective agnostic to the underlying noising process that guides the model. This paper argues that Markov noising processes enjoy an advantage over alternatives, as the…

Machine Learning · Statistics 2025-05-27 Zheyang Shen , Huihui Wang , Marina Riabiz , Chris J. Oates

We introduce a general Monte Carlo method based on Nested Sampling (NS), for sampling complex probability distributions and estimating the normalising constant. The method uses one or more particles, which explore a mixture of nested…

Computation · Statistics 2012-02-27 Brendon J. Brewer , Livia B. Pártay , Gábor Csányi

Continuous normalizing flows (CNFs) are a generative method for learning probability distributions, which is based on ordinary differential equations. This method has shown remarkable empirical success across various applications, including…

Machine Learning · Statistics 2024-04-02 Yuan Gao , Jian Huang , Yuling Jiao , Shurong Zheng

We propose score dynamics (SD), a general framework for learning accelerated evolution operators with large timesteps from molecular-dynamics simulations. SD is centered around scores, or derivatives of the transition log-probability with…

Computational Physics · Physics 2024-03-08 Tim Hsu , Babak Sadigh , Vasily Bulatov , Fei Zhou

We study the consequences of mode-collapse of normalizing flows in the context of lattice field theory. Normalizing flows allow for independent sampling. For this reason, it is hoped that they can avoid the tunneling problem of local-update…

High Energy Physics - Lattice · Physics 2023-11-06 Kim A. Nicoli , Christopher J. Anders , Tobias Hartung , Karl Jansen , Pan Kessel , Shinichi Nakajima

We propose a novel sequential Monte Carlo (SMC) method for sampling from unnormalized target distributions based on a reverse denoising diffusion process. While recent diffusion-based samplers simulate the reverse diffusion using…

Computation · Statistics 2025-11-06 Luhuan Wu , Yi Han , Christian A. Naesseth , John P. Cunningham

We survey continuous-time generative modeling methods based on transporting a simple reference distribution to a data distribution via stochastic or deterministic dynamics. We present a unified framework in which diffusion models,…

Machine Learning · Computer Science 2026-05-11 Aditya Ranganath , Mukesh Singhal

Sampling from unnormalised discrete distributions is a fundamental problem across various domains. While Markov chain Monte Carlo offers a principled approach, it often suffers from slow mixing and poor convergence. In this paper, we…

Machine Learning · Computer Science 2025-10-23 Zijing Ou , Ruixiang Zhang , Yingzhen Li

An effective approach for sampling from unnormalized densities is based on the idea of gradually transporting samples from an easy prior to the complicated target distribution. Two popular methods are (1) Sequential Monte Carlo (SMC), where…

Machine Learning · Statistics 2025-09-09 Junhua Chen , Lorenz Richter , Julius Berner , Denis Blessing , Gerhard Neumann , Anima Anandkumar

Transport maps can ease the sampling of distributions with non-trivial geometries by transforming them into distributions that are easier to handle. The potential of this approach has risen with the development of Normalizing Flows (NF)…

Machine Learning · Statistics 2024-02-20 Louis Grenioux , Alain Durmus , Éric Moulines , Marylou Gabrié

Accelerated magnetic resonance (MR) imaging attempts to reduce acquisition time by collecting data below the Nyquist rate. As an ill-posed inverse problem, many plausible solutions exist, yet the majority of deep learning approaches…

Image and Video Processing · Electrical Eng. & Systems 2023-06-05 Jeffrey Wen , Rizwan Ahmad , Philip Schniter

Continuous Normalizing Flows (CNFs) have emerged as promising deep generative models for a wide range of tasks thanks to their invertibility and exact likelihood estimation. However, conditioning CNFs on signals of interest for conditional…

Machine Learning · Computer Science 2019-12-10 Tan M. Nguyen , Animesh Garg , Richard G. Baraniuk , Anima Anandkumar

Sequential Monte Carlo Samplers are a class of stochastic algorithms for Monte Carlo integral estimation w.r.t. probability distributions, which combine elements of Markov chain Monte Carlo methods and importance sampling/resampling…

Probability · Mathematics 2007-05-23 Andreas Eberle , Carlo Marinelli

In this paper, we explore the potential of generative machine learning models as an alternative to the computationally expensive Monte Carlo (MC) simulations commonly used by the Large Hadron Collider (LHC) experiments. Our objective is to…

High Energy Physics - Experiment · Physics 2023-11-21 Allison Xu , Shuo Han , Xiangyang Ju , Haichen Wang

We propose a new score-based model with one-step sampling. Previously, score-based models were burdened with heavy computations due to iterative sampling. For substituting the iterative process, we train a standalone generator to compress…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Senmao Ye , Fei Liu

Uncertainty quantification provides quantitative measures on the reliability of candidate solutions of ill-posed inverse problems. Due to their sequential nature, Monte Carlo sampling methods require large numbers of sampling steps for…

Geophysics · Physics 2021-04-14 Ali Siahkoohi , Felix J. Herrmann

Normalizing Flows (NFs) are able to model complicated distributions p(y) with strong inter-dimensional correlations and high multimodality by transforming a simple base density p(z) through an invertible neural network under the change of…

Machine Learning · Computer Science 2023-11-14 Christina Winkler , Daniel Worrall , Emiel Hoogeboom , Max Welling

Neural Posterior Estimation methods for simulation-based inference can be ill-suited for dealing with posterior distributions obtained by conditioning on multiple observations, as they tend to require a large number of simulator calls to…

Machine Learning · Computer Science 2023-07-11 Tomas Geffner , George Papamakarios , Andriy Mnih

We propose a renormalisation group inspired normalising flow that combines benefits from traditional Markov chain Monte Carlo methods and standard normalising flows to sample lattice field theories. Specifically, we use samples from a…

High Energy Physics - Lattice · Physics 2024-12-18 Marc Bauer , Renzo Kapust , Jan M. Pawlowski , Finn L. Temmen

Symmetric Nonnegative Matrix Factorization (SymNMF) is a technique in data analysis and machine learning that approximates a symmetric matrix with a product of a nonnegative, low-rank matrix and its transpose. To design faster and more…

Machine Learning · Computer Science 2024-12-02 Koby Hayashi , Sinan G. Aksoy , Grey Ballard , Haesun Park