English
Related papers

Related papers: Enhancing Gradient-based Discrete Sampling via Par…

200 papers

The rise of artificial intelligence (AI) hinges on the efficient training of modern deep neural networks (DNNs) for non-convex optimization and uncertainty quantification, which boils down to a non-convex Bayesian learning problem. A…

Computation · Statistics 2023-06-01 Wei Deng

Diffusion models (DMs) have established themselves as the state-of-the-art generative modeling approach in the visual domain and beyond. A crucial drawback of DMs is their slow sampling speed, relying on many sequential function evaluations…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Amirmojtaba Sabour , Sanja Fidler , Karsten Kreis

We study the convergence to equilibrium of an underdamped Langevin equation that is controlled by a linear feedback force. Specifically, we are interested in sampling the possibly multimodal invariant probability distribution of a Langevin…

Optimization and Control · Mathematics 2022-01-12 Tobias Breiten , Carsten Hartmann , Lara Neureither , Upanshu Sharma

Latent dynamical models are commonly used to learn the distribution of a latent dynamical process that represents a sequence of noisy data samples. However, producing samples from such models with high fidelity is challenging due to the…

Machine Learning · Computer Science 2023-08-17 Mohammad R. Rezaei

Dissipative Particle Dynamics (DPD) is a popular simulation model for investigating hydrodynamic behavior of systems with non-negligible equilibrium thermal fluctuations. DPD employs soft core repulsive interactions between the system…

Statistical Mechanics · Physics 2016-03-23 Oded Farago , Niels Grønbech-Jensen

This article develops a general-purpose adaptive sampler that approximates the target density by a mixture of multivariate t densities. The adaptive sampler is based on reversible proposal distributions each of which has the mixture of…

Methodology · Statistics 2013-08-22 Minh-Ngoc Tran , Michael K. Pitt , Robert Kohn

We introduce a novel framework for efficient sampling from complex, unnormalised target distributions by exploiting multiscale dynamics. Traditional score-based sampling methods either rely on learned approximations of the score function or…

Computation · Statistics 2025-11-04 Paula Cordero-Encinar , Andrew B. Duncan , Sebastian Reich , O. Deniz Akyildiz

Enhanced sampling techniques are essential for exploring biomolecular conformational dynamics that occur on timescales inaccessible to conventional molecular dynamics (MD) simulations. This study introduces a framework that combines…

Statistical Mechanics · Physics 2025-10-22 Zakarya Benayad , Guillaume Stirnemann

We review several parallel tempering schemes and examine their main ingredients for accuracy and efficiency. The present study covers two selection methods of temperatures and several choices for the exchange of replicas, including a recent…

Statistical Mechanics · Physics 2015-06-16 A. Malakis , T. Papakonstantinou

The inadequate mixing of conventional Markov Chain Monte Carlo (MCMC) methods for multi-modal distributions presents a significant challenge in practical applications such as Bayesian inference and molecular dynamics. Addressing this, we…

Machine Learning · Statistics 2024-05-30 Wenlin Chen , Mingtian Zhang , Brooks Paige , José Miguel Hernández-Lobato , David Barber

In this paper we address the following question: Can we approximately sample from a Bayesian posterior distribution if we are only allowed to touch a small mini-batch of data-items for every sample we generate?. An algorithm based on the…

Machine Learning · Computer Science 2012-07-03 Sungjin Ahn , Anoop Korattikara , Max Welling

An effective approach for sampling from unnormalized densities is based on the idea of gradually transporting samples from an easy prior to the complicated target distribution. Two popular methods are (1) Sequential Monte Carlo (SMC), where…

Machine Learning · Statistics 2025-09-09 Junhua Chen , Lorenz Richter , Julius Berner , Denis Blessing , Gerhard Neumann , Anima Anandkumar

Discrete flow models (DFMs) have been proposed to learn the data distribution on finite state space, offering a flexible framework as an alternative to discrete diffusion models. A line of recent work has studied samplers for discrete…

Machine Learning · Statistics 2026-05-28 Zhengyan Wan , Yidong Ouyang , Liyan Xie , Hongyuan Zha , Fang Fang , Guang Cheng

Existing customization methods require access to multiple reference examples to align pre-trained diffusion probabilistic models (DPMs) with user-provided concepts. This paper aims to address the challenge of DPM customization when the only…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Jiachun Pan , Jun Hao Liew , Vincent Y. F. Tan , Jiashi Feng , Hanshu Yan

We review a selection of methods for performing enhanced sampling in molecular dynamics simulations. We consider methods based on collective variable biasing and on tempering, and offer both historical and contemporary perspectives. In…

Statistical Mechanics · Physics 2014-01-03 Cameron Abrams , Giovanni Bussi

We study discrete distribution estimation under user-level local differential privacy (LDP). In user-level $\varepsilon$-LDP, each user has $m\ge1$ samples and the privacy of all $m$ samples must be preserved simultaneously. We resolve the…

Machine Learning · Computer Science 2022-11-08 Jayadev Acharya , Yuhan Liu , Ziteng Sun

This work introduces a new approximate proximal sampler that operates solely with zeroth-order information of the potential function. Prior theoretical analyses have revealed that proximal sampling corresponds to alternating forward and…

Machine Learning · Computer Science 2026-03-23 Hirohane Takagi , Atsushi Nitanda

A key task in Bayesian statistics is sampling from distributions that are only specified up to a partition function (i.e., constant of proportionality). However, without any assumptions, sampling (even approximately) can be #P-hard, and few…

Machine Learning · Computer Science 2018-12-03 Rong Ge , Holden Lee , Andrej Risteski

We propose a parallel adaptive constraint-tightening approach to solve a linear model predictive control problem for discrete-time systems, based on inexact numerical optimization algorithms and operator splitting methods. The underlying…

Optimization and Control · Mathematics 2015-03-24 Laura Ferranti , Tamas Keviczky

We review and compare numerical methods that simultaneously control temperature while preserving the momentum, a family of particle simulation methods commonly used for the modelling of complex fluids and polymers. The class of methods…

Computational Physics · Physics 2020-02-14 Benedict Leimkuhler , Xiaocheng Shang