English
Related papers

Related papers: Improving sampling by modifying the effective diff…

200 papers

Langevin Dynamics has been extensively employed in global non-convex optimization due to the concentration of its stationary distribution around the global minimum of the potential function at low temperatures. In this paper, we propose to…

Optimization and Control · Mathematics 2023-05-22 Ryo Fujino

For engineering applications of artificial intelligence, Bayesian learning holds significant advantages over standard frequentist learning, including the capacity to quantify uncertainty. Langevin Monte Carlo (LMC) is an efficient…

Information Theory · Computer Science 2022-03-01 Yunchuan Zhang , Dongzhu Liu , Osvaldo Simeone

Fitting models to data to obtain distributions of consistent parameter values is important for uncertainty quantification, model comparison, and prediction. Standard Markov chain Monte Carlo (MCMC) approaches for fitting ordinary…

Computation · Statistics 2025-09-05 Chris Chi , Jonathan Weare , Aaron R. Dinner

Hamiltonian Monte Carlo is a prominent Markov Chain Monte Carlo algorithm, which employs symplectic integrators to sample from high dimensional target distributions in many applications, such as statistical mechanics, Bayesian statistics…

Numerical Analysis · Mathematics 2025-02-13 Geoffrey McGregor , Andy T. S. Wan

We introduce new Gaussian proposals to improve the efficiency of the standard Hastings-Metropolis algorithm in Markov chain Monte Carlo (MCMC) methods, used for the sampling from a target distribution in large dimension $d$. The improved…

Numerical Analysis · Mathematics 2016-11-28 Alain Durmus , Gareth O. Roberts , Gilles Vilmart , Konstantinos C. Zygalakis

It is well known in many settings that reversible Langevin diffusions in confining potentials converge to equilibrium exponentially fast. Adding irreversible perturbations to the drift of a Langevin diffusion that maintain the same…

Methodology · Statistics 2019-07-02 Michela Ottobre , Natesh S. Pillai , Konstantinos Spiliopoulos

Hamiltonian Monte Carlo has emerged as a standard tool for posterior computation. In this article, we present an extension that can efficiently explore target distributions with discontinuous densities. Our extension in particular enables…

Computation · Statistics 2020-06-09 Akihiko Nishimura , David Dunson , Jianfeng Lu

Markov chain Monte Carlo (MCMC), such as Langevin dynamics, is valid for approximating intractable distributions. However, its usage is limited in the context of deep latent variable models owing to costly datapoint-wise sampling iterations…

Machine Learning · Computer Science 2022-10-12 Shohei Taniguchi , Yusuke Iwasawa , Wataru Kumagai , Yutaka Matsuo

This paper proposes a replica exchange preconditioned Langevin diffusion discretized by the Crank-Nicolson scheme (repCNLD) to handle high-dimensional and multi-modal distribution problems. Sampling from high-dimensional and multi-modal…

Numerical Analysis · Mathematics 2022-11-01 Ou Na , Zecheng Zhang , Guang Lin

For sampling from a log-concave density, we study implicit integrators resulting from $\theta$-method discretization of the overdamped Langevin diffusion stochastic differential equation. Theoretical and algorithmic properties of the…

Machine Learning · Statistics 2021-07-13 Liam Hodgkinson , Robert Salomone , Fred Roosta

High-dimensional data are routinely collected in many areas. We are particularly interested in Bayesian classification models in which one or more variables are imbalanced. Current Markov chain Monte Carlo algorithms for posterior…

Methodology · Statistics 2024-01-15 Deborshee Sen , Matthias Sachs , Jianfeng Lu , David Dunson

In order to solve tasks like uncertainty quantification or hypothesis tests in Bayesian imaging inverse problems, we often have to draw samples from the arising posterior distribution. For the usually log-concave but high-dimensional…

Computation · Statistics 2025-01-23 Matthias J. Ehrhardt , Lorenz Kuger , Carola-Bibiane Schönlieb

Discrete diffusion models have emerged as powerful tools for high-quality data generation. Despite their success in discrete spaces, such as text generation tasks, the acceleration of discrete diffusion models remains under-explored. In…

Machine Learning · Computer Science 2024-12-09 Zixiang Chen , Huizhuo Yuan , Yongqian Li , Yiwen Kou , Junkai Zhang , Quanquan Gu

We consider posterior sampling in the very common Bayesian hierarchical model in which observed data depends on high-dimensional latent variables that, in turn, depend on relatively few hyperparameters. When the full conditional over the…

Computation · Statistics 2016-10-24 Richard A. Norton , J. Andres Christen , Colin Fox

We present an efficient computational approach to sample the histories of nonlinear stochastic processes. This framework builds upon recent work on casting a $d$-dimensional stochastic dynamical system into a $d+1$-dimensional equilibrium…

Statistical Mechanics · Physics 2009-11-11 Natali Gulbahce , Francis J. Alexander , Gregory Johnson

This paper presents a detailed theoretical analysis of the Langevin Monte Carlo sampling algorithm recently introduced in Durmus et al. (Efficient Bayesian computation by proximal Markov chain Monte Carlo: when Langevin meets Moreau, 2016)…

Methodology · Statistics 2017-05-26 Nicolas Brosse , Alain Durmus , Éric Moulines , Marcelo Pereyra

Generative diffusion models have recently emerged as a powerful strategy to perform stochastic sampling in Bayesian inverse problems, delivering remarkably accurate solutions for a wide range of challenging applications. However, diffusion…

Computation · Statistics 2025-05-15 Abdul-Lateef Haji-Ali , Marcelo Pereyra , Luke Shaw , Konstantinos Zygalakis

The sampling of the configuration space in diffusion Monte Carlo (DMC) is done using walkers moving randomly. In a previous work on the Hubbard model [\href{https://doi.org/10.1103/PhysRevB.60.2299}{Assaraf et al.~Phys.~Rev.~B \textbf{60},…

Strongly Correlated Electrons · Physics 2023-01-19 Roland Assaraf , Emmanuel Giner , Vijay Gopal Chilkuri , Pierre-François Loos , Anthony Scemama , Michel Caffarel

We propose a modification, based on the RESTART (repetitive simulation trials after reaching thresholds) and DPR (dynamics probability redistribution) rare event simulation algorithms, of the standard diffusion Monte Carlo (DMC) algorithm.…

Probability · Mathematics 2014-04-10 Martin Hairer , Jonathan Weare

Priors with non-smooth log-densities, such as the l1-prior, are widely used in Bayesian inverse problems for their sparsity-inducing properties. Existing Langevin-based sampling methods typically rely on proximal mappings or smooth…

Numerical Analysis · Mathematics 2026-05-05 Ivan Cheltsov , Federico Cornalba , Clarice Poon , Tony Shardlow