English
Related papers

Related papers: Irreversible Langevin MCMC on Lie Groups

200 papers

Reversible Markov chains play a central role in stochastic modelling and in algorithms such as Markov chain Monte Carlo (MCMC). Motivated by the fundamental importance of reversibility in classical settings, this paper develops a…

Probability · Mathematics 2025-10-28 Damjan Škulj

We analyse computational efficiency of Metropolis-Hastings algorithms with AR(1) process proposals. These proposals include, as a subclass, discretized Langevin diffusion (e.g. MALA) and discretized Hamiltonian dynamics (e.g. HMC). By…

Probability · Mathematics 2015-01-15 Richard A. Norton , Colin Fox

New classes of Lie-Hamilton systems are obtained from the six-dimensional fundamental representation of the symplectic Lie algebra $\mathfrak{sp}(6,\mathbb{R})$. The ansatz is based on a recently proposed procedure for constructing…

Mathematical Physics · Physics 2025-01-07 O. Carballal , R. Campoamor-Stursberg , F. J. Herranz

Riemannian manifold Hamiltonian Monte Carlo (RMHMC) is a powerful method of Bayesian inference that exploits underlying geometric information of the posterior distribution in order to efficiently traverse the parameter space. However, the…

Computation · Statistics 2022-03-01 James A. Brofos , Roy R. Lederman

In this paper, we explore a general Aggregated Gradient Langevin Dynamics framework (AGLD) for the Markov Chain Monte Carlo (MCMC) sampling. We investigate the nonasymptotic convergence of AGLD with a unified analysis for different data…

Machine Learning · Computer Science 2019-10-22 Chao Zhang , Jiahao Xie , Zebang Shen , Peilin Zhao , Tengfei Zhou , Hui Qian

Hamiltonian Monte Carlo (HMC) and related algorithms have become routinely used in Bayesian computation. In this article, we present a simple and provably accurate method to improve the efficiency of HMC and related algorithms with…

Computation · Statistics 2020-03-10 Akihiko Nishimura , David Dunson

Markov chain Monte Carlo (MCMC) simulation methods are widely used to assess parametric uncertainties of hydrologic models conditioned on measurements of observable state variables. However, when the model is CPU-intensive and…

Optimization and Control · Mathematics 2018-06-18 Jiangjiang Zhang , Jun Man , Guang Lin , Laosheng Wu , Lingzao Zeng

A new algorithm based on bayesian inference for learning local graph conductance based on Gaussian Process(GP) is given that uses advanced MCMC convergence ideas to create a scalable and fast algorithm for convergence to stationary…

Machine Learning · Computer Science 2022-04-28 Farshad Noravesh

The classical Langevin Monte Carlo method looks for samples from a target distribution by descending the samples along the gradient of the target distribution. The method enjoys a fast convergence rate. However, the numerical cost is…

Machine Learning · Statistics 2025-03-07 Zhiyan Ding , Qin Li

Cyclical MCMC is a novel MCMC framework recently proposed by Zhang et al. (2019) to address the challenge posed by high-dimensional multimodal posterior distributions like those arising in deep learning. The algorithm works by generating a…

Computation · Statistics 2024-03-04 Liwei Wang , Xinru Liu , Aaron Smith , Yves Atchade

The use of the probabilistic approach to solve inverse problems is becoming more popular in the geophysical community, thanks to its ability to address nonlinear forward problems and to provide uncertainty quantification. However, such…

Geophysics · Physics 2023-11-13 Andrea Zunino , Lars Gebraad , Alessandro Ghirotto , Andreas Fichtner

A Lie system is a non-autonomous system of first-order ordinary differential equations describing the integral curves of a non-autonomous vector field taking values in a finite-dimensional real Lie algebra of vector fields, a so-called…

Mathematical Physics · Physics 2022-07-04 Javier de Lucas , Xavier Gràcia , Xavier Rivas , Narciso Román-Roy , Silvia Vilariño

Markov chain Monte Carlo(MCMC) is a popular approach to sample from high dimensional distributions, and the asymptotic variance is a commonly used criterion to evaluate the performance. While most popular MCMC algorithms are reversible,…

Probability · Mathematics 2018-02-06 Chi-Hao Wu , Ting-Li Chen

The classical Metropolis-Hastings (MH) algorithm can be extended to generate non-reversible Markov chains. This is achieved by means of a modification of the acceptance probability, using the notion of vorticity matrix. The resulting Markov…

Probability · Mathematics 2020-09-29 Joris Bierkens

In many computational problems, using the Markov Chain Monte Carlo (MCMC) can be prohibitively time-consuming. We propose MCMC-Net, a simple yet efficient way to accelerate MCMC via neural networks. The key idea of our approach is to…

Numerical Analysis · Mathematics 2025-09-16 Sudeb Majee , Anuj Abhishek , Thilo Strauss , Taufiquar Khan

We present a two-stage Metropolis-Hastings algorithm for sampling probabilistic models, whose log-likelihood is computationally expensive to evaluate, by using a surrogate Gaussian Process (GP) model. The key feature of the approach, and…

Machine Learning · Statistics 2021-09-29 Alessio Benavoli , Jason Wyse , Arthur White

A Riemannian geometric framework for Markov chain Monte Carlo (MCMC) is developed where using the Fisher-Rao metric on the manifold of probability density functions (pdfs), informed proposal densities for Metropolis-Hastings (MH) algorithms…

Methodology · Statistics 2024-11-08 Vivekananda Roy

We present a trainable framework for efficiently generating gauge configurations, and discuss ongoing work in this direction. In particular, we consider the problem of sampling configurations from a 4D $SU(3)$ lattice gauge theory, and…

High Energy Physics - Lattice · Physics 2023-12-19 Sam Foreman , Xiao-Yong Jin , James C. Osborn

We discuss Hamiltonian Monte Carlo (HMC) and event-chain Monte Carlo (ECMC) for the one-dimensional chain of particles with harmonic interactions and benchmark them against local reversible Metropolis algorithms. While HMC achieves…

Statistical Mechanics · Physics 2024-11-19 Werner Krauth

We present a significant advancement in the field of Langevin Monte Carlo (LMC) methods by introducing the Inexact Proximal Langevin Algorithm (IPLA). This novel algorithm broadens the scope of problems that LMC can effectively address…

Machine Learning · Statistics 2024-12-16 Matej Benko , Iwona Chlebicka , Jørgen Endal , Błażej Miasojedow