中文
相关论文

相关论文: Optimal Scaling of Mala for Nonlinear Regression

200 篇论文

The Metropolis-adjusted Langevin (MALA) algorithm is a sampling algorithm which makes local moves by incorporating information about the gradient of the logarithm of the target density. In this paper we study the efficiency of MALA on a…

概率论 · 数学 2012-11-29 Natesh S. Pillai , Andrew M. Stuart , Alexandre H. Thiéry

We consider the Random Walk Metropolis algorithm on $\mathbb{R}^n$ with Gaussian proposals, and when the target probability measure is the $n$-fold product of a one-dimensional law. It is well known (see Roberts et al. (Ann. Appl. Probab. 7…

统计方法学 · 统计学 2014-10-22 Benjamin Jourdain , Tony Lelièvre , Błażej Miasojedow

For sufficiently smooth targets of product form it is known that the variance of a single coordinate of the proposal in RWM (Random walk Metropolis) and MALA (Metropolis adjusted Langevin algorithm) should optimally scale as $n^{-1}$ and as…

概率论 · 数学 2020-07-15 Jure Vogrinc , Wilfrid Stephen Kendall

The Metropolis-adjusted Langevin (MALA) algorithm is a sampling algorithm that incorporates the gradient of the logarithm of the target density in its proposal distribution. In an earlier joint work \citet{pill:stu:12}, the author had…

统计计算 · 统计学 2025-01-15 Natesh S. Pillai

The Metropolis-adjusted Langevin algorithm (MALA) is a Metropolis-Hastings method for approximate sampling from continuous distributions. We derive upper bounds for the contraction rate in Kantorovich-Rubinstein-Wasserstein distance of the…

概率论 · 数学 2014-01-17 Andreas Eberle

Conventional wisdom in the sampling literature, backed by a popular diffusion scaling limit, suggests that the mixing time of the Metropolis-Adjusted Langevin Algorithm (MALA) scales as $O(d^{1/3})$, where $d$ is the dimension. However, the…

统计理论 · 数学 2020-12-24 Sinho Chewi , Chen Lu , Kwangjun Ahn , Xiang Cheng , Thibaut Le Gouic , Philippe Rigollet

The Metropolis-Adjusted Langevin Algorithm (MALA) is a Markov Chain Monte Carlo method which creates a Markov chain reversible with respect to a given target distribution, pi^N, with Lebesgue density on R^N; it can hence be used to…

概率论 · 数学 2017-08-24 J. Kuntz , M. Ottobre , A. M. Stuart

This paper proposes a new sampling scheme based on Langevin dynamics that is applicable within pseudo-marginal and particle Markov chain Monte Carlo algorithms. We investigate this algorithm's theoretical properties under standard…

统计方法学 · 统计学 2016-05-30 Christopher Nemeth , Chris Sherlock , Paul Fearnhead

It is well known in many settings that reversible Langevin diffusions in confining potentials converge to equilibrium exponentially fast. Adding irreversible perturbations to the drift of a Langevin diffusion that maintain the same…

统计方法学 · 统计学 2019-07-02 Michela Ottobre , Natesh S. Pillai , Konstantinos Spiliopoulos

We provide a clarification of the description of Langevin diffusions on Riemannian manifolds and of the measure underlying the invariant density. As a result we propose a new position-dependent Metropolis-adjusted Langevin algorithm (MALA)…

统计方法学 · 统计学 2014-08-15 Tatiana Xifara , Chris Sherlock , Samuel Livingstone , Simon Byrne , Mark Girolami

In this paper we consider a new probability sampling methods based on Langevin diffusion dynamics to resolve the problem of existing Monte Carlo algorithms when draw samples from high dimensional target densities. We extent…

机器学习 · 计算机科学 2025-03-31 Z. Zarezadeh , N. Zarezadeh

In this paper, we shall optimize the efficiency of Metropolis algorithms for multidimensional target distributions with scaling terms possibly depending on the dimension. We propose a method for determining the appropriate form for the…

概率论 · 数学 2007-10-25 Mylène Bédard

This paper considers the optimal scaling problem for high-dimensional random walk Metropolis algorithms for densities which are differentiable in Lp mean but which may be irregular at some points (like the Laplace density for example)…

概率论 · 数学 2016-04-25 Alain Durmus , Sylvain Le Corff , Eric Moulines , Gareth O. Roberts

The Metropolis-Adjusted Langevin Algorithm (MALA) is a widely used Markov Chain Monte Carlo (MCMC) method for sampling from high-dimensional distributions. However, MALA relies on differentiability assumptions that restrict its…

统计方法学 · 统计学 2025-07-10 Ning Ning

We investigate a weighted Multilevel Richardson-Romberg extrapolation for the ergodic approximation of invariant distributions of diffusions adapted from the one introduced in~[Lemaire-Pag\`es, 2013] for regular Monte Carlo simulation. In a…

概率论 · 数学 2016-07-05 Gilles Pagès , Fabien Panloup

The Langevin Markov chain algorithms are widely deployed methods to sample from distributions in challenging high-dimensional and non-convex statistics and machine learning applications. Despite this, current bounds for the Langevin…

数据结构与算法 · 计算机科学 2019-04-10 Oren Mangoubi , Nisheeth K. Vishnoi

This paper presents a new Metropolis-adjusted Langevin algorithm (MALA) that uses convex analysis to simulate efficiently from high-dimensional densities that are log-concave, a class of probability distributions that is widely used in…

统计方法学 · 统计学 2015-04-06 Marcelo Pereyra

We consider the random walk Metropolis algorithm on $\mathbb{R}^n$ with Gaussian proposals, and when the target probability measure is the $n$-fold product of a one-dimensional law. In the limit $n\to\infty$, it is well known (see [Ann.…

概率论 · 数学 2016-08-14 Benjamin Jourdain , Tony Lelièvre , Błażej Miasojedow

We consider a recently proposed class of MCMC methods which uses proximity maps instead of gradients to build proposal mechanisms which can be employed for both differentiable and non-differentiable targets. These methods have been shown to…

统计计算 · 统计学 2024-06-21 Francesca R. Crucinio , Alain Durmus , Pablo Jiménez , Gareth O. Roberts

We define an optimal preconditioning for the Langevin diffusion by analytically optimizing the expected squared jumped distance. This yields as the optimal preconditioning an inverse Fisher information covariance matrix, where the…

机器学习 · 统计学 2023-10-31 Michalis K. Titsias
‹ 上一页 1 2 3 10 下一页 ›