English
Related papers

Related papers: The Mirror Langevin Algorithm Converges with Vanis…

200 papers

We present an improved analysis of the Euler-Maruyama discretization of the Langevin diffusion. Our analysis does not require global contractivity, and yields polynomial dependence on the time horizon. Compared to existing approaches, we…

Probability · Mathematics 2019-11-05 Wenlong Mou , Nicolas Flammarion , Martin J. Wainwright , Peter L. Bartlett

This paper is concerned with convergence analysis for the mirror descent (MD) method, a well-known algorithm in convex optimization. An analysis framework via integral quadratic constraints (IQCs) is constructed to analyze the convergence…

Optimization and Control · Mathematics 2022-09-12 Mengmou Li , Khaled Laib , Ioannis Lestas

Classically, the continuous-time Langevin diffusion converges exponentially fast to its stationary distribution $\pi$ under the sole assumption that $\pi$ satisfies a Poincar\'e inequality. Using this fact to provide guarantees for the…

Statistics Theory · Mathematics 2024-07-11 Sinho Chewi , Murat A. Erdogdu , Mufan Bill Li , Ruoqi Shen , Matthew Zhang

Many problems in machine learning can be formulated as optimizing a convex functional over a vector space of measures. This paper studies the convergence of the mirror descent algorithm in this infinite-dimensional setting. Defining Bregman…

Optimization and Control · Mathematics 2022-10-12 Pierre-Cyril Aubin-Frankowski , Anna Korba , Flavien Léger

The mirror descent algorithm is known to be effective in situations where it is beneficial to adapt the mirror map to the underlying geometry of the optimization model. However, the effect of mirror maps on the geometry of distributed…

Optimization and Control · Mathematics 2024-03-13 Anastasia Borovykh , Nikolas Kantas , Panos Parpas , Grigorios A. Pavliotis

The Metropolis-adjusted Langevin (MALA) algorithm is a sampling algorithm which makes local moves by incorporating information about the gradient of the logarithm of the target density. In this paper we study the efficiency of MALA on a…

Probability · Mathematics 2012-11-29 Natesh S. Pillai , Andrew M. Stuart , Alexandre H. Thiéry

This letter investigates the convergence and concentration properties of the Stochastic Mirror Descent (SMD) algorithm utilizing biased stochastic subgradients. We establish the almost sure convergence of the algorithm's iterates under the…

Optimization and Control · Mathematics 2024-07-09 Anik Kumar Paul , Arun D Mahindrakar , Rachel K Kalaimani

Langevin diffusion is a commonly used tool for sampling from a given distribution. In this work, we establish that when the target density $p^*$ is such that $\log p^*$ is $L$ smooth and $m$ strongly convex, discrete Langevin diffusion…

Machine Learning · Statistics 2017-11-02 Xiang Cheng , Peter Bartlett

We consider the problem of sampling from a strongly log-concave density in $\mathbb{R}^d$, and prove a non-asymptotic upper bound on the mixing time of the Metropolis-adjusted Langevin algorithm (MALA). The method draws samples by…

Machine Learning · Statistics 2019-12-12 Raaz Dwivedi , Yuansi Chen , Martin J. Wainwright , Bin Yu

The unadjusted Langevin algorithm is commonly used to sample probability distributions in extremely high-dimensional settings. However, existing analyses of the algorithm for strongly log-concave distributions suggest that, as the dimension…

Machine Learning · Statistics 2025-09-05 Yifan Chen , Xiaoou Cheng , Jonathan Niles-Weed , Jonathan Weare

In this paper, we examine the computational complexity of sampling from a Bayesian posterior (or pseudo-posterior) using the Metropolis-adjusted Langevin algorithm (MALA). MALA first employs a discrete-time Langevin SDE to propose a new…

Statistics Theory · Mathematics 2024-05-10 Rong Tang , Yun Yang

We present new policy mirror descent (PMD) methods for solving reinforcement learning (RL) problems with either strongly convex or general convex regularizers. By exploring the structural properties of these overall highly nonconvex…

Machine Learning · Computer Science 2022-04-08 Guanghui Lan

We provide a clarification of the description of Langevin diffusions on Riemannian manifolds and of the measure underlying the invariant density. As a result we propose a new position-dependent Metropolis-adjusted Langevin algorithm (MALA)…

Methodology · Statistics 2014-08-15 Tatiana Xifara , Chris Sherlock , Samuel Livingstone , Simon Byrne , Mark Girolami

This article considers the popular MCMC method of unadjusted Langevin Monte Carlo (LMC) and provides a non-asymptotic analysis of its sampling error in 2-Wasserstein distance. The proof is based on a refinement of mean-square analysis in Li…

Machine Learning · Computer Science 2022-02-22 Ruilin Li , Hongyuan Zha , Molei Tao

Explicit, momentum-based dynamics for optimizing functions defined on Lie groups was recently constructed, based on techniques such as variational optimization and left trivialization. We appropriately add tractable noise to the…

Statistics Theory · Mathematics 2024-06-19 Lingkai Kong , Molei Tao

This paper presents a new Metropolis-adjusted Langevin algorithm (MALA) that uses convex analysis to simulate efficiently from high-dimensional densities that are log-concave, a class of probability distributions that is widely used in…

Methodology · Statistics 2015-04-06 Marcelo Pereyra

This paper presents a comprehensive convergence analysis for the mirror descent (MD) method, a widely used algorithm in convex optimization. The key feature of this algorithm is that it provides a generalization of classical gradient-based…

Optimization and Control · Mathematics 2024-09-16 Mengmou Li , Khaled Laib , Takeshi Hatanaka , Ioannis Lestas

In this paper, we investigate a continuous time version of the Stochastic Langevin Monte Carlo method, introduced in [WT11], that incorporates a stochastic sampling step inside the traditional over-damped Langevin diffusion. This method is…

Machine Learning · Statistics 2023-01-10 Marelys Crespo Navas , Sébastien Gadat , Xavier Gendre

In this article, we study the problem of sampling from distributions whose densities are not necessarily smooth nor logconcave. We propose a simple Langevin-based algorithm that does not rely on popular but computationally challenging…

Machine Learning · Statistics 2025-12-02 Tim Johnston , Iosif Lytras , Nikolaos Makras , Sotirios Sabanis

We consider the problem of sampling distributions stemming from non-convex potentials with Unadjusted Langevin Algorithm (ULA). We prove the stability of the discrete-time ULA to drift approximations under the assumption that the potential…

Machine Learning · Statistics 2025-09-01 Marien Renaud , Valentin De Bortoli , Arthur Leclaire , Nicolas Papadakis