English
Related papers

Related papers: Stochastic Zeroth-order Discretizations of Langevi…

200 papers

An Euler discretization of the Langevin diffusion is known to converge to the global minimizers of certain convex and non-convex optimization problems. We show that this property holds for any suitably smooth diffusion and that different…

Machine Learning · Statistics 2019-12-30 Murat A. Erdogdu , Lester Mackey , Ohad Shamir

While low-precision optimization has been widely used to accelerate deep learning, low-precision sampling remains largely unexplored. As a consequence, sampling is simply infeasible in many large-scale scenarios, despite providing…

Machine Learning · Computer Science 2022-06-22 Ruqi Zhang , Andrew Gordon Wilson , Christopher De Sa

Langevin algorithms are gradient descent methods with additive noise. They have been used for decades in Markov chain Monte Carlo (MCMC) sampling, optimization, and learning. Their convergence properties for unconstrained non-convex…

Machine Learning · Computer Science 2020-12-23 Andrew Lamperski

In this paper, we study and analyze zeroth-order stochastic approximation algorithms for solving bilvel problems, when neither the upper/lower objective values, nor their unbiased gradient estimates are available. In particular, exploiting…

Optimization and Control · Mathematics 2024-04-02 Alireza Aghasi , Saeed Ghadimi

The stochastic gradient Langevin Dynamics is one of the most fundamental algorithms to solve sampling problems and non-convex optimization appearing in several machine learning applications. Especially, its variance reduced versions have…

Machine Learning · Computer Science 2022-11-22 Yuri Kinoshita , Taiji Suzuki

This paper presents a new accelerated proximal Markov chain Monte Carlo methodology to perform Bayesian inference in imaging inverse problems with an underlying convex geometry. The proposed strategy takes the form of a stochastic relaxed…

Algorithms based on discretizing Langevin diffusion are popular tools for sampling from high-dimensional distributions. We develop novel connections between such Monte Carlo algorithms, the theory of Wasserstein gradient flow, and the…

Computation · Statistics 2019-05-13 Espen Bernton

In the machine learning literature stochastic gradient descent has recently been widely discussed for its purported implicit regularization properties. Much of the theory, that attempts to clarify the role of noise in stochastic gradient…

Machine Learning · Computer Science 2022-10-21 Alberto Lanconelli , Christopher S. A. Lauria

Uncertainty quantification for deep learning is a challenging open problem. Bayesian statistics offer a mathematically grounded framework to reason about uncertainties; however, approximate posteriors for modern neural networks still…

Machine Learning · Statistics 2020-01-23 Nicolas Brosse , Carlos Riquelme , Alice Martin , Sylvain Gelly , Éric Moulines

We prove quantitative convergence rates at which discrete Langevin-like processes converge to the invariant distribution of a related stochastic differential equation. We study the setup where the additive noise can be non-Gaussian and…

Machine Learning · Computer Science 2020-11-20 Xiang Cheng , Dong Yin , Peter L. Bartlett , Michael I. Jordan

A systematic procedure for optimising the friction coefficient in underdamped Langevin dynamics as a sampling tool is given by taking the gradient of the associated asymptotic variance with respect to friction. We give an expression for…

Computation · Statistics 2023-11-01 Martin Chak , Nikolas Kantas , Tony Lelièvre , Grigorios A. Pavliotis

We analyse the privacy leakage of noisy stochastic gradient descent by modeling R\'enyi divergence dynamics with Langevin diffusions. Inspired by recent work on non-stochastic algorithms, we derive similar desirable properties in the…

Machine Learning · Statistics 2022-02-08 Théo Ryffel , Francis Bach , David Pointcheval

This paper presents a novel stochastic optimisation methodology to perform empirical Bayesian inference in semi-blind image deconvolution problems. Given a blurred image and a parametric class of possible operators, the proposed…

Applications · Statistics 2024-03-12 Charlesquin Kemajou Mbakam , Marcelo Pereyra , Jean-François Giovannelli

We present a framework that allows for the non-asymptotic study of the $2$-Wasserstein distance between the invariant distribution of an ergodic stochastic differential equation and the distribution of its numerical approximation in the…

Machine Learning · Statistics 2021-09-27 J. M. Sanz-Serna , Konstantinos C. Zygalakis

A central issue in machine learning is how to train models on sensitive user data. Industry has widely adopted a simple algorithm: Stochastic Gradient Descent with noise (a.k.a. Stochastic Gradient Langevin Dynamics). However, foundational…

Machine Learning · Computer Science 2023-03-01 Jason M. Altschuler , Kunal Talwar

Sampling with Markov chain Monte Carlo methods often amounts to discretizing some continuous-time dynamics with numerical integration. In this paper, we establish the convergence rate of sampling algorithms obtained by discretizing smooth…

Machine Learning · Statistics 2020-02-04 Xuechen Li , Denny Wu , Lester Mackey , Murat A. Erdogdu

We introduce adaptive, tuning-free step size schedules for gradient-based sampling algorithms obtained as time-discretizations of Wasserstein gradient flows. The result is a suite of tuning-free sampling algorithms, including tuning-free…

Methodology · Statistics 2025-10-30 Louis Sharrock , Christopher Nemeth

Derivative-free optimization has become an important technique used in machine learning for optimizing black-box models. To conduct updates without explicitly computing gradient, most current approaches iteratively sample a random search…

Machine Learning · Statistics 2018-08-03 Liu Liu , Minhao Cheng , Cho-Jui Hsieh , Dacheng Tao

Many living and complex systems exhibit second order emergent dynamics. Limited experimental access to the configurational degrees of freedom results in data that appears to be generated by a non-Markovian process. This poses a challenge in…

Quantitative Methods · Quantitative Biology 2020-07-29 Federica Ferretti , Victor Chardès , Thierry Mora , Aleksandra M. Walczak , Irene Giardina

Stochastic differential equations of Langevin-diffusion form have received significant attention, thanks to their foundational role in both Bayesian sampling algorithms and optimization in machine learning. In the latter, they serve as a…

Optimization and Control · Mathematics 2024-05-14 Fabio V. Difonzo , Vyacheslav Kungurtsev , Jakub Marecek