English
Related papers

Related papers: Message Passing Stein Variational Gradient Descent

200 papers

In this paper, we propose an infinite-dimensional version of the Stein variational gradient descent (iSVGD) method for solving Bayesian inverse problems. The method can generate approximate samples from posteriors efficiently. Based on the…

Numerical Analysis · Mathematics 2026-02-09 Junxiong Jia , Peijun Li , Deyu Meng

In Bayesian inference, the posterior distributions are difficult to obtain analytically for complex models such as neural networks. Variational inference usually uses a parametric distribution for approximation, from which we can easily…

Machine Learning · Statistics 2019-02-01 Futoshi Futami , Zhenghang Cui , Issei Sato , Masashi Sugiyama

Multilevel Stein variational gradient descent is a method for particle-based variational inference that leverages hierarchies of surrogate target distributions with varying costs and fidelity to computationally speed up inference. The…

Numerical Analysis · Mathematics 2023-05-02 Terrence Alsup , Tucker Hartland , Benjamin Peherstorfer , Noemi Petra

Stochastic gradient descent (SGD) provides a simple and efficient way to solve a broad range of machine learning problems. Here, we focus on distribution regression (DR), involving two stages of sampling: Firstly, we regress from…

Machine Learning · Statistics 2021-03-08 Nicole Mücke

Stein discrepancies (SDs) monitor convergence and non-convergence in approximate inference when exact integration and sampling are intractable. However, the computation of a Stein discrepancy can be prohibitive if the Stein operator - often…

Machine Learning · Statistics 2020-10-26 Jackson Gorham , Anant Raj , Lester Mackey

The fluctuation effect of gradient expectation and variance caused by parameter update between consecutive iterations is neglected or confusing by current mainstream gradient optimization algorithms.Using this fluctuation effect, combined…

Machine Learning · Statistics 2022-02-23 Aixiang , Chen , Jinting Zhang , Zanbo Zhang , Zhihong Li

Stochastic Gradient Descent with a constant learning rate (constant SGD) simulates a Markov chain with a stationary distribution. With this perspective, we derive several new results. (1) We show that constant SGD can be used as an…

Machine Learning · Statistics 2018-01-23 Stephan Mandt , Matthew D. Hoffman , David M. Blei

Distributed Stein Variational Gradient Descent (DSVGD) is a non-parametric distributed learning framework for federated Bayesian learning, where multiple clients jointly train a machine learning model by communicating a number of non-random…

Machine Learning · Computer Science 2023-03-14 Jiarong Yang , Yuan Liu , Rahif Kassab

We study a variation of vanilla stochastic gradient descent where the optimizer only has access to a Markovian sampling scheme. These schemes encompass applications that range from decentralized optimization with a random walker (token…

Optimization and Control · Mathematics 2023-06-26 Mathieu Even

Stochastic gradient descent (SGD) is a popular algorithm for optimization problems arising in high-dimensional inference tasks. Here one produces an estimator of an unknown parameter from independent samples of data by iteratively…

Machine Learning · Statistics 2023-06-23 Gerard Ben Arous , Reza Gheissari , Aukosh Jagannath

Particle-based Bayesian inference methods by sampling from a partition-free target (posterior) distribution, e.g., Stein variational gradient descent (SVGD), have attracted significant attention. We propose a path-guided particle-based…

Machine Learning · Computer Science 2024-12-05 Mingzhou Fan , Ruida Zhou , Chao Tian , Xiaoning Qian

This work presents a multilevel variant of Stein variational gradient descent to more efficiently sample from target distributions. The key ingredient is a sequence of distributions with growing fidelity and costs that converges to the…

Numerical Analysis · Mathematics 2021-04-06 Terrence Alsup , Luca Venturi , Benjamin Peherstorfer

Decentralized stochastic gradient method emerges as a promising solution for solving large-scale machine learning problems. This paper studies the decentralized Markov chain gradient descent (DMGD) algorithm - a variant of the decentralized…

Optimization and Control · Mathematics 2021-04-14 Tao Sun , Dongsheng Li

Distributed stochastic gradient descent~(DSGD) has been widely used for optimizing large-scale machine learning models, including both convex and non-convex models. With the rapid growth of model size, huge communication cost has been the…

Machine Learning · Statistics 2019-05-31 Shen-Yi Zhao , Hao Gao , Wu-Jun Li

Particle based optimization algorithms have recently been developed as sampling methods that iteratively update a set of particles to approximate a target distribution. In particular Stein variational gradient descent has gained attention…

Machine Learning · Computer Science 2021-03-19 Francesco D'Angelo , Vincent Fortuin

Stochastic Gradient Descent (SGD) is an important algorithm in machine learning. With constant learning rates, it is a stochastic process that, after an initial phase of convergence, generates samples from a stationary distribution. We show…

Machine Learning · Statistics 2017-09-12 Stephan Mandt , Matthew D. Hoffman , David M. Blei

This paper examines the spatial coverage optimization problem for multiple sensors in a known convex environment, where the coverage service of each sensor is heterogeneous and anisotropic. We introduce the Stein Coverage algorithm, a…

Multiagent Systems · Computer Science 2023-12-13 Donipolo Ghimire , Solmaz S. Kia

Stochastic gradient descent (SGD) is a prevalent optimization technique for large-scale distributed machine learning. While SGD computation can be efficiently divided between multiple machines, communication typically becomes a bottleneck…

Machine Learning · Computer Science 2021-05-24 Dmitrii Avdiukhin , Grigory Yaroslavtsev

We consider a variant of the stochastic gradient descent (SGD) with a random learning rate and reveal its convergence properties. SGD is a widely used stochastic optimization algorithm in machine learning, especially deep learning. Numerous…

Machine Learning · Statistics 2025-09-09 Naoki Yoshida , Shogo Nakakita , Masaaki Imaizumi

We derive finite-particle rates for the regularized Stein variational gradient descent (R-SVGD) algorithm introduced by He et al. (2024) that corrects the constant-order bias of the SVGD by applying a resolvent-type preconditioner to the…

Machine Learning · Statistics 2026-05-19 Ye He , Krishnakumar Balasubramanian , Sayan Banerjee , Promit Ghosal