中文
相关论文

相关论文: Improved Stein Variational Gradient Descent with I…

200 篇论文

We study the Stein Variational Gradient Descent (SVGD) algorithm, which optimises a set of particles to approximate a target probability distribution $\pi\propto e^{-V}$ on $\mathbb{R}^d$. In the population limit, SVGD performs gradient…

机器学习 · 统计学 2021-01-05 Anna Korba , Adil Salim , Michael Arbel , Giulia Luise , Arthur Gretton

Stein Variational Gradient Descent (SVGD) is an algorithm for sampling from a target density which is known up to a multiplicative constant. Although SVGD is a popular algorithm in practice, its theoretical study is limited to a few recent…

机器学习 · 计算机科学 2022-06-20 Adil Salim , Lukang Sun , Peter Richtárik

Stein Variational Gradient Descent (SVGD), a popular sampling algorithm, is often described as the kernelized gradient flow for the Kullback-Leibler divergence in the geometry of optimal transport. We introduce a new perspective on SVGD…

统计理论 · 数学 2020-06-05 Sinho Chewi , Thibaut Le Gouic , Chen Lu , Tyler Maunu , Philippe Rigollet

Stein variational gradient descent (SVGD) was recently proposed as a general purpose nonparametric variational inference algorithm [Liu & Wang, NIPS 2016]: it minimizes the Kullback-Leibler divergence between the target distribution and its…

机器学习 · 统计学 2018-10-31 Gianluca Detommaso , Tiangang Cui , Alessio Spantini , Youssef Marzouk , Robert Scheichl

Stein variational gradient descent (SVGD) is a deterministic sampling algorithm that iteratively transports a set of particles to approximate given distributions, based on an efficient gradient-based update that guarantees to optimally…

机器学习 · 统计学 2017-11-15 Qiang Liu

Stein Variational Gradient Descent (SVGD) is a widely used in practice algorithm for scalable sampling with deterministic particle updates. We study its behavior in the singular limit where the kernel bandwidth tends to zero. In this…

偏微分方程分析 · 数学 2026-05-06 José A. Carrillo , Jakub Skrzeczkowski , Jethro Warnett

Stein variational gradient descent (SVGD) is a kernel-based particle method for sampling from a target distribution, e.g., in generative modeling and Bayesian inference. SVGD does not require estimating the gradient of the log-density,…

机器学习 · 统计学 2025-04-10 Viktor Stein , Wuchen Li

Stein Variational Gradient Descent (SVGD) is a nonparametric particle-based deterministic sampling algorithm. Despite its wide usage, understanding the theoretical properties of SVGD has remained a challenging problem. For sampling from a…

统计理论 · 数学 2023-10-31 Tianle Liu , Promit Ghosal , Krishnakumar Balasubramanian , Natesh S. Pillai

Stein Variational Gradient Descent (SVGD) is an important alternative to the Langevin-type algorithms for sampling from probability distributions of the form $\pi(x) \propto \exp(-V(x))$. In the existing theory of Langevin-type algorithms…

统计理论 · 数学 2022-06-02 Lukang Sun , Avetik Karagulyan , Peter Richtarik

Stein variational gradient descent (SVGD) is a kernel-based and non-parametric particle method for sampling from a target distribution, such as in Bayesian inference and other machine learning tasks. Different from other particle methods,…

最优化与控制 · 数学 2025-10-02 Viktor Stein , Wuchen Li

Stein variational gradient descent (SVGD) is a non-parametric inference algorithm that evolves a set of particles to fit a given distribution of interest. We analyze the non-asymptotic properties of SVGD, showing that there exists a set of…

机器学习 · 统计学 2018-10-30 Qiang Liu , Dilin Wang

Stein variational gradient descent (SVGD) is a particle-based inference algorithm that leverages gradient information for efficient approximate inference. In this work, we enhance SVGD by leveraging preconditioning matrices, such as the…

机器学习 · 统计学 2019-11-06 Dilin Wang , Ziyang Tang , Chandrajit Bajaj , Qiang Liu

Stein Variational Gradient Descent (SVGD) is a popular variational inference algorithm which simulates an interacting particle system to approximately sample from a target distribution, with impressive empirical performance across various…

机器学习 · 统计学 2023-10-09 Aniket Das , Dheeraj Nagaraj

A central challenge in Bayesian inference is efficiently approximating posterior distributions. Stein Variational Gradient Descent (SVGD) is a popular variational inference method which transports a set of particles to approximate a target…

机器学习 · 统计学 2025-12-05 Moritz Melcher , Simon Weissmann , Ashia C. Wilson , Jakob Zech

We propose a novel adaptive importance sampling algorithm which incorporates Stein variational gradient decent algorithm (SVGD) with importance sampling (IS). Our algorithm leverages the nonparametric transforms in SVGD to iteratively…

机器学习 · 统计学 2017-07-26 Jun Han , Qiang Liu

Stein Variational Gradient Descent (SVGD) is a deterministic interacting-particle method for sampling from a target probability measure given access to its score function. In the mean-field and continuous-time limit, it is known that the…

机器学习 · 统计学 2026-05-12 Lénaïc Chizat , Maria Colombo , Roberto Colombo , Xavier Fernández-Real

In this paper we propose and analyze a novel multilevel version of Stein variational gradient descent (SVGD). SVGD is a recent particle based variational inference method. For Bayesian inverse problems with computationally expensive…

数值分析 · 数学 2024-02-05 Simon Weissmann , Jakob Zech

Stein variational gradient descent (SVGD) and its variants have shown promising successes in approximate inference for complex distributions. In practice, we notice that the kernel used in SVGD-based methods has a decisive effect on the…

机器学习 · 计算机科学 2022-11-29 Qingzhong Ai , Shiyu Liu , Lirong He , Zenglin Xu

The Stein Variational Gradient Descent (SVGD) algorithm is a deterministic particle method for sampling. However, a mean-field analysis reveals that the gradient flow corresponding to the SVGD algorithm (i.e., the Stein Variational Gradient…

机器学习 · 统计学 2024-05-10 Ye He , Krishnakumar Balasubramanian , Bharath K. Sriperumbudur , Jianfeng Lu

Particle-based approximate Bayesian inference approaches such as Stein Variational Gradient Descent (SVGD) combine the flexibility and convergence guarantees of sampling methods with the computational benefits of variational inference. In…

机器学习 · 计算机科学 2021-07-30 Lauro Langosco di Langosco , Vincent Fortuin , Heiko Strathmann
‹ 上一页 1 2 3 10 下一页 ›