中文
相关论文

相关论文: A Non-Asymptotic Analysis for Stein Variational Gr…

200 篇论文

Stein variational gradient descent (SVGD) is a non-parametric inference algorithm that evolves a set of particles to fit a given distribution of interest. We analyze the non-asymptotic properties of SVGD, showing that there exists a set of…

机器学习 · 统计学 2018-10-30 Qiang Liu , Dilin Wang

We provide the first finite-particle convergence rate for Stein variational gradient descent (SVGD), a popular algorithm for approximating a probability distribution with a collection of particles. Specifically, whenever the target…

机器学习 · 计算机科学 2023-11-03 Jiaxin Shi , Lester Mackey

Stein Variational Gradient Descent (SVGD) is an algorithm for sampling from a target density which is known up to a multiplicative constant. Although SVGD is a popular algorithm in practice, its theoretical study is limited to a few recent…

机器学习 · 计算机科学 2022-06-20 Adil Salim , Lukang Sun , Peter Richtárik

Stein Variational Gradient Descent (SVGD) is a popular variational inference algorithm which simulates an interacting particle system to approximately sample from a target distribution, with impressive empirical performance across various…

机器学习 · 统计学 2023-10-09 Aniket Das , Dheeraj Nagaraj

Stein Variational Gradient Descent (SVGD) is a popular sampling algorithm used in various machine learning tasks. It is well known that SVGD arises from a discretization of the kernelized gradient flow of the Kullback-Leibler divergence…

机器学习 · 计算机科学 2022-11-22 Lukang Sun , Peter Richtárik

Stein variational gradient descent (SVGD) is a deterministic sampling algorithm that iteratively transports a set of particles to approximate given distributions, based on an efficient gradient-based update that guarantees to optimally…

机器学习 · 统计学 2017-11-15 Qiang Liu

Stein Variational Gradient Descent (SVGD) is a nonparametric particle-based deterministic sampling algorithm. Despite its wide usage, understanding the theoretical properties of SVGD has remained a challenging problem. For sampling from a…

统计理论 · 数学 2023-10-31 Tianle Liu , Promit Ghosal , Krishnakumar Balasubramanian , Natesh S. Pillai

Stein Variational Gradient Descent (SVGD) is an important alternative to the Langevin-type algorithms for sampling from probability distributions of the form $\pi(x) \propto \exp(-V(x))$. In the existing theory of Langevin-type algorithms…

统计理论 · 数学 2022-06-02 Lukang Sun , Avetik Karagulyan , Peter Richtarik

Stein variational gradient descent (SVGD) is a kernel-based and non-parametric particle method for sampling from a target distribution, such as in Bayesian inference and other machine learning tasks. Different from other particle methods,…

最优化与控制 · 数学 2025-10-02 Viktor Stein , Wuchen Li

Stein variational gradient descent (SVGD) is a kernel-based particle method for sampling from a target distribution, e.g., in generative modeling and Bayesian inference. SVGD does not require estimating the gradient of the log-density,…

机器学习 · 统计学 2025-04-10 Viktor Stein , Wuchen Li

Particle-based approximate Bayesian inference approaches such as Stein Variational Gradient Descent (SVGD) combine the flexibility and convergence guarantees of sampling methods with the computational benefits of variational inference. In…

机器学习 · 计算机科学 2021-07-30 Lauro Langosco di Langosco , Vincent Fortuin , Heiko Strathmann

Stein variational gradient descent (SVGD) is a prominent particle-based variational inference method used for sampling a target distribution. SVGD has attracted interest for application in machine-learning techniques such as Bayesian…

机器学习 · 计算机科学 2024-02-26 Yuya Kawamura , Satoshi Takabe

Stein variational gradient descent (SVGD) was recently proposed as a general purpose nonparametric variational inference algorithm [Liu & Wang, NIPS 2016]: it minimizes the Kullback-Leibler divergence between the target distribution and its…

机器学习 · 统计学 2018-10-31 Gianluca Detommaso , Tiangang Cui , Alessio Spantini , Youssef Marzouk , Robert Scheichl

Stein variational gradient descent (SVGD) is a particle-based inference algorithm that leverages gradient information for efficient approximate inference. In this work, we enhance SVGD by leveraging preconditioning matrices, such as the…

机器学习 · 统计学 2019-11-06 Dilin Wang , Ziyang Tang , Chandrajit Bajaj , Qiang Liu

Stein Variational Gradient Descent (SVGD) is a widely used in practice algorithm for scalable sampling with deterministic particle updates. We study its behavior in the singular limit where the kernel bandwidth tends to zero. In this…

偏微分方程分析 · 数学 2026-05-06 José A. Carrillo , Jakub Skrzeczkowski , Jethro Warnett

We present a new particle filtering algorithm for nonlinear systems in the discrete-time setting. Our algorithm is based on the Stein variational gradient descent (SVGD) framework, which is a general approach to sample from a target…

计算工程、金融与科学 · 计算机科学 2021-06-22 Jiaojiao Fan , Amirhossein Taghvaei , Yongxin Chen

In this paper we propose and analyze a novel multilevel version of Stein variational gradient descent (SVGD). SVGD is a recent particle based variational inference method. For Bayesian inverse problems with computationally expensive…

数值分析 · 数学 2024-02-05 Simon Weissmann , Jakob Zech

A central challenge in Bayesian inference is efficiently approximating posterior distributions. Stein Variational Gradient Descent (SVGD) is a popular variational inference method which transports a set of particles to approximate a target…

机器学习 · 统计学 2025-12-05 Moritz Melcher , Simon Weissmann , Ashia C. Wilson , Jakob Zech

We provide finite-particle convergence rates for the Stein Variational Gradient Descent (SVGD) algorithm in the Kernelized Stein Discrepancy ($\mathsf{KSD}$) and Wasserstein-2 metrics. Our key insight is that the time derivative of the…

统计理论 · 数学 2025-06-10 Sayan Banerjee , Krishnakumar Balasubramanian , Promit Ghosal

Stein variational gradient descent (SVGD) and its variants have shown promising successes in approximate inference for complex distributions. In practice, we notice that the kernel used in SVGD-based methods has a decisive effect on the…

机器学习 · 计算机科学 2022-11-29 Qingzhong Ai , Shiyu Liu , Lirong He , Zenglin Xu
‹ 上一页 1 2 3 10 下一页 ›