中文
相关论文

相关论文: Neural Variational Gradient Descent

200 篇论文

Stein variational gradient descent (SVGD) is a non-parametric inference algorithm that evolves a set of particles to fit a given distribution of interest. We analyze the non-asymptotic properties of SVGD, showing that there exists a set of…

机器学习 · 统计学 2018-10-30 Qiang Liu , Dilin Wang

Stein variational gradient descent (SVGD) is a particle-based inference algorithm that leverages gradient information for efficient approximate inference. In this work, we enhance SVGD by leveraging preconditioning matrices, such as the…

机器学习 · 统计学 2019-11-06 Dilin Wang , Ziyang Tang , Chandrajit Bajaj , Qiang Liu

Ensembles of deep neural networks have achieved great success recently, but they do not offer a proper Bayesian justification. Moreover, while they allow for averaging of predictions over several hypotheses, they do not provide any…

机器学习 · 计算机科学 2021-06-23 Francesco D'Angelo , Vincent Fortuin , Florian Wenzel

Bayesian computation plays an important role in modern machine learning and statistics to reason about uncertainty. A key computational challenge in Bayesian inference is to develop efficient techniques to approximate, or draw samples from…

数值分析 · 数学 2021-09-01 Liang Yan , Tao Zhou

Stein variational gradient descent (SVGD) is a kernel-based particle method for sampling from a target distribution, e.g., in generative modeling and Bayesian inference. SVGD does not require estimating the gradient of the log-density,…

机器学习 · 统计学 2025-04-10 Viktor Stein , Wuchen Li

Stein variational gradient descent (SVGD) is a kernel-based and non-parametric particle method for sampling from a target distribution, such as in Bayesian inference and other machine learning tasks. Different from other particle methods,…

最优化与控制 · 数学 2025-10-02 Viktor Stein , Wuchen Li

Stein variational gradient descent (SVGD) is a prominent particle-based variational inference method used for sampling a target distribution. SVGD has attracted interest for application in machine-learning techniques such as Bayesian…

机器学习 · 计算机科学 2024-02-26 Yuya Kawamura , Satoshi Takabe

A central challenge in Bayesian inference is efficiently approximating posterior distributions. Stein Variational Gradient Descent (SVGD) is a popular variational inference method which transports a set of particles to approximate a target…

机器学习 · 统计学 2025-12-05 Moritz Melcher , Simon Weissmann , Ashia C. Wilson , Jakob Zech

Stein Variational Gradient Descent (SVGD) is a nonparametric particle-based deterministic sampling algorithm. Despite its wide usage, understanding the theoretical properties of SVGD has remained a challenging problem. For sampling from a…

统计理论 · 数学 2023-10-31 Tianle Liu , Promit Ghosal , Krishnakumar Balasubramanian , Natesh S. Pillai

In this paper we propose and analyze a novel multilevel version of Stein variational gradient descent (SVGD). SVGD is a recent particle based variational inference method. For Bayesian inverse problems with computationally expensive…

数值分析 · 数学 2024-02-05 Simon Weissmann , Jakob Zech

Stein variational gradient descent (SVGD) and its variants have shown promising successes in approximate inference for complex distributions. In practice, we notice that the kernel used in SVGD-based methods has a decisive effect on the…

机器学习 · 计算机科学 2022-11-29 Qingzhong Ai , Shiyu Liu , Lirong He , Zenglin Xu

We study the Stein Variational Gradient Descent (SVGD) algorithm, which optimises a set of particles to approximate a target probability distribution $\pi\propto e^{-V}$ on $\mathbb{R}^d$. In the population limit, SVGD performs gradient…

机器学习 · 统计学 2021-01-05 Anna Korba , Adil Salim , Michael Arbel , Giulia Luise , Arthur Gretton

We propose a novel particle-based variational inference method designed to work with multimodal distributions. Our approach, referred to as Branched Stein Variational Gradient Descent (BSVGD), extends the classical Stein Variational…

机器学习 · 计算机科学 2025-07-18 Isaías Bañales , Arturo Jaramillo , Joshué Helí Ricalde-Guerrero

Stein variational gradient descent (SVGD) refers to a class of methods for Bayesian inference based on interacting particle systems. In this paper, we consider the originally proposed deterministic dynamics as well as a stochastic variant,…

机器学习 · 统计学 2021-02-26 Nikolas Nüsken , D. R. Michiel Renger

We are interested in gradient-based Explicit Generative Modeling where samples can be derived from iterative gradient updates based on an estimate of the score function of the data distribution. Recent advances in Stochastic Gradient…

机器学习 · 统计学 2020-07-08 Wei-Cheng Chang , Chun-Liang Li , Youssef Mroueh , Yiming Yang

Stein Variational Gradient Descent (SVGD) is a popular variational inference algorithm which simulates an interacting particle system to approximately sample from a target distribution, with impressive empirical performance across various…

机器学习 · 统计学 2023-10-09 Aniket Das , Dheeraj Nagaraj

Stein variational gradient descent (SVGD) was recently proposed as a general purpose nonparametric variational inference algorithm [Liu & Wang, NIPS 2016]: it minimizes the Kullback-Leibler divergence between the target distribution and its…

机器学习 · 统计学 2018-10-31 Gianluca Detommaso , Tiangang Cui , Alessio Spantini , Youssef Marzouk , Robert Scheichl

Stein variational gradient descent (SVGD) is a recently proposed particle-based Bayesian inference method, which has attracted a lot of interest due to its remarkable approximation ability and particle efficiency compared to traditional…

机器学习 · 统计学 2018-06-11 Jingwei Zhuo , Chang Liu , Jiaxin Shi , Jun Zhu , Ning Chen , Bo Zhang

Stein variational gradient descent (SVGD) is a deterministic sampling algorithm that iteratively transports a set of particles to approximate given distributions, based on an efficient gradient-based update that guarantees to optimally…

机器学习 · 统计学 2017-11-15 Qiang Liu

Gradient-based approximate inference methods, such as Stein variational gradient descent (SVGD), provide simple and general-purpose inference engines for differentiable continuous distributions. However, existing forms of SVGD cannot be…

机器学习 · 计算机科学 2020-03-03 Jun Han , Fan Ding , Xianglong Liu , Lorenzo Torresani , Jian Peng , Qiang Liu
‹ 上一页 1 2 3 10 下一页 ›