English
Related papers

Related papers: Stein Variational Gradient Descent-based Detection…

200 papers

Stein variational gradient descent (SVGD) is a particle-based inference algorithm that leverages gradient information for efficient approximate inference. In this work, we enhance SVGD by leveraging preconditioning matrices, such as the…

Machine Learning · Statistics 2019-11-06 Dilin Wang , Ziyang Tang , Chandrajit Bajaj , Qiang Liu

The lack of an efficient preamble detection algorithm remains a challenge for solving preamble collision problems in intelligent random access (RA) in the cellular Internet of Things (IoT). To address this problem, we present an early…

Information Theory · Computer Science 2025-01-22 Xin Zhu , Ahmet Enis Cetin

Stein variational gradient descent (SVGD) is a kernel-based particle method for sampling from a target distribution, e.g., in generative modeling and Bayesian inference. SVGD does not require estimating the gradient of the log-density,…

Machine Learning · Statistics 2025-04-10 Viktor Stein , Wuchen Li

Stein variational gradient descent (SVGD) is a recently proposed particle-based Bayesian inference method, which has attracted a lot of interest due to its remarkable approximation ability and particle efficiency compared to traditional…

Machine Learning · Statistics 2018-06-11 Jingwei Zhuo , Chang Liu , Jiaxin Shi , Jun Zhu , Ning Chen , Bo Zhang

Stein variational gradient descent (SVGD) is a deterministic sampling algorithm that iteratively transports a set of particles to approximate given distributions, based on an efficient gradient-based update that guarantees to optimally…

Machine Learning · Statistics 2017-11-15 Qiang Liu

Stein variational gradient descent (SVGD) is a non-parametric inference algorithm that evolves a set of particles to fit a given distribution of interest. We analyze the non-asymptotic properties of SVGD, showing that there exists a set of…

Machine Learning · Statistics 2018-10-30 Qiang Liu , Dilin Wang

Stein variational gradient descent (SVGD) is a prominent particle-based variational inference method used for sampling a target distribution. SVGD has attracted interest for application in machine-learning techniques such as Bayesian…

Machine Learning · Computer Science 2024-02-26 Yuya Kawamura , Satoshi Takabe

Stein variational gradient descent (SVGD) is a deterministic particle inference algorithm that provides an efficient alternative to Markov chain Monte Carlo. However, SVGD has been found to suffer from variance underestimation when the…

Machine Learning · Statistics 2022-03-14 Xing Liu , Harrison Zhu , Jean-François Ton , George Wynne , Andrew Duncan

We propose a novel particle-based variational inference method designed to work with multimodal distributions. Our approach, referred to as Branched Stein Variational Gradient Descent (BSVGD), extends the classical Stein Variational…

Machine Learning · Computer Science 2025-07-18 Isaías Bañales , Arturo Jaramillo , Joshué Helí Ricalde-Guerrero

Stein variational gradient descent (SVGD) is a kernel-based and non-parametric particle method for sampling from a target distribution, such as in Bayesian inference and other machine learning tasks. Different from other particle methods,…

Optimization and Control · Mathematics 2025-10-02 Viktor Stein , Wuchen Li

Particle-based approximate Bayesian inference approaches such as Stein Variational Gradient Descent (SVGD) combine the flexibility and convergence guarantees of sampling methods with the computational benefits of variational inference. In…

Machine Learning · Computer Science 2021-07-30 Lauro Langosco di Langosco , Vincent Fortuin , Heiko Strathmann

Stein Variational Gradient Descent (SVGD) is a highly efficient method to sample from an unnormalized probability distribution. However, the SVGD update relies on gradients of the log-density, which may not always be available. Existing…

Machine Learning · Computer Science 2026-03-13 Cornelius V. Braun , Robert T. Lange , Marc Toussaint

We show how to use Stein variational gradient descent (SVGD) to carry out inference in Gaussian process (GP) models with non-Gaussian likelihoods and large data volumes. Markov chain Monte Carlo (MCMC) is extremely computationally intensive…

Machine Learning · Statistics 2022-01-20 Thomas Pinder , Christopher Nemeth , David Leslie

In this paper we propose and analyze a novel multilevel version of Stein variational gradient descent (SVGD). SVGD is a recent particle based variational inference method. For Bayesian inverse problems with computationally expensive…

Numerical Analysis · Mathematics 2024-02-05 Simon Weissmann , Jakob Zech

In this project, we propose a Variational Inference algorithm to approximate posterior distributions. Building on prior methods, we develop the Gradient-Steered Stein Variational Gradient Descent (G-SVGD) approach. This method introduces a…

Computation · Statistics 2025-02-03 Jose L. Varona-Santana , Marcos A. Capistrán

We propose in this work RBM-SVGD, a stochastic version of Stein Variational Gradient Descent (SVGD) method for efficiently sampling from a given probability measure and thus useful for Bayesian inference. The method is to apply the Random…

Machine Learning · Statistics 2020-06-24 Lei Li , Yingzhou Li , Jian-Guo Liu , Zibu Liu , Jianfeng Lu

We propose a novel distributed inference algorithm for continuous graphical models, by extending Stein variational gradient descent (SVGD) to leverage the Markov dependency structure of the distribution of interest. Our approach combines…

Machine Learning · Statistics 2018-06-11 Dilin Wang , Zhe Zeng , Qiang Liu

We study the Stein Variational Gradient Descent (SVGD) algorithm, which optimises a set of particles to approximate a target probability distribution $\pi\propto e^{-V}$ on $\mathbb{R}^d$. In the population limit, SVGD performs gradient…

Machine Learning · Statistics 2021-01-05 Anna Korba , Adil Salim , Michael Arbel , Giulia Luise , Arthur Gretton

Stein variational gradient decent (SVGD) has been shown to be a powerful approximate inference algorithm for complex distributions. However, the standard SVGD requires calculating the gradient of the target density and cannot be applied…

Machine Learning · Statistics 2018-06-08 Jun Han , Qiang Liu

Stein variational gradient descent (SVGD) refers to a class of methods for Bayesian inference based on interacting particle systems. In this paper, we consider the originally proposed deterministic dynamics as well as a stochastic variant,…

Machine Learning · Statistics 2021-02-26 Nikolas Nüsken , D. R. Michiel Renger
‹ Prev 1 2 3 10 Next ›