English

Stein Variational Gradient Descent dynamics for highly concentrated kernels

Analysis of PDEs 2026-05-06 v1

Abstract

Stein Variational Gradient Descent (SVGD) is a widely used in practice algorithm for scalable sampling with deterministic particle updates. We study its behavior in the singular limit where the kernel bandwidth tends to zero. In this regime, we show that the nonlocal SVGD dynamics converge to a local evolution equation that can be formally interpreted as a Wasserstein gradient flow with quadratic mobility. We analyze this singular limit in two settings: integrable kernels and weighted kernels. In the weighted case, the proof is supported by recently established Stein-log-Sobolev inequalities, which provide the necessary functional control. Overall, our results clarify how SVGD collapses from a nonlocal interacting particle system to a local gradient-flow dynamics as the kernel concentrates.

Keywords

Cite

@article{arxiv.2605.03627,
  title  = {Stein Variational Gradient Descent dynamics for highly concentrated kernels},
  author = {José A. Carrillo and Jakub Skrzeczkowski and Jethro Warnett},
  journal= {arXiv preprint arXiv:2605.03627},
  year   = {2026}
}

Comments

37 pages

R2 v1 2026-07-01T12:50:38.612Z