English
Related papers

Related papers: Stein-based Optimization of Sampling Distributions…

200 papers

We propose a new Stein self-repulsive dynamics for obtaining diversified samples from intractable un-normalized distributions. Our idea is to introduce Stein variational gradient as a repulsive force to push the samples of Langevin dynamics…

Machine Learning · Computer Science 2020-12-16 Mao Ye , Tongzheng Ren , Qiang Liu

Stein variational gradient descent (SVGD) is a kernel-based and non-parametric particle method for sampling from a target distribution, such as in Bayesian inference and other machine learning tasks. Different from other particle methods,…

Optimization and Control · Mathematics 2025-10-02 Viktor Stein , Wuchen Li

Performative prediction (PP) is an algorithmic framework for optimizing machine learning (ML) models where the model's deployment affects the distribution of the data it is trained on. Compared to traditional ML with fixed data, designing…

Machine Learning · Computer Science 2025-09-24 Tian Xie , Ding Zhu , Jia Liu , Mahdi Khalili , Xueru Zhang

In this work, we present a novel sampling-based path planning method, called SPRINT. The method finds solutions for high dimensional path planning problems quickly and robustly. Its efficiency comes from minimizing the number of collision…

Robotics · Computer Science 2021-06-02 Daniel Rakita , Bilge Mutlu , Michael Gleicher

Stein variational gradient descent (SVGD) and its variants have shown promising successes in approximate inference for complex distributions. In practice, we notice that the kernel used in SVGD-based methods has a decisive effect on the…

Machine Learning · Computer Science 2022-11-29 Qingzhong Ai , Shiyu Liu , Lirong He , Zenglin Xu

Deep Gaussian Process (DGP) models offer a powerful nonparametric approach for Bayesian inference, but exact inference is typically intractable, motivating the use of various approximations. However, existing approaches, such as mean-field…

Machine Learning · Computer Science 2025-08-13 Jian Xu , Shian Du , Junmei Yang , Qianli Ma , Delu Zeng

This work develops a stochastic model predictive controller~(SMPC) for uncertain linear systems with additive Gaussian noise subject to state and control constraints. The proposed approach is based on the recently developed finite-horizon…

Optimization and Control · Mathematics 2019-11-26 Kazuhide Okamoto , Panagiotis Tsiotras

Over the last few years, sampling-based stochastic optimal control (SOC) frameworks have shown impressive performances in reinforcement learning (RL) with applications in robotics. However, such approaches require a large amount of samples…

Systems and Control · Computer Science 2014-12-10 Yunpeng Pan , Evangelos A. Theodorou , Michail Kontitsis

Stochastic Gradient Descent (SGD) is one of the most widely used techniques for online optimization in machine learning. In this work, we accelerate SGD by adaptively learning how to sample the most useful training examples at each time…

Machine Learning · Computer Science 2016-03-16 Guillaume Bouchard , Théo Trouillon , Julien Perez , Adrien Gaidon

Accurately controlling a robotic system in real time is a challenging problem. To address this, the robotics community has adopted various algorithms, such as Model Predictive Control (MPC) and Model Predictive Path Integral (MPPI) control.…

Hardware Architecture · Computer Science 2026-01-21 Erwan Tanguy-Legac , Tommaso Belvedere , Gianluca Corsini , Marco Tognon , Marcello Traiola

Stein variational gradient descent (SVGD) is a deterministic particle inference algorithm that provides an efficient alternative to Markov chain Monte Carlo. However, SVGD has been found to suffer from variance underestimation when the…

Machine Learning · Statistics 2022-03-14 Xing Liu , Harrison Zhu , Jean-François Ton , George Wynne , Andrew Duncan

Particle based optimization algorithms have recently been developed as sampling methods that iteratively update a set of particles to approximate a target distribution. In particular Stein variational gradient descent has gained attention…

Machine Learning · Computer Science 2021-03-19 Francesco D'Angelo , Vincent Fortuin

Ensuring safe physical interaction between torque-controlled manipulators and humans is essential for deploying robots in everyday environments. Model Predictive Control (MPC) has emerged as a suitable framework thanks to its capacity to…

Navigating safely in dynamic and uncertain environments is challenging due to uncertainties in perception and motion. This letter presents the Chance-Constrained Unscented Model Predictive Path Integral (C2U-MPPI) framework, a robust…

Robotics · Computer Science 2025-05-29 Ihab S. Mohamed , Mahmoud Ali , Lantao Liu

We present a new particle filtering algorithm for nonlinear systems in the discrete-time setting. Our algorithm is based on the Stein variational gradient descent (SVGD) framework, which is a general approach to sample from a target…

Computational Engineering, Finance, and Science · Computer Science 2021-06-22 Jiaojiao Fan , Amirhossein Taghvaei , Yongxin Chen

Stochastic Gradient Descent (SGD) is a popular optimization method which has been applied to many important machine learning tasks such as Support Vector Machines and Deep Neural Networks. In order to parallelize SGD, minibatch training is…

Machine Learning · Statistics 2014-05-14 Peilin Zhao , Tong Zhang

In this paper, we propose a new technique named \textit{Stochastic Path-Integrated Differential EstimatoR} (SPIDER), which can be used to track many deterministic quantities of interest with significantly reduced computational cost. We…

Optimization and Control · Mathematics 2018-10-18 Cong Fang , Chris Junchi Li , Zhouchen Lin , Tong Zhang

Safe decision-making algorithms for control of mobile robots often require the existence of feedback to verify the safety of proposed actions. This feedback is assumed to be directly available during the development or deployment of the…

Machine Learning · Computer Science 2026-05-26 Jeff Pflueger , Michael Everett

Stochastic Gradient Descent (SGD) is an important algorithm in machine learning. With constant learning rates, it is a stochastic process that, after an initial phase of convergence, generates samples from a stationary distribution. We show…

Machine Learning · Statistics 2017-09-12 Stephan Mandt , Matthew D. Hoffman , David M. Blei

In this paper, we consider a modified version of the control problem in a model free Markov decision process (MDP) setting with large state and action spaces. The control problem most commonly addressed in the contemporary literature is to…

Artificial Intelligence · Computer Science 2018-02-01 Ajin George Joseph , Shalabh Bhatnagar