English
Related papers

Related papers: Sequential Gaussian Variational Inference for Nonl…

200 papers

Inference for GP models with non-Gaussian noises is computationally expensive when dealing with large datasets. Many recent inference methods approximate the posterior distribution with a simpler distribution defined on a small number of…

Machine Learning · Computer Science 2018-09-11 Linfeng Liu , Liping Liu

Variational inference is a powerful approach for approximate posterior inference. However, it is sensitive to initialization and can be subject to poor local optima. In this paper, we develop proximity variational inference (PVI). PVI is a…

Machine Learning · Statistics 2017-05-26 Jaan Altosaar , Rajesh Ranganath , David M. Blei

Motivated by the maneuvering target tracking with sensors such as radar and sonar, this paper considers the joint and recursive estimation of the dynamic state and the time-varying process noise covariance in nonlinear state space models.…

Systems and Control · Electrical Eng. & Systems 2023-05-09 Hua Lan , Jinjie Hu , Zengfu Wang , Qiang Cheng

Bayesian inference for complex models with an intractable likelihood can be tackled using algorithms performing many calls to computer simulators. These approaches are collectively known as "simulation-based inference" (SBI). Recent SBI…

Learning dynamical models from data is not only fundamental but also holds great promise for advancing principle discovery, time-series prediction, and controller design. Among various approaches, Gaussian Process State-Space Models…

Machine Learning · Computer Science 2025-10-20 Tengjie Zheng , Haipeng Chen , Lin Cheng , Shengping Gong , Xu Huang

Accurate platform localization is an integral component of most robotic systems. As these robotic systems become more ubiquitous, it is necessary to develop robust state estimation algorithms that are able to withstand novel and…

Robotics · Computer Science 2019-10-15 Ryan M. Watson , Jason N. Gross , Clark N. Taylor , Robert C. Leishman

Seismic full-waveform inversion (FWI) provides high resolution images of the subsurface by exploiting information in the recorded seismic waveforms. This is achieved by solving a highly nonnlinear and nonunique inverse problem. Bayesian…

Geophysics · Physics 2023-02-22 Xin Zhang , Angus Lomas , Muhong Zhou , York Zheng , Andrew Curtis

Recent advances in the fields of robotics and automation have spurred significant interest in robust state estimation. To enable robust state estimation, several methodologies have been proposed. One such technique, which has shown…

Signal Processing · Electrical Eng. & Systems 2019-10-15 Ryan M. Watson , Jason N. Gross , Clark N. Taylor , Robert C. Leishman

We exploit the observation that stochastic variational inference (SVI) is a form of annealing and present a modified SVI approach -- applicable to both large and small datasets -- that allows the amount of annealing done by SVI to be tuned.…

Machine Learning · Computer Science 2025-11-17 John Paisley , Ghazal Fazelnia , Brian Barr

Gaussian processes are a flexible Bayesian nonparametric modelling approach that has been widely applied but poses computational challenges. To address the poor scaling of exact inference methods, approximation methods based on sparse…

Machine Learning · Statistics 2021-06-01 Rui Meng , Herbert Lee , Soper Braden , Priyadip Ray

Gaussian processes (GPs) provide a framework for Bayesian inference that can offer principled uncertainty estimates for a large range of problems. For example, if we consider regression problems with Gaussian likelihoods, a GP model enjoys…

Machine Learning · Computer Science 2022-12-21 Felix Leibfried , Vincent Dutordoir , ST John , Nicolas Durrande

Stein Variational Gradient Descent (SVGD) is a nonparametric particle-based deterministic sampling algorithm. Despite its wide usage, understanding the theoretical properties of SVGD has remained a challenging problem. For sampling from a…

Statistics Theory · Mathematics 2023-10-31 Tianle Liu , Promit Ghosal , Krishnakumar Balasubramanian , Natesh S. Pillai

We propose a new method for autonomous navigation in uneven terrains by utilizing a sparse Gaussian Process (SGP) based local perception model. The SGP local perception model is trained on local ranging observation (pointcloud) to learn the…

Robotics · Computer Science 2024-02-22 Hassan Jardali , Mahmoud Ali , Lantao Liu

Variational empirical Bayes (VEB) methods provide a practically attractive approach to fitting large, sparse, multiple regression models. These methods usually use coordinate ascent to optimize the variational objective function, an…

Methodology · Statistics 2024-11-25 Saikat Banerjee , Peter Carbonetto , Matthew Stephens

We develop nested variational inference (NVI), a family of methods that learn proposals for nested importance samplers by minimizing an forward or reverse KL divergence at each level of nesting. NVI is applicable to many commonly-used…

Machine Learning · Statistics 2021-06-22 Heiko Zimmermann , Hao Wu , Babak Esmaeili , Jan-Willem van de Meent

We propose an optimization algorithm for Variational Inference (VI) in complex models. Our approach relies on natural gradient updates where the variational space is a Riemann manifold. We develop an efficient algorithm for Gaussian…

Machine Learning · Statistics 2024-04-18 Martin Magris , Mostafa Shabani , Alexandros Iosifidis

Bayesian inference represents a principled way to incorporate Earth structure uncertainty in full-waveform moment tensor inversions, but traditional approaches generally require significant approximations that risk biasing the resulting…

Geophysics · Physics 2026-03-20 A. A. Saoulis , T. -S. Pham , A. M. G. Ferreira

We consider the problem of sequential estimation of the unknowns of state-space and deep state-space models that include estimation of functions and latent processes of the models. The proposed approach relies on Gaussian and deep Gaussian…

Machine Learning · Computer Science 2024-03-26 Yuhao Liu , Marzieh Ajirak , Petar Djuric

Deep learning offers promising new ways to accurately model aleatoric uncertainty in robotic state estimation systems, particularly when the uncertainty distributions do not conform to traditional assumptions of being fixed and Gaussian. In…

Machine Learning · Computer Science 2025-02-28 Aastha Acharya , Caleb Lee , Marissa D'Alonzo , Jared Shamwell , Nisar R. Ahmed , Rebecca Russell

An incremental/online state dynamic learning method is proposed for identification of the nonlinear Gaussian state space models. The method embeds the stochastic variational sparse Gaussian process as the probabilistic state dynamic model…

Machine Learning · Statistics 2016-08-31 Vahid Bastani , Lucio Marcenaro , Carlo Regazzoni