English
Related papers

Related papers: Particle-based Gaussian process optimization for i…

200 papers

Bayesian Optimization using Gaussian Processes is a popular approach to deal with the optimization of expensive black-box functions. However, because of the a priori on the stationarity of the covariance matrix of classic Gaussian…

Machine Learning · Statistics 2019-05-10 Ali Hebbal , Loic Brevault , Mathieu Balesdent , El-Ghazali Talbi , Nouredine Melab

We propose a method to optimise the parameters of a policy which will be used to safely perform a given task in a data-efficient manner. We train a Gaussian process model to capture the system dynamics, based on the PILCO framework. Our…

Machine Learning · Statistics 2019-12-03 Kyriakos Polymenakos , Alessandro Abate , Stephen Roberts

Nonlinear/non-Gaussian filtering has broad applications in many areas of life sciences where either the dynamic is nonlinear and/or the probability density function of uncertain state is non-Gaussian. In such problems, the accuracy of the…

Computation · Statistics 2012-08-02 Hatef Monajemi , Peter K. Kitanidis

High-dimensional optimization is a critical challenge for operating large-scale scientific facilities. We apply a physics-informed Gaussian process (GP) optimizer to tune a complex system by conducting efficient global search. Typical GP…

Computational Physics · Physics 2021-07-14 Adi Hanuka , X. Huang , J. Shtalenkova , D. Kennedy , A. Edelen , V. R. Lalchand , D. Ratner , J. Duris

Gaussian mixtures are a common density representation in nonlinear, non-Gaussian Bayesian state estimation. Selecting an appropriate number of Gaussian components, however, is difficult as one has to trade of computational complexity…

Systems and Control · Computer Science 2012-04-02 Marco F. Huber

In this paper, a new framework, named as graphical state space model, is proposed for the real time optimal estimation of a class of nonlinear state space model. By discretizing this kind of system model as an equation which can not be…

Systems and Control · Electrical Eng. & Systems 2022-11-10 Shaolin Lü

We present a kernel-independent method that applies hierarchical matrices to the problem of maximum likelihood estimation for Gaussian processes. The proposed approximation provides natural and scalable stochastic estimators for its…

Computation · Statistics 2019-03-26 Christopher J. Geoga , Mihai Anitescu , Michael L. Stein

We present a novel Kalman filter for spatiotemporal systems called the numerical Gaussian process Kalman filter (GPKF). Numerical Gaussian processes have recently been introduced as a physics informed machine learning method for simulating…

Systems and Control · Electrical Eng. & Systems 2021-05-06 Armin Küper , Steffen Waldherr

The particle filter is one of the most successful methods for state inference and identification of general non-linear and non-Gaussian models. However, standard particle filters suffer from degeneracy of the particle weights, in particular…

Computation · Statistics 2022-10-27 Anna Wigren , Lawrence Murray , Fredrik Lindsten

Physical computing is a technology utilizing the nature of electronic devices and circuit topology to cope with computing tasks. In this paper, we propose an active circuit network to implement multi-scale Gaussian filter, which is also…

Computer Vision and Pattern Recognition · Computer Science 2014-08-12 Yi Li , Qi Wei , Fei Qiao , Huazhong Yang

In this article, an overview of Bayesian methods for sequential simulation from posterior distributions of nonlinear and non-Gaussian dynamic systems is presented. The focus is mainly laid on sequential Monte Carlo methods, which are based…

Methodology · Statistics 2023-04-28 Konstantinos E. Tatsis , Vasilis K. Dertimanis , Eleni N. Chatzi

We introduce Bayesian optimization, a technique developed for optimizing time-consuming engineering simulations and for fitting machine learning models on large datasets. Bayesian optimization guides the choice of experiments during…

Machine Learning · Statistics 2017-11-22 Peter I. Frazier , Jialei Wang

Gaussian-process state-space models (GP-SSMs) provide a flexible nonparametric alternative for modeling time-series dynamics that are nonlinear or difficult to specify parametrically. While the Kalman filter is effective for linear-Gaussian…

Methodology · Statistics 2025-12-02 Genshiro Kitagawa

Gaussian process state-space models (GP-SSMs) are a very flexible family of models of nonlinear dynamical systems. They comprise a Bayesian nonparametric representation of the dynamics of the system and additional (hyper-)parameters…

Machine Learning · Statistics 2013-12-18 Roger Frigola , Fredrik Lindsten , Thomas B. Schön , Carl E. Rasmussen

We combine conditional state density construction with an extension of the Scenario Approach for stochastic Model Predictive Control to nonlinear systems to yield a novel particle-based formulation of stochastic nonlinear output-feedback…

Optimization and Control · Mathematics 2020-05-01 Martin A. Sehr , Robert R. Bitmead

We propose a dynamical scaling analysis improved by a deep learning approach. While Gaussian process regression has been widely employed for estimating scaling parameters, its computational cost for parameter optimization becomes a…

Statistical Mechanics · Physics 2026-05-18 Yusuke Terasawa , Yukiyasu Ozeki

Particle filtering is a popular method for inferring latent states in stochastic dynamical systems, whose theoretical properties have been well studied in machine learning and statistics communities. In many control problems, e.g.,…

Machine Learning · Computer Science 2021-07-12 Simon S. Du , Wei Hu , Zhiyuan Li , Ruoqi Shen , Zhao Song , Jiajun Wu

One of the pivotal tasks in scientific machine learning is to represent underlying dynamical systems from time series data. Many methods for such dynamics learning explicitly require the derivatives of state data, which are not directly…

Machine Learning · Computer Science 2024-04-17 Dongwei Ye , Mengwu Guo

Bayesian filtering approximates the true underlying behavior of a time-varying system by inverting an explicit generative model to convert noisy measurements into state estimates. This process typically requires either storage, inversion,…

Machine Learning · Computer Science 2023-11-20 Gianluca M. Bencomo , Jake C. Snell , Thomas L. Griffiths

A new formulation of the particle filter for nonlinear filtering is presented, based on concepts from optimal control, and from the mean-field game theory. The optimal control is chosen so that the posterior distribution of a particle…

Numerical Analysis · Mathematics 2013-02-27 Tao Yang , Prashant G. Mehta , Sean P. Meyn