English
Related papers

Related papers: Particle filter-based Gaussian process optimisatio…

200 papers

Gaussian process state-space models (GPSSMs) provide a principled and flexible approach to modeling the dynamics of a latent state, which is observed at discrete-time points via a likelihood model. However, inference in GPSSMs is…

Machine Learning · Computer Science 2023-07-18 Xuhui Fan , Edwin V. Bonilla , Terence J. O'Kane , Scott A. Sisson

Many real world problems exhibit patterns that have periodic behavior. For example, in astrophysics, periodic variable stars play a pivotal role in understanding our universe. An important step when analyzing data from such processes is the…

Machine Learning · Computer Science 2012-08-20 Yuyang Wang , Roni Khardon , Pavlos Protopapas

Particle Filtering (PF) methods are an established class of procedures for performing inference in non-linear state-space models. Resampling is a key ingredient of PF, necessary to obtain low variance likelihood and states estimates.…

Machine Learning · Statistics 2021-07-01 Adrien Corenflos , James Thornton , George Deligiannidis , Arnaud Doucet

We present a novel Kalman filter for spatiotemporal systems called the numerical Gaussian process Kalman filter (GPKF). Numerical Gaussian processes have recently been introduced as a physics informed machine learning method for simulating…

Systems and Control · Electrical Eng. & Systems 2021-05-06 Armin Küper , Steffen Waldherr

We study the problem of likelihood maximization when the likelihood function is intractable but model simulations are readily available. We propose a sequential, gradient-based optimization method that directly models the Fisher score based…

Machine Learning · Statistics 2025-06-10 Sherman Khoo , Yakun Wang , Song Liu , Mark Beaumont

Particle Metropolis-Hastings (PMH) allows for Bayesian parameter inference in nonlinear state space models by combining Markov chain Monte Carlo (MCMC) and particle filtering. The latter is used to estimate the intractable likelihood. In…

Computation · Statistics 2016-04-01 Johan Dahlin , Fredrik Lindsten , Thomas B. Schön

This paper proposes a symbolic-numeric Bayesian filtering method for a class of discrete-time nonlinear stochastic systems to achieve high accuracy with a relatively small online computational cost. The proposed method is based on the…

Numerical Analysis · Mathematics 2022-03-23 Tomoyuki Iori , Toshiyuki Ohtsuka

Variational inference techniques based on inducing variables provide an elegant framework for scalable posterior estimation in Gaussian process (GP) models. Besides enabling scalability, one of their main advantages over sparse…

Machine Learning · Statistics 2021-02-24 Simone Rossi , Markus Heinonen , Edwin V. Bonilla , Zheyang Shen , Maurizio Filippone

Construction of kinetic models has become an indispensable step in the development and scale up of processes in the industry. Model-based design of experiments (MBDoE) has been widely used for the purpose of improving parameter precision in…

Systems and Control · Electrical Eng. & Systems 2021-04-15 Panagiotis Petsagkourakis , Federico Galvanin

In this paper, we consider static parameter estimation for a class of continuous-time state-space models. Our goal is to obtain an unbiased estimate of the gradient of the log-likelihood (score function), which is an estimate that is…

Machine Learning · Statistics 2021-06-01 Marco Ballesio , Ajay Jasra

A typical audio signal processing pipeline includes multiple disjoint analysis stages, including calculation of a time-frequency representation followed by spectrogram-based feature analysis. We show how time-frequency analysis and…

Machine Learning · Statistics 2019-04-30 William J. Wilkinson , Michael Riis Andersen , Joshua D. Reiss , Dan Stowell , Arno Solin

This paper focuses on designing a particle filter for randomly delayed measurements with an unknown latency probability. A generalized measurement model is adopted which includes measurements that are delayed randomly by an arbitrary but…

Signal Processing · Electrical Eng. & Systems 2018-03-22 Ranjeet Kumar Tiwari , Shovan Bhaumik , Paresh Date

We introduce neural information field filter, a Bayesian state and parameter estimation method for high-dimensional nonlinear dynamical systems given large measurement datasets. Solving such a problem using traditional methods, such as…

Machine Learning · Statistics 2024-12-17 Kairui Hao , Ilias Bilionis

This paper proposes a new feature screening method for the multi-response ultrahigh dimensional linear model by empirical likelihood. Through a multivariate moment condition, the empirical likelihood induced ranking statistics can exploit…

Methodology · Statistics 2022-06-07 Jun Lu , Qinqin Hu , Lu Lin

This paper addresses the estimation of parameters of a Bayesian network from incomplete data. The task is usually tackled by running the Expectation-Maximization (EM) algorithm several times in order to obtain a high log-likelihood…

Machine Learning · Computer Science 2015-03-19 Giorgio Corani , Cassio P. De Campos

The Kalman filter is the most powerful tool for estimation of the states of a linear Gaussian system. In addition, using this method, an expectation maximization algorithm can be used to estimate the parameters of the model. However, this…

Computation · Statistics 2020-06-01 Tsuyoshi Ishizone , Kazuyuki Nakamura

State-space models have been successfully used for more than fifty years in different areas of science and engineering. We present a procedure for efficient variational Bayesian learning of nonlinear state-space models based on sparse…

Machine Learning · Computer Science 2014-11-04 Roger Frigola , Yutian Chen , Carl E. Rasmussen

Many problems in the geophysical sciences demand the ability to calibrate the parameters and predict the time evolution of complex dynamical models using sequentially-collected data. Here we introduce a general methodology for the joint…

Computation · Statistics 2018-12-12 Sara Pérez-Vieites , Inés P. Mariño , Joaquín Míguez

Accurate estimation of the states of a nonlinear dynamical system is crucial for their design, synthesis, and analysis. Particle filters are estimators constructed by simulating trajectories from a sampling distribution and averaging them…

Signal Processing · Electrical Eng. & Systems 2023-02-03 Fernando Gama , Nicolas Zilberstein , Martin Sevilla , Richard Baraniuk , Santiago Segarra

In this work, we propose a non-parametric probabilistic load flow (NP-PLF) technique based on the Gaussian Process (GP) learning to understand the power system behavior under uncertainty for better operational decisions. The technique can…

Systems and Control · Electrical Eng. & Systems 2020-03-19 Parikshit Pareek , Chuan Wang , Hung D. Nguyen