English
Related papers

Related papers: Particle filter-based Gaussian process optimisatio…

200 papers

We consider Bayesian inference when only a limited number of noisy log-likelihood evaluations can be obtained. This occurs for example when complex simulator-based statistical models are fitted to data, and synthetic likelihood (SL) method…

Machine Learning · Statistics 2020-03-09 Marko Järvenpää , Michael Gutmann , Aki Vehtari , Pekka Marttinen

Markov chain Monte Carlo methods for exponential family models with intractable normalizing constant, such as the exchange algorithm, require simulations of the sufficient statistics at every iteration of the Markov chain, which often…

Computation · Statistics 2023-02-21 Quan Vu , Matthew T. Moores , Andrew Zammit-Mangion

Maximizing the likelihood has been widely used for estimating the unknown covariance parameters of spatial Gaussian processes. However, evaluating and optimizing the likelihood function can be computationally intractable, particularly for…

Statistics Theory · Mathematics 2019-07-16 Hossein Keshavarz , XuanLong Nguyen , Clayton Scott

Estimating online the parameters of general state-space hidden Markov models is a topic of importance in many scientific and engineering disciplines. In this paper we present an online parameter estimation algorithm obtained by casting our…

Computation · Statistics 2016-02-25 Jimmy Olsson , Johan Westerborn

A Bayesian filtering algorithm is developed for a class of state-space systems that can be modelled via Gaussian mixtures. In general, the exact solution to this filtering problem involves an exponential growth in the number of mixture…

Machine Learning · Statistics 2023-07-03 Adrian G. Wills , Johannes Hendriks , Christopher Renton , Brett Ninness

We study the class of state-space models and perform maximum likelihood estimation for the model parameters. We consider a stochastic approximation expectation-maximization (SAEM) algorithm to maximize the likelihood function with the…

Computation · Statistics 2017-10-25 Umberto Picchini , Adeline Samson

State-space models provide an important body of techniques for analyzing time-series, but their use requires estimating unobserved states. The optimal estimate of the state is its conditional expectation given the observation histories, and…

Inference for partially observed Markov process models has been a longstanding methodological challenge with many scientific and engineering applications. Iterated filtering algorithms maximize the likelihood function for partially observed…

Statistics Theory · Mathematics 2012-11-26 Edward L. Ionides , Anindya Bhadra , Yves Atchadé , Aaron King

Parameter estimation is a major challenge in computational modeling of biological processes. This is especially the case in image-based modeling where the inherently quantitative output of the model is measured against image data, which is…

Quantitative Methods · Quantitative Biology 2018-07-27 Diana Barac , Michael D. Multerer , Dagmar Iber

In this letter, we present a novel Gaussian Process Learning-based Probabilistic Optimal Power Flow (GP-POPF) for solving POPF under renewable and load uncertainties of arbitrary distribution. The proposed method relies on a non-parametric…

Systems and Control · Electrical Eng. & Systems 2020-04-17 Parikshit Pareek , Hung D. Nguyen

One of the pivotal tasks in scientific machine learning is to represent underlying dynamical systems from time series data. Many methods for such dynamics learning explicitly require the derivatives of state data, which are not directly…

Machine Learning · Computer Science 2024-04-17 Dongwei Ye , Mengwu Guo

We develop a (nearly) unbiased particle filtering algorithm for a specific class of continuous-time state-space models, such that (a) the latent process $X_t$ is a linear Gaussian diffusion; and (b) the observations arise from a Poisson…

Computation · Statistics 2023-11-07 Ruiyang Jin , Sumeetpal S. Singh , Nicolas Chopin

We present an offline, iterated particle filter to facilitate statistical inference in general state space hidden Markov models. Given a model and a sequence of observations, the associated marginal likelihood L is central to…

Computation · Statistics 2016-06-16 Pieralberto Guarniero , Adam M. Johansen , Anthony Lee

Parameter estimation is crucial for modeling, tracking, and control of complex dynamical systems. However, parameter uncertainties can compromise system performance under a controller relying on nominal parameter values. Typically,…

Robotics · Computer Science 2020-02-20 Mouhyemen Khan , Abhijit Chatterjee

In this paper, a dual estimation methodology is developed for both time-varying parameters and states of a nonlinear stochastic system based on the Particle Filtering (PF) scheme. Our developed methodology is based on a concurrent…

Systems and Control · Computer Science 2016-06-29 Najmeh Daroogheh , Nader Meskin , Khashayar Khorasani

In this paper, we propose a probabilistic optimization method, named probabilistic incremental proximal gradient (PIPG) method, by developing a probabilistic interpretation of the incremental proximal gradient algorithm. We explicitly model…

Optimization and Control · Mathematics 2019-06-20 Ömer Deniz Akyildiz , Émilie Chouzenoux , Víctor Elvira , Joaquín Míguez

This paper considers parameter estimation for nonlinear state-space models, which is an important but challenging problem. We address this challenge by employing a variational inference (VI) approach, which is a principled method that has…

Machine Learning · Statistics 2022-09-15 Jarrad Courts , Adrian Wills , Thomas Schön , Brett Ninness

The recent direct observation of gravitational waves has further emphasized the desire for fast, low-cost, and accurate methods to infer the parameters of gravitational wave sources. Due to expense in waveform generation and data handling,…

General Relativity and Quantum Cosmology · Physics 2017-07-05 Richard O'Shaughnessy , Jonathan Blackman , Scott E. Field

We develop a computational procedure to estimate the covariance hyperparameters for semiparametric Gaussian process regression models with additive noise. Namely, the presented method can be used to efficiently estimate the variance of the…

Machine Learning · Computer Science 2022-06-22 Siavash Ameli , Shawn C. Shadden

We consider a sequential decision making task, where the goal is to optimize an unknown function without evaluating parameters that violate an a~priori unknown (safety) constraint. A common approach is to place a Gaussian process prior on…

Machine Learning · Computer Science 2024-05-13 Alessandro G. Bottero , Carlos E. Luis , Julia Vinogradska , Felix Berkenkamp , Jan Peters