English
Related papers

Related papers: Weak in the NEES?: Auto-tuning Kalman Filters with…

200 papers

Many state estimation algorithms must be tuned given the state space process and observation models, the process and observation noise parameters must be chosen. Conventional tuning approaches rely on heuristic hand-tuning or gradient-based…

Systems and Control · Electrical Eng. & Systems 2019-12-19 Zhaozhong Chen , Nisar Ahmed , Simon Julier , Christoffer Heckman

The nonlinear and stochastic relationship between noise covariance parameter values and state estimator performance makes optimal filter tuning a very challenging problem. Popular optimization-based tuning approaches can easily get trapped…

Robotics · Computer Science 2023-06-13 Zhaozhong Chen , Harel Biggie , Nisar Ahmed , Simon Julier , Christoffer Heckman

In this paper, we propose an approach to address the problems with ambiguity in tuning the process and observation noises for a discrete-time linear Kalman filter. Conventional approaches to tuning (e.g. using normalized estimation error…

Systems and Control · Electrical Eng. & Systems 2021-08-25 Zhaozhong Chen , Christoffer Heckman , Simon Julier , Nisar Ahmed

Bayesian Optimization is the state of the art technique for the optimization of black boxes, i.e., functions where we do not have access to their analytical expression nor its gradients, they are expensive to evaluate and its evaluation is…

Artificial Intelligence · Computer Science 2021-01-13 Eduardo C. Garrido Merchán , Luis C. Jariego Pérez

The Kalman filter is a fundamental filtering algorithm that fuses noisy sensory data, a previous state estimate, and a dynamics model to produce a principled estimate of the current state. It assumes, and is optimal for, linear models and…

Neural and Evolutionary Computing · Computer Science 2021-04-30 Beren Millidge , Alexander Tschantz , Anil Seth , Christopher Buckley

Kalman filters provide a straightforward and interpretable means to estimate hidden or latent variables, and have found numerous applications in control, robotics, signal processing, and machine learning. One such application is neural…

Machine Learning · Computer Science 2024-01-29 Josue Casco-Rodriguez , Caleb Kemere , Richard G. Baraniuk

Bayesian optimization provides an effective method to optimize expensive-to-evaluate black box functions. It has been widely applied to problems in many fields, including notably in computer science, e.g. in machine learning to optimize…

Machine Learning · Computer Science 2025-11-18 Mike Diessner , Joseph O'Connor , Andrew Wynn , Sylvain Laizet , Yu Guan , Kevin Wilson , Richard D. Whalley

Bayesian optimization is a powerful global optimization technique for expensive black-box functions. One of its shortcomings is that it requires auxiliary optimization of an acquisition function at each iteration. This auxiliary…

Machine Learning · Statistics 2014-02-28 Ziyu Wang , Babak Shakibi , Lin Jin , Nando de Freitas

Bayesian Optimization (BO) is an effective approach for global optimization of black-box functions when function evaluations are expensive. Most prior works use Gaussian processes to model the black-box function, however, the use of kernels…

Machine Learning · Computer Science 2023-09-25 Dat Phan-Trong , Hung Tran-The , Sunil Gupta

Prediction error and maximum likelihood methods are powerful tools for identifying linear dynamical systems and, in particular, enable the joint estimation of model parameters and the Kalman filter used for state estimation. A key…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Léo Simpson , Moritz Diehl

Popular Bayes filters typically rely on linearization techniques such as Taylor series expansion and stochastic linear regression to use the structure of standard Kalman filter. These techniques may introduce large estimation errors in…

Systems and Control · Electrical Eng. & Systems 2025-07-17 Wenhan Cao , Tianyi Zhang , Shengbo Eben Li

Bayesian optimization is a sequential method for minimizing objective functions that are expensive to evaluate and about which few assumptions can be made. By using all gathered data to train a Gaussian process model for the function and…

Machine Learning · Computer Science 2026-05-07 Jesse Schneider , William J. Welch

Bayesian filtering approximates the true underlying behavior of a time-varying system by inverting an explicit generative model to convert noisy measurements into state estimates. This process typically requires either storage, inversion,…

Machine Learning · Computer Science 2023-11-20 Gianluca M. Bencomo , Jake C. Snell , Thomas L. Griffiths

Structural identification and damage detection can be generalized as the simultaneous estimation of input forces, physical parameters, and dynamical states. Although Kalman-type filters are efficient tools to address this problem, the…

Applications · Statistics 2022-10-04 Daniz Teymouri , Omid Sedehi , Lambros S. Katafygiotis , Costas Papadimitriou

Many contemporary machine learning models require extensive tuning of hyperparameters to perform well. A variety of methods, such as Bayesian optimization, have been developed to automate and expedite this process. However, tuning remains…

Machine Learning · Computer Science 2020-02-25 Setareh Ariafar , Zelda Mariet , Ehsan Elhamifar , Dana Brooks , Jennifer Dy , Jasper Snoek

Kalman filtering is a classic state estimation technique used in application areas such as signal processing and autonomous control of vehicles. It is now being used to solve problems in computer systems such as controlling the voltage and…

Systems and Control · Electrical Eng. & Systems 2019-07-01 Yan Pei , Swarnendu Biswas , Donald S. Fussell , Keshav Pingali

Bayesian optimization is a popular and versatile approach that is well suited to solve challenging optimization problems. Their popularity comes from their effective minimization of expensive function evaluations, their capability to…

Optimization and Control · Mathematics 2026-05-14 André L. Marchildon , David W. Zingg

Bayesian optimization is a sample-efficient method for solving expensive, black-box optimization problems. Stochastic programming concerns optimization under uncertainty where, typically, average performance is the quantity of interest. In…

Machine Learning · Statistics 2025-02-19 Jack M. Buckingham , Ivo Couckuyt , Juergen Branke

Likelihood functions evaluated using particle filters are typically noisy, computationally expensive, and non-differentiable due to Monte Carlo variability. These characteristics make conventional optimization methods difficult to apply…

Methodology · Statistics 2026-01-13 Genshiro Kitagawa

Bayesian optimisation has proven to be a powerful tool for expensive global black-box optimisation problems. In this paper, we propose new Bayesian optimisation variants of the popular Knowledge Gradient acquisition functions for problems…

Machine Learning · Computer Science 2025-12-22 Xietao Wang Lin , Juan Ungredda , Max Butler , James Town , Alma Rahat , Hemant Singh , Juergen Branke
‹ Prev 1 2 3 10 Next ›