English
Related papers

Related papers: Weak in the NEES?: Auto-tuning Kalman Filters with…

200 papers

Here we revisit the classic problem of linear quadratic estimation, i.e. estimating the trajectory of a linear dynamical system from noisy measurements. The celebrated Kalman filter gives an optimal estimator when the measurement noise is…

Machine Learning · Statistics 2021-11-12 Sitan Chen , Frederic Koehler , Ankur Moitra , Morris Yau

We develop a fast algorithm for Kalman Filter applied to the random walk forecast model. The key idea is an efficient representation of the estimate covariance matrix at each time-step as a weighted sum of two contributions - the process…

Numerical Analysis · Mathematics 2015-05-13 Arvind K. Saibaba , Eric Miller , Peter K. Kitanidis

Bayesian optimization methods have been successfully applied to black box optimization problems that are expensive to evaluate. In this paper, we adapt the so-called super effcient global optimization algorithm to solve more accurately…

Machine Learning · Statistics 2020-06-30 Rémy Priem , Nathalie Bartoli , Youssef Diouane , Alessandro Sgueglia

Application domains of Bayesian optimization include optimizing black-box functions or very complex functions. The functions we are interested in describe complex real-world systems applied in industrial settings. Even though they do have…

Machine Learning · Computer Science 2021-06-14 Franz Brauße , Zurab Khasidashvili , Konstantin Korovin

Bayesian Optimization is a very effective tool for optimizing expensive black-box functions. Inspired by applications developing and characterizing reaction chemistry using droplet microfluidic reactors, we consider a novel setting where…

Machine Learning · Computer Science 2023-01-12 Jose Pablo Folch , Shiqiang Zhang , Robert M Lee , Behrang Shafei , David Walz , Calvin Tsay , Mark van der Wilk , Ruth Misener

Bayesian Optimization (BO) is an effective method for finding the global optimum of expensive black-box functions. However, it is well known that applying BO to high-dimensional optimization problems is challenging. To address this issue, a…

Machine Learning · Statistics 2024-02-06 Lam Ngo , Huong Ha , Jeffrey Chan , Vu Nguyen , Hongyu Zhang

Acoustic howling suppression (AHS) is a critical challenge in audio communication systems. In this paper, we propose a novel approach that leverages the power of neural networks (NN) to enhance the performance of traditional Kalman filter…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-29 Yixuan Zhang , Hao Zhang , Meng Yu , Dong Yu

Bayesian optimization (BO) is a model-based approach to sequentially optimize expensive black-box functions, such as the validation error of a deep neural network with respect to its hyperparameters. In many real-world scenarios, the…

Machine Learning · Statistics 2019-10-17 Valerio Perrone , Iaroslav Shcherbatyi , Rodolphe Jenatton , Cedric Archambeau , Matthias Seeger

This paper proposes a novel convex optimization framework for designing robust Kalman filters that guarantee a user-specified steady-state error while maximizing process and sensor noise. The proposed framework simultaneously determines the…

Systems and Control · Electrical Eng. & Systems 2024-03-06 Himanshu Prabhat , Raktim Bhattacharya

The kernel least mean squares (KLMS) algorithm is a computationally efficient nonlinear adaptive filtering method that "kernelizes" the celebrated (linear) least mean squares algorithm. We demonstrate that the least mean squares algorithm…

Machine Learning · Statistics 2013-10-22 Il Memming Park , Sohan Seth , Steven Van Vaerenbergh

This paper presents an evaluation of a number of probabilistic algorithms for localization of autonomous underwater vehicles (AUVs) using bathymetry data. The algorithms, based on the principles of the Bayes filter, work by fusing…

Robotics · Computer Science 2019-10-14 Jungseok Hong , Michael Fulton , Junaed Sattar

Optimization of high-dimensional black-box functions is an extremely challenging problem. While Bayesian optimization has emerged as a popular approach for optimizing black-box functions, its applicability has been limited to…

Machine Learning · Statistics 2018-08-06 Zi Wang , Chengtao Li , Stefanie Jegelka , Pushmeet Kohli

We consider the problem of estimating the means $\mu_i$ of $n$ random variables $Y_i \sim N(\mu_i,1)$, $i=1,\ldots ,n$. Assuming some structure on the $\mu$ process, e.g., a state space model, one may use a summary statistics for the…

Statistics Theory · Mathematics 2014-06-05 E. Greenshtein , A. Mansura , Y. Ritov

Hyperparameter tuning is a challenging problem especially when the system itself involves uncertainty. Due to noisy function evaluations, optimization under uncertainty can be computationally expensive. In this paper, we present a novel…

Machine Learning · Computer Science 2025-10-09 Akash Yadav , Ruda Zhang

We consider black box optimization of an unknown function in the nonparametric Gaussian process setting when the noise in the observed function values can be heavy tailed. This is in contrast to existing literature that typically assumes…

Machine Learning · Computer Science 2019-09-17 Sayak Ray Chowdhury , Aditya Gopalan

The notion of expense in Bayesian optimisation generally refers to the uniformly expensive cost of function evaluations over the whole search space. However, in some scenarios, the cost of evaluation for black-box objective functions is…

Machine Learning · Computer Science 2019-09-10 Majid Abdolshah , Alistair Shilton , Santu Rana , Sunil Gupta , Svetha Venkatesh

The optimization of expensive-to-evaluate black-box functions over combinatorial structures is an ubiquitous task in machine learning, engineering and the natural sciences. The combinatorial explosion of the search space and costly…

Machine Learning · Statistics 2018-10-11 Ricardo Baptista , Matthias Poloczek

Many parameter estimation problems arising in applications are best cast in the framework of Bayesian inversion. This allows not only for an estimate of the parameters, but also for the quantification of uncertainties in the estimates.…

Computation · Statistics 2020-10-28 Emmet Cleary , Alfredo Garbuno-Inigo , Shiwei Lan , Tapio Schneider , Andrew M Stuart

Tuning particle accelerators is a challenging and time-consuming task that can be automated and carried out efficiently using suitable optimization algorithms, such as model-based Bayesian optimization techniques. One of the major…

Sequential Bayesian filters in non-linear dynamic systems require the recursive estimation of the predictive and posterior distributions. This paper introduces a Bayesian filter called the adaptive kernel Kalman filter (AKKF). With this…

Signal Processing · Electrical Eng. & Systems 2023-04-12 Mengwei Sun , Mike E. Davies , Ian K. Proudler , James R. Hopgood