English
Related papers

Related papers: Bayesian Optimization of Noisy Log-Likelihoods Eva…

200 papers

We introduce a new incremental preference elicitation procedure able to deal with noisy responses of a Decision Maker (DM). The originality of the contribution is to propose a Bayesian approach for determining a preferred solution in a…

Artificial Intelligence · Computer Science 2020-07-30 Nadjet Bourdache , Patrice Perny , Olivier Spanjaard

We propose a novel approach to input design for identification of nonlinear state space models. The optimal input sequence is obtained by maximizing a scalar cost function of the Fisher information matrix. Since the Fisher information…

Optimization and Control · Mathematics 2016-03-18 Patricio E. Valenzuela , Johan Dahlin , Cristian R. Rojas , Thomas B. Schön

Bayesian optimization is a coherent, ubiquitous approach to decision-making under uncertainty, with applications including multi-arm bandits, active learning, and black-box optimization. Bayesian optimization selects decisions (i.e.…

Machine Learning · Computer Science 2023-12-13 Samuel Stanton , Wesley Maddox , Andrew Gordon Wilson

Bayesian filtering is a well-known problem that aims to estimate plausible states of a dynamical system from observations. Among existing approaches to solve this problem, particle filters are theoretically exact for non-linear dynamics and…

Machine Learning · Computer Science 2026-05-20 Thomas Savary , François Rozet , Gilles Louppe

This paper deals with the identification of linear stochastic dynamical systems, where the unknowns include system coefficients and noise variances. Conventional approaches that rely on the maximum likelihood estimation (MLE) require…

Machine Learning · Statistics 2025-08-18 Jinwen Xu , Qin Lu , Yaakov Bar-Shalom

Several scenarios require the optimization of non-convex black-box functions, that are noisy expensive to evaluate functions with unknown analytical expression, whose gradients are hence not accessible. For example, the hyper-parameter…

Machine Learning · Computer Science 2025-02-12 Eduardo C. Garrido-Merchán

Bayesian optimization (BO) is a sequential approach for optimizing black-box objective functions using zeroth-order noisy observations. In BO, Gaussian processes (GPs) are employed as probabilistic surrogate models to estimate the objective…

Machine Learning · Computer Science 2025-04-02 Dongwon Kim , Matteo Zecchin , Sangwoo Park , Joonhyuk Kang , Osvaldo Simeone

We propose a method for optimal Bayesian filtering with deterministic particles. In order to avoid particle degeneration, the filter step is not performed at once. Instead, the particles progressively flow from prior to posterior. This is…

Machine Learning · Statistics 2023-03-07 Uwe D. Hanebeck

Popular Bayes filters typically rely on linearization techniques such as Taylor series expansion and stochastic linear regression to use the structure of standard Kalman filter. These techniques may introduce large estimation errors in…

Systems and Control · Electrical Eng. & Systems 2025-07-17 Wenhan Cao , Tianyi Zhang , Shengbo Eben Li

Bayesian optimization (BO) is a sample-efficient approach for tuning design parameters to optimize expensive-to-evaluate, black-box performance metrics. In many manufacturing processes, the design parameters are subject to random input…

Machine Learning · Computer Science 2022-06-06 Samuel Daulton , Sait Cakmak , Maximilian Balandat , Michael A. Osborne , Enlu Zhou , Eytan Bakshy

The kinematics of a gliding flat-plate with spanwise oscillation has been optimized to enhance the power efficiency by using Bayesian optimization method, in which the portfolio allocation framework consists of a Gaussian process…

Fluid Dynamics · Physics 2021-09-10 Chunyu Wang , Zhaoyue Xu , Xinlei Zhang , Shizhao Wang

We consider the problem of randomly choosing the sensors of a linear time-invariant dynamical system subject to process and measurement noise. We sample the sensors independently and from the same distribution. We measure the performance of…

Systems and Control · Electrical Eng. & Systems 2021-03-23 Christopher I. Calle , Shaunak D. Bopardikar

Optimal portfolio allocation is often formulated as a constrained risk problem, where one aims to minimize a risk measure subject to some performance constraints. This paper presents new Bayesian Optimization algorithms for such constrained…

Portfolio Management · Quantitative Finance 2025-03-25 Robert Millar , Jinglai Li

We consider the problem of selecting a subset of alternatives given noisy evaluations of the relative strength of different alternatives. We wish to select a k-subset (for a given k) that provides a maximum likelihood estimate for one of…

Artificial Intelligence · Computer Science 2012-10-19 Ariel D. Procaccia , Sashank J. Reddi , Nisarg Shah

Maximum likelihood estimation is one of the most used methods in quantum state tomography, where the aim is to reconstruct the density matrix of a physical system from measurement results. One strategy to deal with positivity and unit trace…

Numerical simulation of complex optical structures enables their optimization with respect to specific objectives. Often, optimization is done by multiple successive parameter scans, which are time consuming and computationally expensive.…

Computational Physics · Physics 2017-07-27 P. -I. Schneider , X. Garcia Santiago , C. Rockstuhl , S. Burger

This article focuses on the multi-objective optimization of stochastic simulators with high output variance, where the input space is finite and the objective functions are expensive to evaluate. We rely on Bayesian optimization algorithms,…

Optimization and Control · Mathematics 2022-07-21 Bruno Barracosa , Julien Bect , Héloïse Dutrieux Baraffe , Juliette Morin , Josselin Fournel , Emmanuel Vazquez

Koopman spectral analysis plays a crucial role in understanding and modeling nonlinear dynamical systems as it reveals key system behaviors and long-term dynamics. However, the presence of measurement noise poses a significant challenge to…

Systems and Control · Electrical Eng. & Systems 2025-04-15 Zhexuan Zeng , Jun Zhou , Yasen Wang , Zuowei Ping

A maximum likelihood (ML) technique for detecting compact sources in images of the x-ray sky is examined. Such images, in the relatively low exposure regime accessible to present x-ray observatories, exhibit Poissonian noise at background…

Instrumentation and Methods for Astrophysics · Physics 2009-11-13 I. M. Stewart

Quantum state tomography (QST) is typically performed from a frequentist viewpoint using maximum likelihood estimation (MLE) which seeks to find the best plausible state consistent with the data by maximizing a likelihood function /…

Quantum Physics · Physics 2022-12-22 Daniel J. Lum , Yaakov Weinstein