English
Related papers

Related papers: POPE: Post Optimization Posterior Evaluation of Li…

200 papers

Bayesian optimization is proposed for automatic learning of optimal controller parameters from experimental data. A probabilistic description (a Gaussian process) is used to model the unknown function from controller parameters to a…

Systems and Control · Computer Science 2019-01-24 Matthias Neumann-Brosig , Alonso Marco , Dieter Schwarzmann , Sebastian Trimpe

Bayesian parameter inference for complex stochastic simulators is challenging due to intractable likelihood functions. Existing simulation-based inference methods often require large number of simulations and become costly to use in…

Machine Learning · Computer Science 2026-04-06 Vasilis Gkolemis , Christos Diou , Michael U. Gutmann

This article focuses on the multi-objective optimization of stochastic simulators with high output variance, where the input space is finite and the objective functions are expensive to evaluate. We rely on Bayesian optimization algorithms,…

Optimization and Control · Mathematics 2022-07-21 Bruno Barracosa , Julien Bect , Héloïse Dutrieux Baraffe , Juliette Morin , Josselin Fournel , Emmanuel Vazquez

Simulation Optimization (SO) refers to the optimization of an objective function subject to constraints, both of which can be evaluated through a stochastic simulation. To address specific features of a particular simulation---discrete or…

Data Structures and Algorithms · Computer Science 2017-06-28 Satyajith Amaran , Nikolaos V. Sahinidis , Bikram Sharda , Scott J. Bury

We present new algorithms and fast implementations to find efficient approximations for modelling stochastic processes. For many numerical computations it is essential to develop finite approximations for stochastic processes. While the…

Optimization and Control · Mathematics 2020-12-03 Kipngeno Benard Kirui , Georg Ch. Pflug , Alois Pichler

Simulation models of critical systems often have parameters that need to be calibrated using observed data. For expensive simulation models, calibration is done using an emulator of the simulation model built on simulation output at…

Methodology · Statistics 2023-08-24 Özge Sürer , Matthew Plumlee , Stefan M. Wild

We study statistical estimators computed using iterative optimization methods that are not run until completion. Classical results on maximum likelihood estimators (MLEs) assert that a one-step estimator (OSE), in which a single…

Optimization and Control · Mathematics 2021-06-28 Robert Bassett , Julio Deride

Bayesian optimization (BO) is a powerful paradigm for derivative-free global optimization of a black-box objective function (BOF) that is expensive to evaluate. However, the overhead of BO can still be prohibitive for problems with highly…

Machine Learning · Computer Science 2019-12-18 Bin Liu

Automated experimentation has the potential to revolutionize scientific discovery, but its effectiveness depends on well-defined optimization targets, which are often uncertain or probabilistic in real-world settings. In this work, we…

Machine Learning · Computer Science 2025-04-10 Yu Liu , Sergei V. Kalinin

One of the core problems in statistical models is the estimation of a posterior distribution. For topic models, the problem of posterior inference for individual texts is particularly important, especially when dealing with data streams,…

Machine Learning · Statistics 2016-08-18 Khoat Than , Tung Doan

Simulation-based inference enables learning the parameters of a model even when its likelihood cannot be computed in practice. One class of methods uses data simulated with different parameters to infer models of the likelihood-to-evidence…

Machine Learning · Computer Science 2022-06-08 Giulio Isacchini , Natanael Spisak , Armita Nourmohammad , Thierry Mora , Aleksandra M. Walczak

Accurate simulation of complex physical systems enables the development, testing, and certification of control strategies before they are deployed into the real systems. As simulators become more advanced, the analytical tractability of the…

Robotics · Computer Science 2020-05-27 Lucas Barcelos , Rafael Oliveira , Rafael Possas , Lionel Ott , Fabio Ramos

The likelihood-free sequential Approximate Bayesian Computation (ABC) algorithms, are increasingly popular inference tools for complex biological models. Such algorithms proceed by constructing a succession of probability distributions over…

Computation · Statistics 2012-10-12 Daniel Silk , Saran Filippi , Michael P. H. Stumpf

This paper is on Bayesian inference for parametric statistical models that are defined by a stochastic simulator which specifies how data is generated. Exact sampling is then possible but evaluating the likelihood function is typically…

Machine Learning · Statistics 2020-03-02 Borislav Ikonomov , Michael U. Gutmann

Control algorithms such as model predictive control (MPC) and state estimators rely on a number of different parameters. The performance of the closed loop usually depends on the correct setting of these parameters. Tuning is often done…

Systems and Control · Electrical Eng. & Systems 2020-10-15 David Stenger , Muzaffer Ay , Dirk Abel

Modern simulation-based inference techniques use neural networks to solve inverse problems efficiently. One notable strategy is neural posterior estimation (NPE), wherein a neural network parameterizes a distribution to approximate the…

Instrumentation and Methods for Astrophysics · Physics 2024-03-06 Alex Kolmus , Justin Janquart , Tomasz Baka , Twan van Laarhoven , Chris Van Den Broeck , Tom Heskes

Faced with problems of increasing complexity, recent research in Bayesian Optimisation (BO) has focused on adapting deep probabilistic models as flexible alternatives to Gaussian Processes (GPs). In a similar vein, this paper investigates…

Machine Learning · Computer Science 2022-05-31 Alexandre Maraval , Matthieu Zimmer , Antoine Grosnit , Rasul Tutunov , Jun Wang , Haitham Bou Ammar

How can we plan efficiently in a large and complex environment when the time budget is limited? Given the original simulator of the environment, which may be computationally very demanding, we propose to learn online an approximate but much…

Artificial Intelligence · Computer Science 2022-12-14 Jinke He , Miguel Suau , Hendrik Baier , Michael Kaisers , Frans A. Oliehoek

State-of-the-art multi-objective optimization often assumes a known utility function, learns it interactively, or computes the full Pareto front-each requiring costly expert input.~Real-world problems, however, involve implicit preferences…

Machine Learning · Computer Science 2025-10-01 Farha A. Khan , Tanmay Chakraborty , Jörg P. Dietrich , Christian Wirth

Optimizing an expensive-to-query function is a common task in science and engineering, where it is beneficial to keep the number of queries to a minimum. A popular strategy is Bayesian optimization (BO), which leverages probabilistic models…

Machine Learning · Computer Science 2019-07-05 Willie Neiswanger , Kirthevasan Kandasamy , Barnabas Poczos , Jeff Schneider , Eric Xing