English
Related papers

Related papers: Goal-Oriented Bayesian Optimal Experimental Design…

200 papers

This study concerns the formulation and application of Bayesian optimal experimental design to symbolic discovery, which is the inference from observational data of predictive models taking general functional forms. We apply constrained…

Machine Learning · Computer Science 2022-11-30 Kenneth L. Clarkson , Cristina Cornelio , Sanjeeb Dash , Joao Goncalves , Lior Horesh , Nimrod Megiddo

Bayesian optimization (BO) is among the most effective and widely-used blackbox optimization methods. BO proposes solutions according to an explore-exploit trade-off criterion encoded in an acquisition function, many of which are computed…

Machine Learning · Computer Science 2021-02-19 Louis C. Tiao , Aaron Klein , Matthias Seeger , Edwin V. Bonilla , Cedric Archambeau , Fabio Ramos

This article focuses on the estimation and design aspects of a bivariate collocated cokriging experiment. For a large class of covariance matrices, a linear dependency criterion is identified, which allows the best linear unbiased estimator…

Methodology · Statistics 2022-03-15 Subhadra Dasgupta , Siuli Mukhopadhyay , Jonathan Keith

One of the well-known challenges in optimal experimental design is how to efficiently estimate the nested integrations of the expected information gain. The Gaussian approximation and associated importance sampling have been shown to be…

Computation · Statistics 2021-08-17 Quan Long

Bayesian quadrature optimization (BQO) maximizes the expectation of an expensive black-box integrand taken over a known probability distribution. In this work, we study BQO under distributional uncertainty in which the underlying…

Machine Learning · Computer Science 2020-01-22 Thanh Tang Nguyen , Sunil Gupta , Huong Ha , Santu Rana , Svetha Venkatesh

The quality of an estimated nonlinear model highly depends on the data quality that was used for the system identification. By using a Gaussian Process-based optimal input design approach, a so-called space-filling dataset can be generated…

Systems and Control · Electrical Eng. & Systems 2026-05-13 Máté Kiss , Maarten Schoukens , Roland Tóth

Bayesian Optimisation has gained much popularity lately, as a global optimisation technique for functions that are expensive to evaluate or unknown a priori. While classical BO focuses on where to gather an observation next, it does not…

Robotics · Computer Science 2017-03-14 Philippe Morere , Roman Marchant , Fabio Ramos

The Efficient Global Optimization (EGO) algorithm uses a conditional Gaus-sian Process (GP) to approximate an objective function known at a finite number of observation points and sequentially adds new points which maximize the Expected…

Optimization and Control · Mathematics 2016-03-09 Hossein Mohammadi , Rodolphe Le Riche , Eric Touboul

We introduce Bayesian optimization, a technique developed for optimizing time-consuming engineering simulations and for fitting machine learning models on large datasets. Bayesian optimization guides the choice of experiments during…

Machine Learning · Statistics 2017-11-22 Peter I. Frazier , Jialei Wang

We study preferential Bayesian optimization (BO) where reliable feedback is limited to pairwise comparison called duels. An important challenge in preferential BO, which uses the preferential Gaussian process (GP) model to represent…

Machine Learning · Computer Science 2023-06-13 Shion Takeno , Masahiro Nomura , Masayuki Karasuyama

Mixture of Experts (MoE) models constitute a widely utilized class of ensemble learning approaches in statistics and machine learning, known for their flexibility and computational efficiency. They have become integral components in…

Machine Learning · Statistics 2025-05-26 Tuan Thai , TrungTin Nguyen , Dat Do , Nhat Ho , Christopher Drovandi

Multi-objective Bayesian optimization (MOBO) provides a principled framework for navigating trade-offs in molecular design. However, its empirical advantages over scalarized alternatives remain underexplored. We benchmark a simple…

Machine Learning · Computer Science 2025-12-25 Anabel Yong , Austin Tripp , Layla Hosseini-Gerami , Brooks Paige

Causal Bayesian Optimization (CBO) is a methodology designed to optimize an outcome variable by leveraging known causal relationships through targeted interventions. Traditional CBO methods require a fully and accurately specified causal…

Machine Learning · Statistics 2025-03-26 Jean Durand , Yashas Annadani , Stefan Bauer , Sonali Parbhoo

We leverage multilevel Monte Carlo (MLMC) to improve the performance of multi-step look-ahead Bayesian optimization (BO) methods that involve nested expectations and maximizations. Often these expectations must be computed by Monte Carlo…

This article addresses the problem of derivative-free (single- or multi-objective) optimization subject to multiple inequality constraints. Both the objective and constraint functions are assumed to be smooth, non-linear and expensive to…

Computation · Statistics 2017-07-28 Paul Feliot , Julien Bect , Emmanuel Vazquez

In experimental design, we are given $n$ vectors in $d$ dimensions, and our goal is to select $k\ll n$ of them to perform expensive measurements, e.g., to obtain labels/responses, for a linear regression task. Many statistical criteria have…

Machine Learning · Computer Science 2019-06-11 Michał Dereziński , Feynman Liang , Michael W. Mahoney

A Bayesian design is given by maximising an expected utility over a design space. The utility is chosen to represent the aim of the experiment and its expectation is taken with respect to all unknowns: responses, parameters and/or models.…

Methodology · Statistics 2019-01-16 Antony M. Overstall , James M. McGree

The identification of the interface of an inclusion in a diffusion process is considered. This task is viewed as a parameter identification problem in which the parameter space bears the structure of a shape manifold. A corresponding…

Optimization and Control · Mathematics 2021-04-12 Tommy Etling , Roland Herzog , Martin Siebenborn

We develop an empirical Bayes framework for experimental design that leverages information from prior related studies. When a researcher has access to estimates from previous studies on similar parameters, they can use empirical Bayes to…

Econometrics · Economics 2026-02-25 Zhiheng You

In this work, we further develop multigoal-oriented a posteriori error estimation with two objectives in mind. First, we formulate goal-oriented mesh adaptivity for multiple functionals of interest for nonlinear problems in which both the…

Numerical Analysis · Mathematics 2018-04-05 B. Endtmayer , U. Langer , T. Wick