English
Related papers

Related papers: Mean--Variance Risk-Aware Bayesian Optimal Experim…

200 papers

In experimental design, we are given $n$ vectors in $d$ dimensions, and our goal is to select $k\ll n$ of them to perform expensive measurements, e.g., to obtain labels/responses, for a linear regression task. Many statistical criteria have…

Machine Learning · Computer Science 2019-06-11 Michał Dereziński , Feynman Liang , Michael W. Mahoney

The generation of decision-theoretic Bayesian optimal designs is complicated by the significant computational challenge of minimising an analytically intractable expected loss function over a, potentially, high-dimensional design space. A…

Methodology · Statistics 2017-02-07 Antony M. Overstall , James M. McGree , Christopher C. Drovandi

The design of an experiment can be always be considered at least implicitly Bayesian, with prior knowledge used informally to aid decisions such as the variables to be studied and the choice of a plausible relationship between the…

Methodology · Statistics 2017-01-03 David C. Woods , Antony M. Overstall , Maria Adamou , Timothy W. Waite

We consider optimal design of PDE-based Bayesian linear inverse problems with infinite-dimensional parameters. We focus on the A-optimal design criterion, defined as the average posterior variance and quantified by the trace of the…

Numerical Analysis · Mathematics 2020-04-02 Elizabeth Herman , Alen Alexanderian , Arvind K. Saibaba

Systems with both quantitative and qualitative responses are widely encountered in many applications. Design of experiment methods are needed when experiments are conducted to study such systems. Classic experimental design methods are…

Methodology · Statistics 2023-04-24 Lulu Kang , Xinwei Deng , Ran Jin

We consider optimal design of infinite-dimensional Bayesian linear inverse problems governed by partial differential equations that contain secondary reducible model uncertainties, in addition to the uncertainty in the inversion parameters.…

Optimization and Control · Mathematics 2020-06-23 Alen Alexanderian , Noemi Petra , Georg Stadler , Isaac Sunseri

In predictive modeling with simulation or machine learning, it is critical to accurately assess the quality of estimated values through output analysis. In recent decades output analysis has become enriched with methods that quantify the…

Methodology · Statistics 2023-10-27 Kimia Vahdat , Sara Shashaani

Bayesian optimization (BO) is a sample-efficient approach for tuning design parameters to optimize expensive-to-evaluate, black-box performance metrics. In many manufacturing processes, the design parameters are subject to random input…

Machine Learning · Computer Science 2022-06-06 Samuel Daulton , Sait Cakmak , Maximilian Balandat , Michael A. Osborne , Enlu Zhou , Eytan Bakshy

This work considers Bayesian experimental design for the inverse boundary value problem of linear elasticity in a two-dimensional setting. The aim is to optimize the positions of compactly supported pressure activations on the boundary of…

Numerical Analysis · Mathematics 2023-09-06 Sarah Eberle-Blick , Nuutti Hyvönen

Bayesian adaptive experimental design is a form of active learning, which chooses samples to maximize the information they give about uncertain parameters. Prior work has shown that other forms of active learning can suffer from active…

This paper considers mean-variance optimization under uncertainty, specifically when one desires a sparsified set of optimal portfolio weights. From the standpoint of a Bayesian investor, our approach produces a small portfolio from many…

Statistical Finance · Quantitative Finance 2016-10-05 David Puelz , P. Richard Hahn , Carlos M. Carvalho

Microplastics contamination is one of the most rapidly growing research topics. However, monitoring microplastics contamination in the environment presents both logistical and statistical challenges, particularly when constrained resources…

We introduce Bayesian optimization, a technique developed for optimizing time-consuming engineering simulations and for fitting machine learning models on large datasets. Bayesian optimization guides the choice of experiments during…

Machine Learning · Statistics 2017-11-22 Peter I. Frazier , Jialei Wang

We consider robust optimal experimental design (ROED) for nonlinear Bayesian inverse problems governed by partial differential equations (PDEs). An optimal design is one that maximizes some utility quantifying the quality of the solution of…

Numerical Analysis · Mathematics 2026-05-01 Abhijit Chowdhary , Ahmed Attia , Alen Alexanderian

We consider optimal experimental design (OED) for nonlinear inverse problems within the Bayesian framework. Optimizing the data acquisition process for large-scale nonlinear Bayesian inverse problems is a computationally challenging task…

Numerical Analysis · Mathematics 2024-05-14 Karina Koval , Ruanui Nicholson

We consider the problem of variable selection in Bayesian multivariate linear regression models, involving multiple response and predictor variables, under multivariate normal errors. In the absence of a known covariance structure,…

Methodology · Statistics 2025-07-25 Joyee Ghosh , Xun Li

In experimental design, we are given a large collection of vectors, each with a hidden response value that we assume derives from an underlying linear model, and we wish to pick a small subset of the vectors such that querying the…

Machine Learning · Computer Science 2019-02-05 Michał Dereziński , Kenneth L. Clarkson , Michael W. Mahoney , Manfred K. Warmuth

We present a novel stochastic approach to binary optimization for optimal experimental design (OED) for Bayesian inverse problems governed by mathematical models such as partial differential equations. The OED utility function, namely, the…

Optimization and Control · Mathematics 2022-06-28 Ahmed Attia , Sven Leyffer , Todd Munson

Bayesian optimization is a methodology for global optimization of unknown and expensive objectives. It combines a surrogate Bayesian regression model with an acquisition function to decide where to evaluate the objective. Typical regression…

Machine Learning · Computer Science 2023-04-04 Afonso Eduardo , Michael U. Gutmann

Bayesian optimal experimental design (BOED) provides a powerful, decision-theoretic framework for selecting experiments so as to maximise the expected utility of the data to be collected. In practice, however, its applicability can be…

Machine Learning · Statistics 2026-03-13 Louis Sharrock