English
Related papers

Related papers: Bayesian experimental design using regularized det…

200 papers

Bayesian experimental design is a technique that allows to efficiently select measurements to characterize a physical system by maximizing the expected information gain. Recent developments in deep neural networks and normalizing flows…

Quantum Physics · Physics 2023-06-27 Leopoldo Sarra , Florian Marquardt

This study concerns the formulation and application of Bayesian optimal experimental design to symbolic discovery, which is the inference from observational data of predictive models taking general functional forms. We apply constrained…

Machine Learning · Computer Science 2022-11-30 Kenneth L. Clarkson , Cristina Cornelio , Sanjeeb Dash , Joao Goncalves , Lior Horesh , Nimrod Megiddo

Consider an experiment with a finite set of design points representing permissible trial conditions. Suppose that each trial is associated with a cost that depends on the selected design point. In this paper, we study the problem of…

Computation · Statistics 2014-08-13 Radoslav Harman , Eva Benková

The experimental design problem concerns the selection of k points from a potentially large design pool of p-dimensional vectors, so as to maximize the statistical efficiency regressed on the selected k design points. Statistical efficiency…

Machine Learning · Statistics 2017-11-15 Zeyuan Allen-Zhu , Yuanzhi Li , Aarti Singh , Yining Wang

Bayesian optimal experimental design is a sub-field of statistics focused on developing methods to make efficient use of experimental resources. Any potential design is evaluated in terms of a utility function, such as the (theoretically…

Machine Learning · Computer Science 2022-10-21 Noble Kennamer , Steven Walton , Alexander Ihler

Bayesian optimal experimental design (OED) provides a principled framework for selecting observations or experiments. We introduce new Bayesian design criteria based on the expected Wasserstein-$p$ distance between the prior and posterior…

Methodology · Statistics 2026-05-28 Tapio Helin , Youssef Marzouk , Jose Rodrigo Rojo-Garcia

We introduce Bayesian optimization, a technique developed for optimizing time-consuming engineering simulations and for fitting machine learning models on large datasets. Bayesian optimization guides the choice of experiments during…

Machine Learning · Statistics 2017-11-22 Peter I. Frazier , Jialei Wang

Efficient algorithms for searching for optimal saturated designs are widely available. They maximize a given efficiency measure (such as D-optimality) and provide an optimum design. Nevertheless, they do not guarantee a \emph{global}…

Computation · Statistics 2013-03-29 Roberto Fontana

Determining the causal structure of a set of variables is critical for both scientific inquiry and decision-making. However, this is often challenging in practice due to limited interventional data. Given that randomized experiments are…

Methodology · Statistics 2019-02-28 Raj Agrawal , Chandler Squires , Karren Yang , Karthik Shanmugam , Caroline Uhler

We consider maximin and Bayesian $D$-optimal designs for nonlinear regression models. The maximin criterion requires the specification of a region for the nonlinear parameters in the model, while the Bayesian optimality criterion assumes…

Statistics Theory · Mathematics 2009-09-29 Dietrich Braess , Holger Dette

The design of multiple experiments is commonly undertaken via suboptimal strategies, such as batch (open-loop) design that omits feedback or greedy (myopic) design that does not account for future effects. This paper introduces new…

Methodology · Statistics 2016-04-29 Xun Huan , Youssef M. Marzouk

We develop a new computational approach for "focused" optimal Bayesian experimental design with nonlinear models, with the goal of maximizing expected information gain in targeted subsets of model parameters. Our approach considers…

Computation · Statistics 2019-03-28 Chi Feng , Youssef M. Marzouk

Optimal design of experiments for Bayesian inverse problems has recently gained wide popularity and attracted much attention, especially in the computational science and Bayesian inversion communities. An optimal design maximizes a…

Optimization and Control · Mathematics 2023-05-09 Ahmed Attia , Sven Leyffer , Todd Munson

In this paper, we propose two simple yet efficient computational algorithms to obtain approximate optimal designs for multi-dimensional linear regression on a large variety of design spaces. We focus on the two commonly used optimal…

Statistics Theory · Mathematics 2021-02-26 Jiangtao Duan , Wei Gao , Yanyuan Ma , Hon Keung Tony Ng

We consider the utilization of a computational model to guide the optimal acquisition of experimental data to inform the stochastic description of model input parameters. Our formulation is based on the recently developed consistent…

Computation · Statistics 2021-05-04 Scott N. Walsh , Tim M. Wildey , John D. Jakeman

The construction of decision-theoretic Bayesian designs for realistically-complex nonlinear models is computationally challenging, as it requires the optimization of analytically intractable expected utility functions over high-dimensional…

Methodology · Statistics 2016-07-01 Antony Overstall , David Woods

Gaussian Process bandit optimization has emerged as a powerful tool for optimizing noisy black box functions. One example in machine learning is hyper-parameter optimization where each evaluation of the target function requires training a…

Machine Learning · Computer Science 2016-11-15 Tarun Kathuria , Amit Deshpande , Pushmeet Kohli

Optimal design facilitates intelligent data collection. In this paper, we introduce a fully Bayesian design approach for spatial processes with complex covariance structures, like those typically exhibited in natural ecosystems. Coordinate…

Design of experiments is a fundamental topic in applied statistics with a long history. Yet its application is often limited by the complexity and costliness of constructing experimental designs, which involve searching a high-dimensional…

Methodology · Statistics 2022-03-29 Matthew T. Pratola , C. Devon Lin , Peter F. Craigmile

Bayesian optimal experimental design (OED) seeks to conduct the most informative experiment under budget constraints to update the prior knowledge of a system to its posterior from the experimental data in a Bayesian framework. Such…

Machine Learning · Computer Science 2024-02-29 Rafael Orozco , Felix J. Herrmann , Peng Chen