English
Related papers

Related papers: An approach for finding fully Bayesian optimal des…

200 papers

One of the well-known challenges in optimal experimental design is how to efficiently estimate the nested integrations of the expected information gain. The Gaussian approximation and associated importance sampling have been shown to be…

Computation · Statistics 2021-08-17 Quan Long

We consider optimal experimental design (OED) for nonlinear inverse problems within the Bayesian framework. Optimizing the data acquisition process for large-scale nonlinear Bayesian inverse problems is a computationally challenging task…

Numerical Analysis · Mathematics 2024-05-14 Karina Koval , Ruanui Nicholson

The Bayesian approach has proved to be a coherent approach to handle ill posed Inverse problems. However, the Bayesian calculations need either an optimization or an integral calculation. The maximum a posteriori (MAP) estimation requires…

Data Analysis, Statistics and Probability · Physics 2007-05-23 A. Mohammad-Djafari

Bayesian optimal design is a well-established approach to planning experiments. A distribution for the responses, i.e. a statistical model, is assumed which is dependent on unknown parameters. A utility function is then specified giving…

Methodology · Statistics 2025-01-03 Antony M. Overstall , Jacinta Holloway-Brown , James M. McGree

Many expensive black-box optimisation problems are sensitive to their inputs. In these problems it makes more sense to locate a region of good designs, than a single-possibly fragile-optimal design. Expensive black-box functions can be…

Machine Learning · Computer Science 2021-12-16 Nicholas D. Sanders , Richard M. Everson , Jonathan E. Fieldsend , Alma A. M. Rahat

Bayesian optimization is a popular framework for efficiently tackling black-box search problems. As a rule, these algorithms operate by iteratively choosing what to evaluate next until some predefined budget has been exhausted. We…

Machine Learning · Statistics 2024-12-12 James T. Wilson

We introduce a novel combination of Bayesian Models (BMs) and Neural Networks (NNs) for making predictions with a minimum expected risk. Our approach combines the best of both worlds, the data efficiency and interpretability of a BM with…

Machine Learning · Computer Science 2021-09-28 Mathias Löwe , Per Lunnemann Hansen , Sebastian Risi

We develop a new computational approach for "focused" optimal Bayesian experimental design with nonlinear models, with the goal of maximizing expected information gain in targeted subsets of model parameters. Our approach considers…

Computation · Statistics 2019-03-28 Chi Feng , Youssef M. Marzouk

Bayesian optimal experiments that maximize the information gained from collected data are critical to efficiently identify behavioral models. We extend a seminal method for designing Bayesian optimal experiments by introducing two…

Applications · Statistics 2025-03-19 Stefano Balietti , Brennan Klein , Christoph Riedl

The design of informatively rich input signals is essential for accurate system identification, yet classical Fisher-information-based methods are inherently local and often inadequate in the presence of significant model uncertainty and…

Statistics Theory · Mathematics 2025-12-15 Piotr Bania , Anna Wójcik

Most computational approaches to Bayesian experimental design require making posterior calculations repeatedly for a large number of potential designs and/or simulated datasets. This can be expensive and prohibit scaling up these methods to…

Computation · Statistics 2021-11-18 Dennis Prangle , Sophie Harbisher , Colin S Gillespie

We present a framework for the efficient computation of optimal Bayesian decisions under intractable likelihoods, by learning a surrogate model for the expected utility (or its distribution) as a function of the action and data spaces. We…

Machine Learning · Statistics 2023-11-13 Justin Alsing , Thomas D. P. Edwards , Benjamin Wandelt

We present a novel technique for tailoring Bayesian quadrature (BQ) to model selection. The state-of-the-art for comparing the evidence of multiple models relies on Monte Carlo methods, which converge slowly and are unreliable for…

Machine Learning · Computer Science 2019-03-04 Henry Chai , Jean-Francois Ton , Roman Garnett , Michael A. Osborne

Engineering design is traditionally performed by hand: an expert makes design proposals based on past experience, and these proposals are then tested for compliance with certain target specifications. Testing for compliance is performed…

We consider the utilization of a computational model to guide the optimal acquisition of experimental data to inform the stochastic description of model input parameters. Our formulation is based on the recently developed consistent…

Computation · Statistics 2021-05-04 Scott N. Walsh , Tim M. Wildey , John D. Jakeman

Stochastic process models are now commonly used to analyse complex biological, ecological and industrial systems. Increasingly there is a need to deliver accurate estimates of model parameters and assess model fit by optimizing the timing…

Computation · Statistics 2018-09-18 Colin S. Gillespie , Richard J. Boys

Simulation-based optimal design techniques are a convenient tool for solving a particular class of optimal design problems. The goal is to find the optimal configuration of factor settings with respect to an expected utility criterion. This…

Methodology · Statistics 2013-05-21 Markus Hainy , Werner G. Müller , Helga Wagner

Bayesian optimization is a powerful global optimization technique for expensive black-box functions. One of its shortcomings is that it requires auxiliary optimization of an acquisition function at each iteration. This auxiliary…

Machine Learning · Statistics 2014-02-28 Ziyu Wang , Babak Shakibi , Lin Jin , Nando de Freitas

Approximate Bayesian computation (ABC) using a sequential Monte Carlo method provides a comprehensive platform for parameter estimation, model selection and sensitivity analysis in differential equations. However, this method, like other…

Machine Learning · Statistics 2015-07-21 Sanmitra Ghosh , Srinandan Dasmahapatra , Koushik Maharatna

For nearly any challenging scientific problem evaluation of the likelihood is problematic if not impossible. Approximate Bayesian computation (ABC) allows us to employ the whole Bayesian formalism to problems where we can use simulations…

Computation · Statistics 2011-07-04 Chris Barnes , Sarah Filippi , Michael P. H. Stumpf , Thomas Thorne