English
Related papers

Related papers: Nested Bayesian Optimization for Computer Experime…

200 papers

One of the goals of computer-aided surgery is to match intraoperative data to preoperative images of the anatomy and add complementary information that can facilitate the task of surgical navigation. In this context, mechanical palpation…

Robotics · Computer Science 2015-09-22 Elif Ayvali , Rangaprasad Arun Srivatsan , Long Wang , Rajarshi Roy , Nabil Simaan , Howie Choset

Bayesian experimental design (BED) provides a principled framework for optimizing data collection by choosing experiments that are maximally informative about unknown parameters. However, existing methods cannot deal with the joint…

Machine Learning · Statistics 2026-01-30 Sara Pérez-Vieites , Sahel Iqbal , Simo Särkkä , Dominik Baumann

We develop a new computational approach for "focused" optimal Bayesian experimental design with nonlinear models, with the goal of maximizing expected information gain in targeted subsets of model parameters. Our approach considers…

Computation · Statistics 2019-03-28 Chi Feng , Youssef M. Marzouk

The power system of the future will be governed by complex interactions and non-linear phenomena at small time-scales, that should be studied more and more through computationally expensive software simulations. To solve the abovementioned…

Systems and Control · Electrical Eng. & Systems 2025-02-26 Marius Kuhn , Evelyn Heylen , Willem Leterme

Bayesian experimental design (BED) provides a powerful and general framework for optimizing the design of experiments. However, its deployment often poses substantial computational challenges that can undermine its practical use. In this…

Machine Learning · Statistics 2023-11-30 Tom Rainforth , Adam Foster , Desi R Ivanova , Freddie Bickford Smith

Bayesian optimization works effectively optimizing parameters in black-box problems. However, this method did not work for high-dimensional parameters in limited trials. Parameters can be efficiently explored by nonlinearly embedding them…

Machine Learning · Computer Science 2022-06-14 Shoki Miyagawa , Atsuyoshi Yano , Naoko Sawada , Isamu Ogawa

Online field experiments are the gold-standard way of evaluating changes to real-world interactive machine learning systems. Yet our ability to explore complex, multi-dimensional policy spaces - such as those found in recommendation and…

Machine Learning · Statistics 2019-04-30 Benjamin Letham , Eytan Bakshy

We present two algorithms for Bayesian optimization in the batch feedback setting, based on Gaussian process upper confidence bound and Thompson sampling approaches, along with frequentist regret guarantees and numerical results.

Machine Learning · Computer Science 2019-11-05 Sayak Ray Chowdhury , Aditya Gopalan

The Gaussian mixture model is a classic technique for clustering and data modeling that is used in numerous applications. With the rise of big data, there is a need for parameter estimation techniques that can handle streaming data and…

Artificial Intelligence · Computer Science 2016-09-20 Priyank Jaini , Pascal Poupart

Bayesian optimization involves "inner optimization" over a new-data acquisition criterion which is non-convex/highly multi-modal, may be non-differentiable, or may otherwise thwart local numerical optimizers. In such cases it is common to…

Computation · Statistics 2022-05-23 Robert B. Gramacy , Annie Sauer , Nathan Wycoff

The Bayesian evidence is a key tool in model selection, allowing a comparison of models with different numbers of parameters. Its use in analysis of cosmological models has been limited by difficulties in calculating it, with current…

Cosmology and Nongalactic Astrophysics · Physics 2023-02-01 Juan Garcia-Bellido

The PC algorithm is a popular method for learning the structure of Gaussian Bayesian networks. It carries out statistical tests to determine absent edges in the network. It is hence governed by two parameters: (i) The type of test, and (ii)…

In statistical modeling of computer experiments sometimes prior information is available about the underlying function. For example, the physical system simulated by the computer code may be known to be monotone with respect to some or all…

Methodology · Statistics 2014-06-17 Shirin Golchi , Derek R. Bingham , Hugh Chipman , David A. Campbell

A Bayesian design is given by maximising an expected utility over a design space. The utility is chosen to represent the aim of the experiment and its expectation is taken with respect to all unknowns: responses, parameters and/or models.…

Methodology · Statistics 2019-01-16 Antony M. Overstall , James M. McGree

The Design of Experiments (DOEs) is a fundamental scientific methodology that provides researchers with systematic principles and techniques to enhance the validity, reliability, and efficiency of experimental outcomes. In this study, we…

Machine Learning · Statistics 2025-07-22 Miao Huang , Hongqiao Wang , Kunyu Wu

Nonclassical correlations provide a resource for many applications in quantum technology as well as providing strong evidence that a system is indeed operating in the quantum regime. Optomechanical systems can be arranged to generate…

Bayesian probabilistic numerical methods for numerical integration offer significant advantages over their non-Bayesian counterparts: they can encode prior information about the integrand, and can quantify uncertainty over estimates of an…

Machine Learning · Statistics 2023-09-12 Katharina Ott , Michael Tiemann , Philipp Hennig , François-Xavier Briol

We deal with the efficient parallelization of Bayesian global optimization algorithms, and more specifically of those based on the expected improvement criterion and its variants. A closed form formula relying on multivariate Gaussian…

Machine Learning · Statistics 2016-09-12 Sébastien Marmin , Clément Chevalier , David Ginsbourger

The increasing availability of structured but high dimensional data has opened new opportunities for optimization. One emerging and promising avenue is the exploration of unsupervised methods for projecting structured high dimensional data…

Machine Learning · Computer Science 2021-01-07 Eero Siivola , Javier Gonzalez , Andrei Paleyes , Aki Vehtari

In this paper, we aim to solve Bayesian Risk Optimization (BRO), which is a recently proposed framework that formulates simulation optimization under input uncertainty. In order to efficiently solve the BRO problem, we derive nested…

Optimization and Control · Mathematics 2020-07-17 Sait Cakmak , Di Wu , Enlu Zhou