English
Related papers

Related papers: An adaptive approach to Bayesian Optimization with…

200 papers

Within the framework of complex system design, it is often necessary to solve mixed variable optimization problems, in which the objective and constraint functions can depend simultaneously on continuous and discrete variables.…

Optimization and Control · Mathematics 2020-03-10 Julien Pelamatti , Loic Brevault , Mathieu Balesdent , El-Ghazali Talbi , Yannick Guerin

Bayesian optimization (BO) is a popular method for optimizing expensive-to-evaluate black-box functions. BO budgets are typically given in iterations, which implicitly assumes each evaluation has the same cost. In fact, in many BO…

Machine Learning · Computer Science 2021-06-14 Eric Hans Lee , David Eriksson , Valerio Perrone , Matthias Seeger

We study the problem of deciding whether, and when an organization should replace a trained incumbent model with a challenger relying on newly available features. We develop a unified economic and statistical framework that links…

Machine Learning · Computer Science 2025-12-23 Vassilis Digalakis , Christophe Pérignon , Sébastien Saurin , Flore Sentenac

Bayesian optimization is a sequential method for minimizing objective functions that are expensive to evaluate and about which few assumptions can be made. By using all gathered data to train a Gaussian process model for the function and…

Machine Learning · Computer Science 2026-05-07 Jesse Schneider , William J. Welch

Optimal designs minimize the number of experimental runs (samples) needed to accurately estimate model parameters, resulting in algorithms that, for instance, efficiently minimize parameter estimate variance. Governed by knowledge of past…

Methodology · Statistics 2023-02-03 Nicholas W. Barendregt , Emily G. Webb , Zachary P. Kilpatrick

We study the sequential testing problem of two alternative hypotheses regarding an unknown parameter in an exponential family when observations are costly. In a Bayesian setting, the problem can be embedded in a Markovian framework. Using…

Statistics Theory · Mathematics 2022-06-22 Erik Ekström , Yuqiong Wang

This study investigates the integration of forecasting and optimization in energy management systems, with a focus on the role of switching costs -- penalties incurred from frequent operational adjustments. We develop a theoretical and…

Systems and Control · Electrical Eng. & Systems 2025-04-16 Evgenii Genov , Julian Ruddick , Christoph Bergmeir , Majid Vafaeipour , Thierry Coosemans , Salvador Garcia , Maarten Messagie

The computational costs of inference and planning have confined Bayesian model-based reinforcement learning to one of two dismal fates: powerful Bayes-adaptive planning but only for simplistic models, or powerful, Bayesian non-parametric…

Artificial Intelligence · Computer Science 2014-02-11 Arthur Guez , David Silver , Peter Dayan

Multipurpose batch processes become increasingly popular in manufacturing industries since they adapt to low-volume, high-value products and shifting demands. These processes often operate in a dynamic environment, which faces disturbances…

Machine Learning · Computer Science 2025-12-02 Taicheng Zheng , Dan Li , Jie Li

Classification systems are often deployed in resource-constrained settings where labels must be assigned to inputs on a budget of time, memory, etc. Budgeted, sequential classifiers (BSCs) address these scenarios by processing inputs…

Neural and Evolutionary Computing · Computer Science 2022-09-08 Nolan H. Hamilton , Errin Fulp

Relational query optimisers rely on cost models to choose between different query execution plans. Selectivity estimates are known to be a crucial input to the cost model. In practice, standard selectivity estimation procedures are prone to…

Databases · Computer Science 2020-09-22 Max Halford , Philippe Saint-Pierre , Franck Morvan

Most existing black-box optimization methods assume that all variables in the system being optimized have equal cost and can change freely at each iteration. However, in many real world systems, inputs are passed through a sequence of…

Machine Learning · Computer Science 2021-10-13 Chi-Heng Lin , Joseph D. Miano , Eva L. Dyer

Bayesian Optimization is a very effective tool for optimizing expensive black-box functions. Inspired by applications developing and characterizing reaction chemistry using droplet microfluidic reactors, we consider a novel setting where…

Machine Learning · Computer Science 2023-01-12 Jose Pablo Folch , Shiqiang Zhang , Robert M Lee , Behrang Shafei , David Walz , Calvin Tsay , Mark van der Wilk , Ruth Misener

In recent years, leveraging parallel and distributed computational resources has become essential to solve problems of high computational cost. Bayesian optimization (BO) has shown attractive results in those expensive-to-evaluate problems…

Machine Learning · Statistics 2020-06-25 Masahiro Nomura

We study the problem of evaluating a discrete function by adaptively querying the values of its variables until the values read uniquely determine the value of the function. Reading the value of a variable is done at the expense of some…

Data Structures and Algorithms · Computer Science 2014-06-17 Aline Saettler , Eduardo Laber , Ferdinando Cicalese

Active learning parallelization is widely used, but typically relies on fixing the batch size throughout experimentation. This fixed approach is inefficient because of a dynamic trade-off between cost and speed -- larger batches are more…

Machine Learning · Computer Science 2024-10-15 Masaki Adachi , Satoshi Hayakawa , Martin Jørgensen , Xingchen Wan , Vu Nguyen , Harald Oberhauser , Michael A. Osborne

We provide a unifying approximate dynamic programming framework that applies to a broad variety of problems involving sequential estimation. We consider first the construction of surrogate cost functions for the purposes of optimization,…

Artificial Intelligence · Computer Science 2023-01-02 Dimitri Bertsekas

We introduce and study online conversion with switching costs, a family of online problems that capture emerging problems at the intersection of energy and sustainability. In this problem, an online player attempts to purchase…

Data Structures and Algorithms · Computer Science 2024-11-11 Adam Lechowicz , Nicolas Christianson , Bo Sun , Noman Bashir , Mohammad Hajiesmaili , Adam Wierman , Prashant Shenoy

Likelihood-free Bayesian inference algorithms are popular methods for calibrating the parameters of complex, stochastic models, required when the likelihood of the observed data is intractable. These algorithms characteristically rely…

Computation · Statistics 2021-12-23 Thomas P Prescott , David J Warne , Ruth E Baker

Bayesian modelling for cost-effectiveness data has received much attention in both the health economics and the statistical literature in recent years. Cost-effectiveness data are characterised by a relatively complex structure of…

Statistics Theory · Mathematics 2013-07-22 Gianluca Baio