English
Related papers

Related papers: Transition Constrained Bayesian Optimization via M…

200 papers

The closed-loop performance of model predictive controllers (MPCs) is sensitive to the choice of prediction models, controller formulation, and tuning parameters. However, prediction models are typically optimized for prediction accuracy…

Systems and Control · Electrical Eng. & Systems 2020-11-25 Farshud Sorourifar , Georgios Makrygirgos , Ali Mesbah , Joel A. Paulson

Bayesian optimization is a sequential decision making framework for optimizing expensive-to-evaluate black-box functions. Computing a full lookahead policy amounts to solving a highly intractable stochastic dynamic program. Myopic…

Machine Learning · Computer Science 2020-06-30 Shali Jiang , Daniel R. Jiang , Maximilian Balandat , Brian Karrer , Jacob R. Gardner , Roman Garnett

Finding optimal parameter configurations for tunable GPU kernels is a non-trivial exercise for large search spaces, even when automated. This poses an optimization task on a non-convex search space, using an expensive to evaluate function…

Machine Learning · Computer Science 2021-12-01 Floris-Jan Willemsen , Rob van Nieuwpoort , Ben van Werkhoven

Bayesian optimization has emerged at the forefront of expensive black-box optimization due to its data efficiency. Recent years have witnessed a proliferation of studies on the development of new Bayesian optimization algorithms and their…

Machine Learning · Computer Science 2022-11-14 Xilu Wang , Yaochu Jin , Sebastian Schmitt , Markus Olhofer

Bayesian Optimization (BO) is a method for globally optimizing black-box functions. While BO has been successfully applied to many scenarios, developing effective BO algorithms that scale to functions with high-dimensional domains is still…

Machine Learning · Computer Science 2024-02-13 Yihang Shen , Carl Kingsford

We examine a constrained Markov decision process under uncertain transition probabilities, with the uncertainty modeled as deviations from observed transition probabilities. We construct the uncertainty set associated with the deviations…

Optimization and Control · Mathematics 2025-04-15 V Varagapriya

Machine learning algorithms frequently require careful tuning of model hyperparameters, regularization terms, and optimization parameters. Unfortunately, this tuning is often a "black art" that requires expert experience, unwritten rules of…

Machine Learning · Statistics 2012-08-30 Jasper Snoek , Hugo Larochelle , Ryan P. Adams

We derive an optimal policy for adaptively restarting a randomized algorithm, based on observed features of the run-so-far, so as to minimize the expected time required for the algorithm to successfully terminate. Given a suitable Bayesian…

Machine Learning · Computer Science 2019-02-25 Matthew Streeter

Bayesian optimization (BO) is among the most effective and widely-used blackbox optimization methods. BO proposes solutions according to an explore-exploit trade-off criterion encoded in an acquisition function, many of which are computed…

Machine Learning · Computer Science 2021-02-19 Louis C. Tiao , Aaron Klein , Matthias Seeger , Edwin V. Bonilla , Cedric Archambeau , Fabio Ramos

The performance of many machine learning models depends on their hyper-parameter settings. Bayesian Optimization has become a successful tool for hyper-parameter optimization of machine learning algorithms, which aims to identify optimal…

Machine Learning · Computer Science 2020-08-04 Lidan Wang , Franck Dernoncourt , Trung Bui

Bayesian Optimization is a very effective tool for optimizing expensive black-box functions. Inspired by applications developing and characterizing reaction chemistry using droplet microfluidic reactors, we consider a novel setting where…

Machine Learning · Computer Science 2023-01-12 Jose Pablo Folch , Shiqiang Zhang , Robert M Lee , Behrang Shafei , David Walz , Calvin Tsay , Mark van der Wilk , Ruth Misener

We propose a practical Bayesian optimization method using Gaussian process regression, of which the marginal likelihood is maximized where the number of model selection steps is guided by a pre-defined threshold. Since Bayesian optimization…

Machine Learning · Statistics 2020-10-19 Jungtaek Kim , Seungjin Choi

Complex system design problems, such as those involved in aerospace engineering, require the use of numerically costly simulation codes in order to predict the performance of the system to be designed. In this context, these codes are often…

Optimization and Control · Mathematics 2024-02-14 Loic Brevault , Mathieu Balesdent

Bayesian optimization is a principled optimization strategy for a black-box objective function. It shows its effectiveness in a wide variety of real-world applications such as scientific discovery and experimental design. In general, the…

Machine Learning · Computer Science 2024-11-11 Jungtaek Kim

Bayesian optimization (BO) is a popular method for optimizing expensive-to-evaluate black-box functions. BO budgets are typically given in iterations, which implicitly assumes each evaluation has the same cost. In fact, in many BO…

Machine Learning · Computer Science 2021-06-14 Eric Hans Lee , David Eriksson , Valerio Perrone , Matthias Seeger

Bayesian optimization has proven to be a highly effective methodology for the global optimization of unknown, expensive and multimodal functions. The ability to accurately model distributions over functions is critical to the effectiveness…

Machine Learning · Statistics 2014-06-13 Jasper Snoek , Kevin Swersky , Richard S. Zemel , Ryan P. Adams

Robots performing manipulation tasks must operate under uncertainty about both their pose and the dynamics of the system. In order to remain robust to modeling error and shifts in payload dynamics, agents must simultaneously perform…

Systems and Control · Computer Science 2017-07-31 Patrick Slade , Preston Culbertson , Zachary Sunberg , Mykel Kochenderfer

Models of many real-life applications, such as queuing models of communication networks or computing systems, have a countably infinite state-space. Algorithmic and learning procedures that have been developed to produce optimal policies…

Systems and Control · Electrical Eng. & Systems 2024-03-19 Saghar Adler , Vijay Subramanian

Black box optimization requires specifying a search space to explore for solutions, e.g. a d-dimensional compact space, and this choice is critical for getting the best results at a reasonable budget. Unfortunately, determining a high…

Machine Learning · Computer Science 2021-12-20 Setareh Ariafar , Justin Gilmer , Zachary Nado , Jasper Snoek , Rodolphe Jenatton , George E. Dahl

Bayesian optimization is an effective technique for black-box optimization, but its applicability is typically limited to low-dimensional and small-budget problems due to the cubic complexity of computing the Gaussian process (GP)…

Machine Learning · Computer Science 2025-12-18 Yunyue Wei , Vincent Zhuang , Saraswati Soedarmadji , Yanan Sui