English
Related papers

Related papers: Constrained Bayesian Optimization Using a Lagrange…

200 papers

Bayesian optimisation (BO) is a powerful framework for global optimisation of costly functions, using predictions from Gaussian process models (GPs). In this work, we apply BO to functions that exhibit invariance to a known group of…

Machine Learning · Computer Science 2024-10-23 Theodore Brown , Alexandru Cioba , Ilija Bogunovic

Bayesian optimization (BO) is among the most effective and widely-used blackbox optimization methods. BO proposes solutions according to an explore-exploit trade-off criterion encoded in an acquisition function, many of which are computed…

Machine Learning · Computer Science 2021-02-19 Louis C. Tiao , Aaron Klein , Matthias Seeger , Edwin V. Bonilla , Cedric Archambeau , Fabio Ramos

Bayesian optimization (BO) offers an elegant approach for efficiently optimizing black-box functions. However, acquisition criteria demand their own challenging inner-optimization, which can induce significant overhead. Many practical BO…

Machine Learning · Statistics 2024-12-09 Nathan Wycoff , John W. Smith , Annie S. Booth , Robert B. Gramacy

Optimizing expensive to evaluate black-box functions over an input space consisting of all permutations of d objects is an important problem with many real-world applications. For example, placement of functional blocks in hardware design…

Machine Learning · Computer Science 2021-12-03 Aryan Deshwal , Syrine Belakaria , Janardhan Rao Doppa , Dae Hyun Kim

A crucial problem in achieving innovative high-throughput materials growth with machine learning and automation techniques, such as Bayesian optimization (BO) and robotic experimentation, has been a lack of an appropriate way to handle…

In this paper, we propose a predictor-corrector type Consensus Based Optimization (CBO) algorithm on a convex feasible set. Our proposed algorithm generalizes the CBO algorithm in [11] to tackle a constrained optimization problem for the…

Optimization and Control · Mathematics 2021-10-14 Hyeong-Ohk Bae , Seung-Yeal Ha , Myeongju Kang , Hyuncheul Lim , Chanho Min , Jane Yoo

This paper focuses on Bayesian Optimization (BO) for objectives on combinatorial search spaces, including ordinal and categorical variables. Despite the abundance of potential applications of Combinatorial BO, including chipset…

Machine Learning · Statistics 2019-10-29 Changyong Oh , Jakub M. Tomczak , Efstratios Gavves , Max Welling

Bayesian optimization (BO) developed as an approach for the efficient optimization of expensive black-box functions without gradient information. A typical BO paper introduces a new approach and compares it to some alternatives on simulated…

Computation · Statistics 2023-10-17 Jiajie Kong , Tony Pourmohamad , Herbert K. H. Lee

Bayesian optimization (BO) suffers from long computing times when processing highly-dimensional or large data sets. These long computing times are a result of the Gaussian process surrogate model having a polynomial time complexity with the…

Machine Learning · Computer Science 2023-09-12 Alexander E. Siemenn , Tonio Buonassisi

It is commonly believed that Bayesian optimization (BO) algorithms are highly efficient for optimizing numerically costly functions. However, BO is not often compared to widely different alternatives, and is mostly tested on narrow sets of…

Optimization and Control · Mathematics 2021-10-01 Rodolphe Le Riche , Victor Picheny

Bayesian optimization (BO) is a sequential decision-making tool widely used for optimizing expensive black-box functions. Recently, Large Language Models (LLMs) have shown remarkable adaptability in low-data regimes, making them promising…

Machine Learning · Computer Science 2025-10-10 Chih-Yu Chang , Milad Azvar , Chinedum Okwudire , Raed Al Kontar

One of the consequences of network densification is more frequent handovers (HO). HO failures have a direct impact on the quality of service and are undesirable, especially in scenarios with strict latency, reliability, and robustness…

Networking and Internet Architecture · Computer Science 2023-01-26 Eloise de Carvalho Rodrigues , Alvaro Valcarce Rial , Giovanni Geraci

The present study aimed to solve the cure optimization problem of laminated composites through a statistical approach. The approach consisted of using constrained Bayesian Optimization (cBO) along with a Gaussian process model as a…

Applications · Statistics 2025-06-02 Madhura Limaye , Yezhuo Li , Qiong Zhang , Gang Li

Bayesian Optimization (BO), guided by Gaussian process (GP) surrogates, has proven to be an invaluable technique for efficient, high-dimensional, black-box optimization, a critical problem inherent to many applications such as industrial…

We present a new algorithm, truncated variance reduction (TruVaR), that treats Bayesian optimization (BO) and level-set estimation (LSE) with Gaussian processes in a unified fashion. The algorithm greedily shrinks a sum of truncated…

Machine Learning · Statistics 2016-10-25 Ilija Bogunovic , Jonathan Scarlett , Andreas Krause , Volkan Cevher

Bayesian optimization (BO) has become an effective approach for black-box function optimization problems when function evaluations are expensive and the optimum can be achieved within a relatively small number of queries. However, many…

Machine Learning · Statistics 2018-08-06 Zi Wang , Clement Gehring , Pushmeet Kohli , Stefanie Jegelka

We consider the problem of optimizing combinatorial spaces (e.g., sequences, trees, and graphs) using expensive black-box function evaluations. For example, optimizing molecules for drug design using physical lab experiments. Bayesian…

Machine Learning · Computer Science 2022-02-07 Aryan Deshwal , Janardhan Rao Doppa

Bayesian Optimization (BO) is a widely used approach for blackbox optimization that leverages a Gaussian process (GP) model and an acquisition function to guide future sampling. While effective in low-dimensional settings, BO faces…

Machine Learning · Computer Science 2025-11-26 Pavankumar Koratikere , Leifur Leifsson

Pruning is an effective technique for convolutional neural networks (CNNs) model compression, but it is difficult to find the optimal pruning policy due to the large design space. To improve the usability of pruning, many auto pruning…

Machine Learning · Computer Science 2022-07-26 Hanwei Fan , Jiandong Mu , Wei Zhang

Constrained optimization offers a powerful framework to prescribe desired behaviors in neural network models. Typically, constrained problems are solved via their min-max Lagrangian formulations, which exhibit unstable oscillatory dynamics…

Machine Learning · Computer Science 2024-06-10 Motahareh Sohrabi , Juan Ramirez , Tianyue H. Zhang , Simon Lacoste-Julien , Jose Gallego-Posada