中文
相关论文

相关论文: Constrained Bayesian Optimization Using a Lagrange…

200 篇论文

Bayesian optimisation (BO) is a powerful framework for global optimisation of costly functions, using predictions from Gaussian process models (GPs). In this work, we apply BO to functions that exhibit invariance to a known group of…

机器学习 · 计算机科学 2024-10-23 Theodore Brown , Alexandru Cioba , Ilija Bogunovic

Bayesian optimization (BO) is among the most effective and widely-used blackbox optimization methods. BO proposes solutions according to an explore-exploit trade-off criterion encoded in an acquisition function, many of which are computed…

机器学习 · 计算机科学 2021-02-19 Louis C. Tiao , Aaron Klein , Matthias Seeger , Edwin V. Bonilla , Cedric Archambeau , Fabio Ramos

Bayesian optimization (BO) offers an elegant approach for efficiently optimizing black-box functions. However, acquisition criteria demand their own challenging inner-optimization, which can induce significant overhead. Many practical BO…

机器学习 · 统计学 2024-12-09 Nathan Wycoff , John W. Smith , Annie S. Booth , Robert B. Gramacy

Optimizing expensive to evaluate black-box functions over an input space consisting of all permutations of d objects is an important problem with many real-world applications. For example, placement of functional blocks in hardware design…

机器学习 · 计算机科学 2021-12-03 Aryan Deshwal , Syrine Belakaria , Janardhan Rao Doppa , Dae Hyun Kim

A crucial problem in achieving innovative high-throughput materials growth with machine learning and automation techniques, such as Bayesian optimization (BO) and robotic experimentation, has been a lack of an appropriate way to handle…

In this paper, we propose a predictor-corrector type Consensus Based Optimization (CBO) algorithm on a convex feasible set. Our proposed algorithm generalizes the CBO algorithm in [11] to tackle a constrained optimization problem for the…

最优化与控制 · 数学 2021-10-14 Hyeong-Ohk Bae , Seung-Yeal Ha , Myeongju Kang , Hyuncheul Lim , Chanho Min , Jane Yoo

This paper focuses on Bayesian Optimization (BO) for objectives on combinatorial search spaces, including ordinal and categorical variables. Despite the abundance of potential applications of Combinatorial BO, including chipset…

机器学习 · 统计学 2019-10-29 Changyong Oh , Jakub M. Tomczak , Efstratios Gavves , Max Welling

Bayesian optimization (BO) developed as an approach for the efficient optimization of expensive black-box functions without gradient information. A typical BO paper introduces a new approach and compares it to some alternatives on simulated…

统计计算 · 统计学 2023-10-17 Jiajie Kong , Tony Pourmohamad , Herbert K. H. Lee

Bayesian optimization (BO) suffers from long computing times when processing highly-dimensional or large data sets. These long computing times are a result of the Gaussian process surrogate model having a polynomial time complexity with the…

机器学习 · 计算机科学 2023-09-12 Alexander E. Siemenn , Tonio Buonassisi

It is commonly believed that Bayesian optimization (BO) algorithms are highly efficient for optimizing numerically costly functions. However, BO is not often compared to widely different alternatives, and is mostly tested on narrow sets of…

最优化与控制 · 数学 2021-10-01 Rodolphe Le Riche , Victor Picheny

Bayesian optimization (BO) is a sequential decision-making tool widely used for optimizing expensive black-box functions. Recently, Large Language Models (LLMs) have shown remarkable adaptability in low-data regimes, making them promising…

机器学习 · 计算机科学 2025-10-10 Chih-Yu Chang , Milad Azvar , Chinedum Okwudire , Raed Al Kontar

One of the consequences of network densification is more frequent handovers (HO). HO failures have a direct impact on the quality of service and are undesirable, especially in scenarios with strict latency, reliability, and robustness…

网络与互联网体系结构 · 计算机科学 2023-01-26 Eloise de Carvalho Rodrigues , Alvaro Valcarce Rial , Giovanni Geraci

The present study aimed to solve the cure optimization problem of laminated composites through a statistical approach. The approach consisted of using constrained Bayesian Optimization (cBO) along with a Gaussian process model as a…

应用统计 · 统计学 2025-06-02 Madhura Limaye , Yezhuo Li , Qiong Zhang , Gang Li

Bayesian Optimization (BO), guided by Gaussian process (GP) surrogates, has proven to be an invaluable technique for efficient, high-dimensional, black-box optimization, a critical problem inherent to many applications such as industrial…

We present a new algorithm, truncated variance reduction (TruVaR), that treats Bayesian optimization (BO) and level-set estimation (LSE) with Gaussian processes in a unified fashion. The algorithm greedily shrinks a sum of truncated…

机器学习 · 统计学 2016-10-25 Ilija Bogunovic , Jonathan Scarlett , Andreas Krause , Volkan Cevher

Bayesian optimization (BO) has become an effective approach for black-box function optimization problems when function evaluations are expensive and the optimum can be achieved within a relatively small number of queries. However, many…

机器学习 · 统计学 2018-08-06 Zi Wang , Clement Gehring , Pushmeet Kohli , Stefanie Jegelka

We consider the problem of optimizing combinatorial spaces (e.g., sequences, trees, and graphs) using expensive black-box function evaluations. For example, optimizing molecules for drug design using physical lab experiments. Bayesian…

机器学习 · 计算机科学 2022-02-07 Aryan Deshwal , Janardhan Rao Doppa

Bayesian Optimization (BO) is a widely used approach for blackbox optimization that leverages a Gaussian process (GP) model and an acquisition function to guide future sampling. While effective in low-dimensional settings, BO faces…

机器学习 · 计算机科学 2025-11-26 Pavankumar Koratikere , Leifur Leifsson

Pruning is an effective technique for convolutional neural networks (CNNs) model compression, but it is difficult to find the optimal pruning policy due to the large design space. To improve the usability of pruning, many auto pruning…

机器学习 · 计算机科学 2022-07-26 Hanwei Fan , Jiandong Mu , Wei Zhang

Constrained optimization offers a powerful framework to prescribe desired behaviors in neural network models. Typically, constrained problems are solved via their min-max Lagrangian formulations, which exhibit unstable oscillatory dynamics…

机器学习 · 计算机科学 2024-06-10 Motahareh Sohrabi , Juan Ramirez , Tianyue H. Zhang , Simon Lacoste-Julien , Jose Gallego-Posada