中文
相关论文

相关论文: Scaling Bayesian Optimization With Game Theory

200 篇论文

Bayesian optimization (BO) is a leading method for optimizing expensive black-box optimization and has been successfully applied across various scenarios. However, BO suffers from the curse of dimensionality, making it challenging to scale…

机器学习 · 计算机科学 2025-04-03 Vu Viet Hoang , Hung The Tran , Sunil Gupta , Vu Nguyen

Black-box zero-th order optimization is a central primitive for applications in fields as diverse as finance, physics, and engineering. In a common formulation of this problem, a designer sequentially attempts candidate solutions, receiving…

机器学习 · 计算机科学 2024-07-08 Yunchuan Zhang , Sangwoo Park , Osvaldo Simeone

Bayesian Optimisation (BO) is a technique used in optimising a $D$-dimensional function which is typically expensive to evaluate. While there have been many successes for BO in low dimensions, scaling it to high dimensions has been…

机器学习 · 统计学 2016-05-16 Kirthevasan Kandasamy , Jeff Schneider , Barnabas Poczos

Bayesian optimization (BO) is a popular approach to optimize expensive-to-evaluate black-box functions. A significant challenge in BO is to scale to high-dimensional parameter spaces while retaining sample efficiency. A solution considered…

机器学习 · 统计学 2020-10-26 Benjamin Letham , Roberto Calandra , Akshara Rai , Eytan Bakshy

Bayesian optimization (BO) is a popular approach for sample-efficient optimization of black-box objective functions. While BO has been successfully applied to a wide range of scientific applications, traditional approaches to…

机器学习 · 计算机科学 2023-05-04 Natalie Maus , Kaiwen Wu , David Eriksson , Jacob Gardner

Bayesian optimization (BO) with Gaussian processes (GP) has become an indispensable algorithm for black box optimization problems. Not without a dash of irony, BO is often considered a black box itself, lacking ways to provide reasons as to…

Many real-world scientific and industrial applications require the optimization of expensive black-box functions. Bayesian Optimization (BO) provides an effective framework for such problems. However, traditional BO methods are prone to get…

人工智能 · 计算机科学 2025-09-29 Zhuo Yang , Daolang Wang , Lingli Ge , Beilun Wang , Tianfan Fu , Yuqiang Li

Existing high-dimensional Bayesian optimization (BO) methods aim to overcome the curse of dimensionality by carefully encoding structural assumptions, from locality to sparsity to smoothness, into the optimization procedure. Surprisingly,…

机器学习 · 计算机科学 2026-04-10 Colin Doumont , Donney Fan , Natalie Maus , Jacob R. Gardner , Henry Moss , Geoff Pleiss

Bayesian optimization (BO) is a widely-used sequential method for zeroth-order optimization of complex and expensive-to-compute black-box functions. The existing BO methods assume that the function evaluation (feedback) is available to the…

机器学习 · 计算机科学 2022-06-22 Arun Verma , Zhongxiang Dai , Bryan Kian Hsiang Low

Macro placement is the problem of placing memory blocks on a chip canvas. It can be formulated as a combinatorial optimization problem over sequence pairs, a representation which describes the relative positions of macros. Solving this…

When it comes to expensive black-box optimization problems, Bayesian Optimization (BO) is a well-known and powerful solution. Many real-world applications involve a large number of dimensions, hence scaling BO to high dimension is of much…

机器学习 · 统计学 2024-12-18 Lam Ngo , Huong Ha , Jeffrey Chan , Hongyu Zhang

Bayesian optimization (BO) is widely used to optimize expensive-to-evaluate black-box functions.BO first builds a surrogate model to represent the objective function and assesses its uncertainty. It then decides where to sample by…

机器学习 · 计算机科学 2024-01-25 Jiayu Zhao , Renyu Yang , Shenghao Qiu , Zheng Wang

Because of its sample efficiency, Bayesian optimization (BO) has become a popular approach dealing with expensive black-box optimization problems, such as hyperparameter optimization (HPO). Recent empirical experiments showed that the loss…

机器学习 · 计算机科学 2021-11-11 Difan Deng , Marius Lindauer

A wide spectrum of design and decision problems, including parameter tuning, A/B testing and drug design, intrinsically are instances of black-box optimization. Bayesian optimization (BO) is a powerful tool that models and optimizes such…

机器学习 · 计算机科学 2023-02-14 Tianyi Bai , Yang Li , Yu Shen , Xinyi Zhang , Wentao Zhang , Bin Cui

Bayesian optimization (BO) is a powerful technology for optimizing noisy expensive-to-evaluate black-box functions, with a broad range of real-world applications in science, engineering, economics, manufacturing, and beyond. In this paper,…

机器学习 · 计算机科学 2024-01-30 Joel A. Paulson , Calvin Tsay

Some real problems require the evaluation of expensive and noisy objective functions. Moreover, the analytical expression of these objective functions may be unknown. These functions are known as black-boxes, for example, estimating the…

机器学习 · 统计学 2021-07-12 Lucia Asencio Martín , Eduardo C. Garrido-Merchán

Bayesian Optimization (BO) is typically used to optimize an unknown function $f$ that is noisy and costly to evaluate, by exploiting an acquisition function that must be maximized at each optimization step. Even if provably asymptotically…

机器学习 · 计算机科学 2024-02-09 Anthony Bardou , Patrick Thiran , Thomas Begin

Many real world scientific and industrial applications require optimizing multiple competing black-box objectives. When the objectives are expensive-to-evaluate, multi-objective Bayesian optimization (BO) is a popular approach because of…

机器学习 · 计算机科学 2022-06-17 Samuel Daulton , David Eriksson , Maximilian Balandat , Eytan Bakshy

Bayesian optimization (BO) is a widely used algorithm for solving expensive black-box optimization problems. However, its performance decreases significantly on high-dimensional problems due to the inherent high-dimensionality of the…

机器学习 · 计算机科学 2025-04-16 Jundi Huang , Dawei Zhan

Computational models in fields such as computational neuroscience are often evaluated via stochastic simulation or numerical approximation. Fitting these models implies a difficult optimization problem over complex, possibly noisy parameter…

机器学习 · 统计学 2017-11-03 Luigi Acerbi , Wei Ji Ma