中文
相关论文

相关论文: Bayesian optimization for modular black-box system…

200 篇论文

Bayesian optimization (BO) is an efficient method to optimize expensive black-box functions. It has been generalized to scenarios where objective function evaluations return stochastic binary feedback, such as success/failure in a given…

机器学习 · 统计学 2021-11-08 Tristan Fauvel , Matthew Chalk

We consider Bayesian optimization of an expensive-to-evaluate black-box objective function, where we also have access to cheaper approximations of the objective. In general, such approximations arise in applications such as reinforcement…

机器学习 · 统计学 2016-11-16 Matthias Poloczek , Jialei Wang , Peter I. Frazier

Contextual Bayesian optimization (CBO) is a powerful framework for sequential decision-making given side information, with important applications, e.g., in wind energy systems. In this setting, the learner receives context (e.g., weather…

机器学习 · 统计学 2022-10-18 Shyam Sundhar Ramesh , Pier Giuseppe Sessa , Andreas Krause , Ilija Bogunovic

Bayesian optimization techniques have been successfully applied to robotics, planning, sensor placement, recommendation, advertising, intelligent user interfaces and automatic algorithm configuration. Despite these successes, the approach…

机器学习 · 统计学 2016-01-12 Ziyu Wang , Frank Hutter , Masrour Zoghi , David Matheson , Nando de Freitas

Many real-world tasks require optimizing expensive black-box functions accessible only through noisy evaluations, a setting commonly addressed with Bayesian optimization (BO). While Bayesian neural networks (BNNs) have recently emerged as…

机器学习 · 计算机科学 2026-01-14 Farhad Mirkarimi

Bayesian optimization is a powerful global optimization technique for expensive black-box functions. One of its shortcomings is that it requires auxiliary optimization of an acquisition function at each iteration. This auxiliary…

机器学习 · 统计学 2014-02-28 Ziyu Wang , Babak Shakibi , Lin Jin , Nando de Freitas

This paper introduces a framework for Bayesian Optimization (BO) with metric movement costs, addressing a critical challenge in practical applications where input alterations incur varying costs. Our approach is a convenient plug-in that…

统计方法学 · 统计学 2025-11-26 Qiyuan Chen , Raed Al Kontar

Modern computer systems are highly configurable, with hundreds of configuration options that interact, resulting in an enormous configuration space. As a result, optimizing performance goals (e.g., latency) in such systems is challenging…

性能 · 计算机科学 2023-10-04 Md Shahriar Iqbal , Ziyuan Zhong , Iftakhar Ahmad , Baishakhi Ray , Pooyan Jamshidi

A body of work has been done to automate machine learning algorithm to highlight the importance of model choice. Automating the process of choosing the best forecasting model and its corresponding parameters can result to improve a wide…

机器学习 · 计算机科学 2021-09-02 Nadhir Hassen , Irina Rish

Bayesian optimization (BO) is a powerful approach for seeking the global optimum of expensive black-box functions and has proven successful for fine tuning hyper-parameters of machine learning models. However, BO is practically limited to…

机器学习 · 统计学 2020-09-28 Riccardo Moriconi , Marc P. Deisenroth , K. S. Sesh Kumar

Bayesian optimization (BO) is a popular method for optimizing expensive black-box functions. BO has several well-documented shortcomings, including computational slowdown with longer optimization runs, poor suitability for non-stationary or…

机器学习 · 计算机科学 2024-06-18 E. Visser , C. E. van Daalen , J. C. Schoeman

The core challenge of high-dimensional and expensive black-box optimization (BBO) is how to obtain better performance faster with little function evaluation cost. The essence of the problem is how to design an efficient optimization…

机器学习 · 计算机科学 2023-07-26 Xiaobin Li , Kai Wu , Xiaoyu Zhang , Handing Wang , Jing Liu

Bayesian optimization (BO) and its batch extensions are successful for optimizing expensive black-box functions. However, these traditional BO approaches are not yet ideal for optimizing less expensive functions when the computational cost…

机器学习 · 计算机科学 2018-11-06 Vu Nguyen , Sunil Gupta , Santu Rana , Cheng Li , Svetha Venkatesh

In the machine learning algorithms, the choice of the hyperparameter is often an art more than a science, requiring labor-intensive search with expert experience. Therefore, automation on hyperparameter optimization to exclude human…

机器学习 · 计算机科学 2020-12-08 Taehyeon Kim , Jaeyeon Ahn , Nakyil Kim , Seyoung Yun

Bayesian optimisation (BO) uses probabilistic surrogate models - usually Gaussian processes (GPs) - for the optimisation of expensive black-box functions. At each BO iteration, the GP hyperparameters are fit to previously-evaluated data by…

机器学习 · 计算机科学 2021-05-04 George De Ath , Richard Everson , Jonathan Fieldsend

It is commonly believed that Bayesian optimization (BO) algorithms are highly efficient for optimizing numerically costly functions. However, BO is not often compared to widely different alternatives, and is mostly tested on narrow sets of…

最优化与控制 · 数学 2021-10-01 Rodolphe Le Riche , Victor Picheny

Bayesian optimization is a popular method for optimizing expensive black-box functions. Yet it oftentimes struggles in high dimensions where the computation could be prohibitively heavy. To alleviate this problem, we introduce Coordinate…

机器学习 · 计算机科学 2022-04-21 Jian Tan , Niv Nayman , Mengchang Wang

Multi-objective Bayesian optimization (MOBO) provides a principled framework for navigating trade-offs in molecular design. However, its empirical advantages over scalarized alternatives remain underexplored. We benchmark a simple…

机器学习 · 计算机科学 2025-12-25 Anabel Yong , Austin Tripp , Layla Hosseini-Gerami , Brooks Paige

Bayesian optimisation (BO) is a well-known efficient algorithm for finding the global optimum of expensive, black-box functions. The current practical BO algorithms have regret bounds ranging from $\mathcal{O}(\frac{logN}{\sqrt{N}})$ to…

机器学习 · 计算机科学 2026-04-28 Hung Tran-The , Sunil Gupta , Santu Rana , Svetha Venkatesh

Black-box optimization (BBO) has a broad range of applications, including automatic machine learning, engineering, physics, and experimental design. However, it remains a challenge for users to apply BBO methods to their problems at hand…