中文
相关论文

相关论文: Practical Path-based Bayesian Optimization

200 篇论文

We investigate modifications to Bayesian Optimization for a resource-constrained setting of sequential experimental design where changes to certain design variables of the search space incur a switching cost. This models the scenario where…

机器学习 · 计算机科学 2024-05-16 Stefan Pricopie , Richard Allmendinger , Manuel Lopez-Ibanez , Clyde Fare , Matt Benatan , Joshua Knowles

Modern scientific and engineering design increasingly involves distributed optimization, where agents such as laboratories, simulations, or industrial partners pursue related goals under differing conditions. These agents often face…

机器学习 · 统计学 2025-10-21 Zihan Wang , Yi-Ping Chen , Tuba Dolar , Wei Chen

Gaussian process (GP) based Bayesian optimization (BO) is a powerful method for optimizing black-box functions efficiently. The practical performance and theoretical guarantees of this approach depend on having the correct GP hyperparameter…

机器学习 · 统计学 2024-06-07 Huong Ha , Vu Nguyen , Hung Tran-The , Hongyu Zhang , Xiuzhen Zhang , Anton van den Hengel

Bayesian optimization has been successfully applied to optimize black-box functions where the number of evaluations is severely limited. However, in many real-world applications, it is hard or impossible to know in advance which designs are…

Bayesian optimisation (BO) is a well-known efficient algorithm for finding the global optimum of expensive, black-box functions. The current practical BO algorithms have regret bounds ranging from $\mathcal{O}(\frac{logN}{\sqrt{N}})$ to…

机器学习 · 计算机科学 2026-04-28 Hung Tran-The , Sunil Gupta , Santu Rana , Svetha Venkatesh

Bayesian optimization has become widely popular across various experimental sciences due to its favorable attributes: it can handle noisy data, perform well with relatively small datasets, and provide adaptive suggestions for sequential…

其他定量生物学 · 定量生物学 2025-08-15 Maximilian Siska , Emma Pajak , Katrin Rosenthal , Antonio del Rio Chanona , Eric von Lieres , Laura Marie Helleckes

Bayesian Optimization is a popular approach for optimizing expensive black-box functions. Its key idea is to use a surrogate model to approximate the objective and, importantly, quantify the associated uncertainty that allows a sequential…

机器学习 · 统计学 2025-02-05 Haoxian Chen , Henry Lam

In recent years, leveraging parallel and distributed computational resources has become essential to solve problems of high computational cost. Bayesian optimization (BO) has shown attractive results in those expensive-to-evaluate problems…

机器学习 · 统计学 2020-06-25 Masahiro Nomura

Bayesian Optimisation (BO) methods seek to find global optima of objective functions which are only available as a black-box or are expensive to evaluate. Such methods construct a surrogate model for the objective function, quantifying the…

机器学习 · 统计学 2023-01-10 Enrico Crovini , Simon L. Cotter , Konstantinos Zygalakis , Andrew B. Duncan

Bayesian Optimization (BO) is widely used for optimizing expensive black-box functions, particularly in hyperparameter tuning. However, standard BO assumes access to precise objective values, which may be unavailable, noisy, or unreliable…

机器学习 · 统计学 2025-10-07 Tunde Fahd Egunjobi

Bayesian Optimization (BO) is an efficient tool for optimizing black-box functions, but its theoretical guarantees typically hold in the asymptotic regime. In many critical real-world applications such as drug discovery or materials design,…

机器学习 · 计算机科学 2025-11-04 Diantong Li , Kyunghyun Cho , Chong Liu

Bayesian Optimization (BO) is a technique for sample-efficient black-box optimization that employs probabilistic models to identify promising input locations for evaluation. When dealing with composite-structured functions, such as f=g o h,…

机器学习 · 计算机科学 2024-07-11 Natalie Maus , Zhiyuan Jerry Lin , Maximilian Balandat , Eytan Bakshy

Bayesian optimization (BO) is an effective paradigm for the optimization of expensive-to-sample systems. Standard BO learns the performance of a system $f(x)$ by using a Gaussian Process (GP) model; this treats the system as a black-box and…

机器学习 · 统计学 2025-01-03 Leonardo D. González , Victor M. Zavala

We consider Bayesian optimization of objective functions of the form $\rho[ F(x, W) ]$, where $F$ is a black-box expensive-to-evaluate function and $\rho$ denotes either the VaR or CVaR risk measure, computed with respect to the randomness…

机器学习 · 统计学 2020-11-05 Sait Cakmak , Raul Astudillo , Peter Frazier , Enlu Zhou

This paper studies the problem of globally optimizing a variable of interest that is part of a causal model in which a sequence of interventions can be performed. This problem arises in biology, operational research, communications and,…

机器学习 · 统计学 2020-05-27 Virginia Aglietti , Xiaoyu Lu , Andrei Paleyes , Javier González

Bayesian Optimization (BO) for the minimization of expensive functions of continuous variables uses all the knowledge acquired from previous samples (${\boldsymbol x}_i$ and $f({\boldsymbol x}_i)$ values) to build a surrogate model based on…

数值分析 · 数学 2025-05-15 Roberto Battiti , Mauro Brunato

Bayesian optimisation has proven to be a powerful tool for expensive global black-box optimisation problems. In this paper, we propose new Bayesian optimisation variants of the popular Knowledge Gradient acquisition functions for problems…

机器学习 · 计算机科学 2025-12-22 Xietao Wang Lin , Juan Ungredda , Max Butler , James Town , Alma Rahat , Hemant Singh , Juergen Branke

Bayesian optimisation is a powerful tool to solve expensive black-box problems, but fails when the stationary assumption made on the objective function is strongly violated, which is the case in particular for ill-conditioned or…

机器学习 · 统计学 2019-12-06 Victor Picheny , Sattar Vakili , Artem Artemev

Bandit methods for black-box optimisation, such as Bayesian optimisation, are used in a variety of applications including hyper-parameter tuning and experiment design. Recently, \emph{multi-fidelity} methods have garnered considerable…

机器学习 · 统计学 2017-03-21 Kirthevasan Kandasamy , Gautam Dasarathy , Jeff Schneider , Barnabas Poczos

Probabilistic programming systems enable users to encode model structure and naturally reason about uncertainties, which can be leveraged towards improved Bayesian optimization (BO) methods. Here we present a probabilistic program embedding…

人工智能 · 计算机科学 2019-02-06 Alexander Lavin