中文
相关论文

相关论文: On the Effects of Heterogeneous Errors on Multi-fi…

200 篇论文

Multi-fidelity (MF) methods are gaining popularity for enhancing surrogate modeling and design optimization by incorporating data from various low-fidelity (LF) models. While most existing MF methods assume a fixed dataset, adaptive…

机器学习 · 统计学 2024-02-06 Yi-Ping Chen , Liwei Wang , Yigitcan Comlek , Wei Chen

Bayesian optimization (BO) has gained attention as an efficient algorithm for black-box optimization of expensive-to-evaluate systems, where the BO algorithm iteratively queries the system and suggests new trials based on a probabilistic…

机器学习 · 计算机科学 2026-03-13 Eike Cramer , Luis Kutschat , Oliver Stollenwerk , Joel A. Paulson , Alexander Mitsos

While sample efficiency is the main motive for use of Bayesian optimisation when black-box functions are expensive to evaluate, the standard approach based on type II maximum likelihood (ML-II) may fail and result in disappointing…

机器学习 · 计算机科学 2022-08-31 Yuji Saikai

Bayesian optimization (BO) is a widely-used sequential method for zeroth-order optimization of complex and expensive-to-compute black-box functions. The existing BO methods assume that the function evaluation (feedback) is available to the…

机器学习 · 计算机科学 2022-06-22 Arun Verma , Zhongxiang Dai , Bryan Kian Hsiang Low

Bayesian optimization (BO) is a sequential approach for optimizing black-box objective functions using zeroth-order noisy observations. In BO, Gaussian processes (GPs) are employed as probabilistic surrogate models to estimate the objective…

机器学习 · 计算机科学 2025-04-02 Dongwon Kim , Matteo Zecchin , Sangwoo Park , Joonhyuk Kang , Osvaldo Simeone

Bayesian optimization (BO) is a powerful approach for seeking the global optimum of expensive black-box functions and has proven successful for fine tuning hyper-parameters of machine learning models. However, BO is practically limited to…

机器学习 · 统计学 2020-09-28 Riccardo Moriconi , Marc P. Deisenroth , K. S. Sesh Kumar

Preferential Bayesian optimization (PBO) learns latent utilities from pairwise comparisons, but most existing methods assume homoscedastic comparison noise. This is inadequate in human-in-the-loop settings, where a user may compare some…

机器学习 · 计算机科学 2026-05-19 Marshal Arijona Sinaga , Julien Martinelli , Samuel Kaski

Bayesian Optimization (BO) is a sample-efficient optimization algorithm widely employed across various applications. In some challenging BO tasks, input uncertainty arises due to the inevitable randomness in the optimization process, such…

机器学习 · 计算机科学 2023-11-07 Lin Yang , Junlong Lyu , Wenlong Lyu , Zhitang Chen

The performance of deep (reinforcement) learning systems crucially depends on the choice of hyperparameters. Their tuning is notoriously expensive, typically requiring an iterative training process to run for numerous steps to convergence.…

机器学习 · 计算机科学 2021-01-19 Vu Nguyen , Sebastian Schulze , Michael A Osborne

It is commonly believed that Bayesian optimization (BO) algorithms are highly efficient for optimizing numerically costly functions. However, BO is not often compared to widely different alternatives, and is mostly tested on narrow sets of…

最优化与控制 · 数学 2021-10-01 Rodolphe Le Riche , Victor Picheny

Bayesian optimization (BO) with preference-based feedback has recently garnered significant attention due to its emerging applications. We refer to this problem as Bayesian Optimization from Human Feedback (BOHF), which differs from…

机器学习 · 计算机科学 2025-05-30 Aya Kayal , Sattar Vakili , Laura Toni , Da-shan Shiu , Alberto Bernacchia

Most research in Bayesian optimization (BO) has focused on \emph{direct feedback} scenarios, where one has access to exact values of some expensive-to-evaluate objective. This direction has been mainly driven by the use of BO in machine…

Bayesian optimization (BO) is a leading method for optimizing expensive black-box optimization and has been successfully applied across various scenarios. However, BO suffers from the curse of dimensionality, making it challenging to scale…

机器学习 · 计算机科学 2025-04-03 Vu Viet Hoang , Hung The Tran , Sunil Gupta , Vu Nguyen

Bayesian Optimization (BO) is a common approach for hyperparameter optimization (HPO) in automated machine learning. Although it is well-accepted that HPO is crucial to obtain well-performing machine learning models, tuning BO's own…

机器学习 · 计算机科学 2019-08-20 Marius Lindauer , Matthias Feurer , Katharina Eggensperger , André Biedenkapp , Frank Hutter

The sample efficiency of Bayesian optimization(BO) is often boosted by Gaussian Process(GP) surrogate models. However, on mixed variable spaces, surrogate models other than GPs are prevalent, mainly due to the lack of kernels which can…

机器学习 · 统计学 2022-07-19 Changyong Oh , Efstratios Gavves , Max Welling

Bayesian Optimization (BO) is a popular framework for optimizing black-box functions. Despite its effectiveness, BO is often inefficient for high-dimensional problems due to the exponential growth of the search space, heterogeneity of the…

最优化与控制 · 数学 2026-05-08 Sourav Das , Debjani Chakraborty , Pabitra Mitra

Bayesian optimization (BO) is a class of global optimization algorithms, suitable for minimizing an expensive objective function in as few function evaluations as possible. While BO budgets are typically given in iterations, this implicitly…

机器学习 · 计算机科学 2020-03-25 Eric Hans Lee , Valerio Perrone , Cedric Archambeau , Matthias Seeger

Bayesian Optimization (BO) is a foundational strategy in the field of engineering design optimization for efficiently handling black-box functions with many constraints and expensive evaluations. This paper introduces a fast and accurate BO…

计算工程、金融与科学 · 计算机科学 2024-04-09 Rosen , Yu , Cyril Picard , Faez Ahmed

This paper proposes Bayesian optimization augmented factoring self-scheduling (BO FSS), a new parallel loop scheduling strategy. BO FSS is an automatic tuning variant of the factoring self-scheduling (FSS) algorithm and is based on Bayesian…

分布式、并行与集群计算 · 计算机科学 2022-06-14 Kyurae Kim , Youngjae Kim , Sungyong Park

Aligning beamlines at synchrotron light sources is a high-dimensional, expensive-to-sample optimization problem, as beams are focused using a series of dynamic optical components. Bayesian Optimization is an efficient machine learning…

加速器物理 · 物理学 2024-08-14 Megha R. Narayanan , Thomas W. Morris