中文
相关论文

相关论文: Unexpected Improvements to Expected Improvement fo…

200 篇论文

The expected improvement (EI) algorithm is a popular strategy for information collection in optimization under uncertainty. The algorithm is widely known to be too greedy, but nevertheless enjoys wide use due to its simplicity and ability…

机器学习 · 计算机科学 2017-05-30 Chao Qin , Diego Klabjan , Daniel Russo

Sequential maximization of expected improvement (EI) is one of the most widely used policies in Bayesian optimization because of its simplicity and ability to handle noisy observations. In particular, the improvement function often uses the…

机器学习 · 计算机科学 2023-11-15 Han Zhou , Xingchen Ma , Matthew B Blaschko

Expected improvement (EI) is one of the most widely used acquisition functions in Bayesian optimization (BO). Despite its proven success in applications for decades, important open questions remain on the theoretical convergence behaviors…

机器学习 · 统计学 2025-02-13 Jingyi Wang , Haowei Wang , Nai-Yuan Chiang , Cosmin G. Petra

Expected Improvement (EI) is arguably the most widely used acquisition function in Bayesian optimization. However, it is often challenging to enhance the performance with EI due to its sensitivity to numerical precision. Previously, Hutter…

机器学习 · 计算机科学 2024-11-28 Shuhei Watanabe

The expected improvement (EI) is one of the most popular acquisition functions for Bayesian optimization (BO) and has demonstrated good empirical performances in many applications for the minimization of simple regret. However, under the…

机器学习 · 计算机科学 2024-10-04 Shouri Hu , Haowei Wang , Zhongxiang Dai , Bryan Kian Hsiang Low , Szu Hui Ng

Bayesian optimization is a sample-efficient approach to global optimization that relies on theoretically motivated value heuristics (acquisition functions) to guide its search process. Fully maximizing acquisition functions produces the…

机器学习 · 统计学 2018-12-04 James T. Wilson , Frank Hutter , Marc Peter Deisenroth

Bayesian Optimization (BO) is a principled framework for optimizing expensive black-box functions, with Expected Improvement (EI) among its most widely used acquisition functions. Despite its empirical success, EI is agnostic to first-order…

机器学习 · 计算机科学 2026-05-19 Joshua Hang Sai Ip , Georgios Makrygiorgos , Ali Mesbah

Bayesian optimization (BO) with Gaussian processes is a powerful methodology to optimize an expensive black-box function with as few function evaluations as possible. The expected improvement (EI) and probability of improvement (PI) are…

机器学习 · 计算机科学 2023-07-06 Takuya Kanazawa

The Expected Improvement (EI) method, proposed by Jones et al. (1998), is a widely-used Bayesian optimization method, which makes use of a fitted Gaussian process model for efficient black-box optimization. However, one key drawback of EI…

统计方法学 · 统计学 2023-04-21 Zhehui Chen , Simon Mak , C. F. Jeff Wu

Bayesian optimization (BO) is a popular algorithm for solving challenging optimization tasks. It is designed for problems where the objective function is expensive to evaluate, perhaps not available in exact form, without gradient…

机器学习 · 统计学 2018-08-22 Umberto Noè , Dirk Husmeier

Design optimization under uncertainty is notoriously difficult when the objective function is expensive to evaluate. State-of-the-art techniques, e.g, stochastic optimization or sampling average approximation, fail to learn exploitable…

最优化与控制 · 数学 2019-06-20 Piyush Pandita , Ilias Bilionis , Jitesh Panchal

One of the most interesting features of Bayesian optimization for direct policy search is that it can leverage priors (e.g., from simulation or from previous tasks) to accelerate learning on a robot. In this paper, we are interested in…

机器人学 · 计算机科学 2018-03-14 Rémi Pautrat , Konstantinos Chatzilygeroudis , Jean-Baptiste Mouret

Bayesian optimization is a widely used method for optimizing expensive black-box functions, with Expected Improvement being one of the most commonly used acquisition functions. In contrast, information-theoretic acquisition functions aim to…

机器学习 · 统计学 2026-05-15 Nuojin Cheng , Leonard Papenmeier , Stephen Becker , Luigi Nardi

Real-world optimization problems often involve complex objective functions with costly evaluations. While Bayesian optimization (BO) with Gaussian processes is effective for these challenges, it suffers in high-dimensional spaces due to…

机器学习 · 计算机科学 2024-12-17 Nobuo Namura , Sho Takemori

Bayesian optimization is a sample-efficient method for finding a global optimum of an expensive-to-evaluate black-box function. A global solution is found by accumulating a pair of query point and its function value, repeating these two…

机器学习 · 统计学 2020-06-17 Jungtaek Kim , Seungjin Choi

We propose a novel, theoretically-grounded, acquisition function for Batch Bayesian optimization informed by insights from distributionally ambiguous optimization. Our acquisition function is a lower bound on the well-known Expected…

机器学习 · 统计学 2018-04-17 Nikitas Rontsis , Michael A. Osborne , Paul J. Goulart

Bayesian optimization (BO) is among the most effective and widely-used blackbox optimization methods. BO proposes solutions according to an explore-exploit trade-off criterion encoded in an acquisition function, many of which are computed…

机器学习 · 计算机科学 2021-02-19 Louis C. Tiao , Aaron Klein , Matthias Seeger , Edwin V. Bonilla , Cedric Archambeau , Fabio Ramos

In many real-world scenarios, decision makers seek to efficiently optimize multiple competing objectives in a sample-efficient fashion. Multi-objective Bayesian optimization (BO) is a common approach, but many of the best-performing…

机器学习 · 统计学 2020-11-12 Samuel Daulton , Maximilian Balandat , Eytan Bakshy

Bayesian optimisation presents a sample-efficient methodology for global optimisation. Within this framework, a crucial performance-determining subroutine is the maximisation of the acquisition function, a task complicated by the fact that…

Bayesian optimization is a widely used technique for optimizing black-box functions, with Expected Improvement (EI) being the most commonly utilized acquisition function in this domain. While EI is often viewed as distinct from other…

机器学习 · 统计学 2025-03-11 Nuojin Cheng , Stephen Becker
‹ 上一页 1 2 3 10 下一页 ›