中文
相关论文

相关论文: Derivation of Closed Form of Expected Improvement …

200 篇论文

Sequential maximization of expected improvement (EI) is one of the most widely used policies in Bayesian optimization because of its simplicity and ability to handle noisy observations. In particular, the improvement function often uses the…

机器学习 · 计算机科学 2023-11-15 Han Zhou , Xingchen Ma , Matthew B Blaschko

Expected improvement (EI) is one of the most widely used acquisition functions in Bayesian optimization (BO). Despite its proven success in applications for decades, important open questions remain on the theoretical convergence behaviors…

机器学习 · 统计学 2025-02-13 Jingyi Wang , Haowei Wang , Nai-Yuan Chiang , Cosmin G. Petra

Expected Improvement (EI) is arguably the most popular acquisition function in Bayesian optimization and has found countless successful applications, but its performance is often exceeded by that of more recent methods. Notably, EI and its…

机器学习 · 计算机科学 2025-01-08 Sebastian Ament , Samuel Daulton , David Eriksson , Maximilian Balandat , Eytan Bakshy

The Expected Improvement (EI) method, proposed by Jones et al. (1998), is a widely-used Bayesian optimization method, which makes use of a fitted Gaussian process model for efficient black-box optimization. However, one key drawback of EI…

统计方法学 · 统计学 2023-04-21 Zhehui Chen , Simon Mak , C. F. Jeff Wu

The expected improvement (EI) algorithm is a popular strategy for information collection in optimization under uncertainty. The algorithm is widely known to be too greedy, but nevertheless enjoys wide use due to its simplicity and ability…

机器学习 · 计算机科学 2017-05-30 Chao Qin , Diego Klabjan , Daniel Russo

Bayesian Optimization (BO) is a principled framework for optimizing expensive black-box functions, with Expected Improvement (EI) among its most widely used acquisition functions. Despite its empirical success, EI is agnostic to first-order…

机器学习 · 计算机科学 2026-05-19 Joshua Hang Sai Ip , Georgios Makrygiorgos , Ali Mesbah

We consider optimization of composite objective functions, i.e., of the form $f(x)=g(h(x))$, where $h$ is a black-box derivative-free expensive-to-evaluate function with vector-valued outputs, and $g$ is a cheap-to-evaluate real-valued…

机器学习 · 统计学 2019-06-05 Raul Astudillo , Peter I. Frazier

Bayesian optimization is a widely used technique for optimizing black-box functions, with Expected Improvement (EI) being the most commonly utilized acquisition function in this domain. While EI is often viewed as distinct from other…

机器学习 · 统计学 2025-03-11 Nuojin Cheng , Stephen Becker

We deal with the efficient parallelization of Bayesian global optimization algorithms, and more specifically of those based on the expected improvement criterion and its variants. A closed form formula relying on multivariate Gaussian…

机器学习 · 统计学 2016-09-12 Sébastien Marmin , Clément Chevalier , David Ginsbourger

The expected improvement (EI) algorithm is one of the most popular strategies for optimization under uncertainty due to its simplicity and efficiency. Despite its popularity, the theoretical aspects of this algorithm have not been properly…

机器学习 · 计算机科学 2026-04-28 Hung Tran-The , Sunil Gupta , Santu Rana , Svetha Venkatesh

Bayesian optimization is a powerful paradigm to optimize black-box functions based on scarce and noisy data. Its data efficiency can be further improved by transfer learning from related tasks. While recent transfer models meta-learn a…

In many real-world applications, we are interested in approximating black-box, costly functions as accurately as possible with the smallest number of function evaluations. A complex computer code is an example of such a function. In this…

统计计算 · 统计学 2022-03-22 Hossein Mohammadi , Peter Challenor , Daniel Williamson , Marc Goodfellow

Bayesian optimization is a sample-efficient method for finding a global optimum of an expensive-to-evaluate black-box function. A global solution is found by accumulating a pair of query point and its function value, repeating these two…

机器学习 · 统计学 2020-06-17 Jungtaek Kim , Seungjin Choi

We consider the problem of finding an input to a stochastic black box function such that the scalar output of the black box function is as close as possible to a target value in the sense of the expected squared error. While the…

机器学习 · 计算机科学 2023-05-16 Johannes G. Hoffer , Sascha Ranftl , Bernhard C. Geiger

Bayesian Optimization (BO) links Gaussian Process (GP) surrogates with sequential design toward optimizing expensive-to-evaluate black-box functions. Example design heuristics, or so-called acquisition functions, like expected improvement…

机器学习 · 计算机科学 2023-08-16 Ryan B. Christianson , Robert B. Gramacy

Bayesian optimization (BO) with Gaussian processes is a powerful methodology to optimize an expensive black-box function with as few function evaluations as possible. The expected improvement (EI) and probability of improvement (PI) are…

机器学习 · 计算机科学 2023-07-06 Takuya Kanazawa

Bayesian Optimization, leveraging Gaussian process models, has proven to be a powerful tool for minimizing expensive-to-evaluate objective functions by efficiently exploring the search space. Extensions such as constrained Bayesian…

统计计算 · 统计学 2025-06-03 Yezhuo Li , Qiong Zhang , Madhura Limaye , Gang Li

We propose a novel, theoretically-grounded, acquisition function for Batch Bayesian optimization informed by insights from distributionally ambiguous optimization. Our acquisition function is a lower bound on the well-known Expected…

机器学习 · 统计学 2018-04-17 Nikitas Rontsis , Michael A. Osborne , Paul J. Goulart

Design optimization under uncertainty is notoriously difficult when the objective function is expensive to evaluate. State-of-the-art techniques, e.g, stochastic optimization or sampling average approximation, fail to learn exploitable…

最优化与控制 · 数学 2019-06-20 Piyush Pandita , Ilias Bilionis , Jitesh Panchal

Bayesian optimization is a widely used method for optimizing expensive black-box functions, with Expected Improvement being one of the most commonly used acquisition functions. In contrast, information-theoretic acquisition functions aim to…

机器学习 · 统计学 2026-05-15 Nuojin Cheng , Leonard Papenmeier , Stephen Becker , Luigi Nardi
‹ 上一页 1 2 3 10 下一页 ›