English
Related papers

Related papers: A new integral loss function for Bayesian optimiza…

200 papers

Bayesian optimization (BO) is a sample-efficient approach to optimizing costly-to-evaluate black-box functions. Most BO methods ignore how evaluation costs may vary over the optimization domain. However, these costs can be highly…

Machine Learning · Computer Science 2021-11-15 Raul Astudillo , Daniel R. Jiang , Maximilian Balandat , Eytan Bakshy , Peter I. Frazier

This paper proposes a new approach for Bayesian and maximum likelihood parameter estimation for stationary Gaussian processes observed on a large lattice with missing values. We propose an MCMC approach for Bayesian inference, and a Monte…

Computation · Statistics 2014-02-19 Jonathan R. Stroud , Michael L. Stein , Shaun Lysen

In this study, variable acceptance sampling plans under Type I hybrid censoring is designed for a lot of independent and identical units with exponential lifetimes using Bayesian estimate of the parameter $\vartheta$. This approach is new…

Statistics Theory · Mathematics 2023-11-29 Ashlyn Maria Mathai , Mahesh Kumar

Sequential maximization of expected improvement (EI) is one of the most widely used policies in Bayesian optimization because of its simplicity and ability to handle noisy observations. In particular, the improvement function often uses the…

Machine Learning · Computer Science 2023-11-15 Han Zhou , Xingchen Ma , Matthew B Blaschko

Local optimization presents a promising approach to expensive, high-dimensional black-box optimization by sidestepping the need to globally explore the search space. For objective functions whose gradient cannot be evaluated directly,…

Machine Learning · Computer Science 2023-01-18 Quan Nguyen , Kaiwen Wu , Jacob R. Gardner , Roman Garnett

Bayesian optimization (BO) is a class of sample-efficient global optimization methods, where a probabilistic model conditioned on previous observations is used to determine future evaluations via the optimization of an acquisition function.…

Machine Learning · Computer Science 2020-06-22 Eric Hans Lee , David Eriksson , Bolong Cheng , Michael McCourt , David Bindel

Information-based Bayesian optimization (BO) algorithms have achieved state-of-the-art performance in optimizing a black-box objective function. However, they usually require several approximations or simplifying assumptions (without…

Machine Learning · Computer Science 2021-08-02 Quoc Phong Nguyen , Zhaoxuan Wu , Bryan Kian Hsiang Low , Patrick Jaillet

This paper introduces the $f$-EI$(\phi)$ algorithm, a novel iterative algorithm which operates on measures and performs $f$-divergence minimisation in a Bayesian framework. We prove that for a rich family of values of $(f,\phi)$ this…

Statistics Theory · Mathematics 2021-03-16 Kamélia Daudel , Randal Douc , François Portier , François Roueff

We consider an unknown multivariate function representing a system-such as a complex numerical simulator-taking both deterministic and uncertain inputs. Our objective is to estimate the set of deterministic inputs leading to outputs whose…

Machine Learning · Statistics 2024-12-09 Romain Ait Abdelmalek-Lomenech , Julien Bect , Vincent Chabridon , Emmanuel Vazquez

In many applications, ranging from logistics to engineering, a designer is faced with a sequence of optimization tasks for which the objectives are in the form of black-box functions that are costly to evaluate. Furthermore, higher-fidelity…

Machine Learning · Computer Science 2025-01-09 Yunchuan Zhang , Sangwoo Park , Osvaldo Simeone

In Bayesian optimization, accounting for the importance of the output relative to the input is a crucial yet challenging exercise, as it can considerably improve the final result but often involves inaccurate and cumbersome entropy…

Machine Learning · Computer Science 2020-12-30 Antoine Blanchard , Themistoklis Sapsis

We study the problem of optimizing a function under a \emph{budgeted number of evaluations}. We only assume that the function is \emph{locally} smooth around one of its global optima. The difficulty of optimization is measured in terms of…

Machine Learning · Computer Science 2019-02-26 Peter L. Bartlett , Victor Gabillon , Michal Valko

The Markov Decision Process (MDP) is a popular framework for sequential decision-making problems, and uncertainty quantification is an essential component of it to learn optimal decision-making strategies. In particular, a Bayesian…

Machine Learning · Statistics 2025-05-06 Jiaqi Guo , Chon Wai Ho , Sumeetpal S. Singh

Given a multivariate function taking deterministic and uncertain inputs, we consider the problem of estimating a quantile set: a set of deterministic inputs for which the probability that the output belongs to a specific region remains…

Applications · Statistics 2025-07-25 Romain Ait Abdelmalek-Lomenech , Julien Bect , Emmanuel Vazquez

We obtain a reliability acceptance sampling plan for independent competing risk data under interval censoring schemes using the Bayesian approach. At first, the Bayesian reliability acceptance sampling plan is obtained where the decision…

Applications · Statistics 2025-10-21 Biswabrata Pradhan , Rathin Das

We propose a practical Bayesian optimization method using Gaussian process regression, of which the marginal likelihood is maximized where the number of model selection steps is guided by a pre-defined threshold. Since Bayesian optimization…

Machine Learning · Statistics 2020-10-19 Jungtaek Kim , Seungjin Choi

Bayesian Optimization (BO) is a sample-efficient optimization algorithm widely employed across various applications. In some challenging BO tasks, input uncertainty arises due to the inevitable randomness in the optimization process, such…

Machine Learning · Computer Science 2023-11-07 Lin Yang , Junlong Lyu , Wenlong Lyu , Zhitang Chen

Bayesian optimization (BO) is a widely used iterative algorithm for optimizing black-box functions. Each iteration requires maximizing an acquisition function, such as the upper confidence bound (UCB) or a sample path from the Gaussian…

Machine Learning · Statistics 2025-06-16 Hwanwoo Kim , Chong Liu , Yuxin Chen

We consider the problem of finding an input to a stochastic black box function such that the scalar output of the black box function is as close as possible to a target value in the sense of the expected squared error. While the…

Machine Learning · Computer Science 2023-05-16 Johannes G. Hoffer , Sascha Ranftl , Bernhard C. Geiger

Expected Improvement (EI) is arguably the most popular acquisition function in Bayesian optimization and has found countless successful applications, but its performance is often exceeded by that of more recent methods. Notably, EI and its…

Machine Learning · Computer Science 2025-01-08 Sebastian Ament , Samuel Daulton , David Eriksson , Maximilian Balandat , Eytan Bakshy