English
Related papers

Related papers: Probability Distribution of Hypervolume Improvemen…

200 papers

The expected improvement algorithm (or efficient global optimization) aims for global continuous optimization with a limited budget of black-box function evaluations. It is based on a statistical model of the function learned from previous…

Data Structures and Algorithms · Computer Science 2014-09-01 Iris Hupkens , Michael Emmerich , André Deutz

In many real-world scenarios, decision makers seek to efficiently optimize multiple competing objectives in a sample-efficient fashion. Multi-objective Bayesian optimization (BO) is a common approach, but many of the best-performing…

Machine Learning · Statistics 2020-11-12 Samuel Daulton , Maximilian Balandat , Eytan Bakshy

Optimizing multiple competing objectives is a common problem across science and industry. The inherent inextricable trade-off between those objectives leads one to the task of exploring their Pareto front. A meaningful quantity for the…

Machine Learning · Computer Science 2023-10-24 Jim Boelrijk , Bernd Ensing , Patrick Forré

In the field of multi-objective optimization algorithms, multi-objective Bayesian Global Optimization (MOBGO) is an important branch, in addition to evolutionary multi-objective optimization algorithms (EMOAs). MOBGO utilizes Gaussian…

Machine Learning · Computer Science 2019-06-14 Kaifeng Yang , Michael Emmerich , André Deutz , Thomas Bäck

In this article, we present a framework for taking into account user preferences in multi-objective Bayesian optimization in the case where the objectives are expensive-to-evaluate black-box functions. A novel expected improvement criterion…

Optimization and Control · Mathematics 2018-09-17 Paul Feliot , Julien Bect , Emmanuel Vazquez

Hypervolume (HV)-based Bayesian optimization (BO) is one of the standard approaches for multi-objective decision-making. However, the computational cost of optimizing the acquisition function remains a significant bottleneck, primarily due…

Machine Learning · Computer Science 2025-12-08 Shuhei Watanabe

Optimizing multiple competing black-box objectives is a challenging problem in many fields, including science, engineering, and machine learning. Multi-objective Bayesian optimization (MOBO) is a sample-efficient approach for identifying…

Machine Learning · Computer Science 2021-10-28 Samuel Daulton , Maximilian Balandat , Eytan Bakshy

We present a multi-objective Bayesian optimisation algorithm that allows the user to express preference-order constraints on the objectives of the type "objective A is more important than objective B". These preferences are defined based on…

Machine Learning · Computer Science 2019-11-14 Majid Abdolshah , Alistair Shilton , Santu Rana , Sunil Gupta , Svetha Venkatesh

Many methods for performing multi-objective optimisation of computationally expensive problems have been proposed recently. Typically, a probabilistic surrogate for each objective is constructed from an initial dataset. The surrogates can…

Machine Learning · Computer Science 2022-06-17 Alma Rahat , Tinkle Chugh , Jonathan Fieldsend , Richard Allmendinger , Kaisa Miettinen

Student-$t$ processes have recently been proposed as an appealing alternative non-parameteric function prior. They feature enhanced flexibility and predictive variance. In this work the use of Student-$t$ processes are explored for…

Machine Learning · Statistics 2016-12-02 Joachim van der Herten , Ivo Couckuyt , Tom Dhaene

In multi-objective Bayesian optimization and surrogate-based evolutionary algorithms, Expected HyperVolume Improvement (EHVI) is widely used as the acquisition function to guide the search approaching the Pareto front. This paper focuses on…

Machine Learning · Statistics 2019-01-25 Guang Zhao , Raymundo Arroyave , Xiaoning Qian

Bayesian models often involve a small set of hyperparameters determined by maximizing the marginal likelihood. Bayesian optimization is a popular iterative method where a Gaussian process posterior of the underlying function is sequentially…

Computation · Statistics 2022-08-18 Oskar Gustafsson , Mattias Villani , Pär Stockhammar

This paper studies preference-shaped expected improvement criteria for Bayesian multiobjective optimization. We consider two indicator families which are often used for similar algorithmic purposes, but which are geometrically different.…

Optimization and Control · Mathematics 2026-05-29 Michael T. M. Emmerich

We propose a novel, theoretically-grounded, acquisition function for Batch Bayesian optimization informed by insights from distributionally ambiguous optimization. Our acquisition function is a lower bound on the well-known Expected…

Machine Learning · Statistics 2018-04-17 Nikitas Rontsis , Michael A. Osborne , Paul J. Goulart

Bayesian optimization (BO) is a popular algorithm for solving challenging optimization tasks. It is designed for problems where the objective function is expensive to evaluate, perhaps not available in exact form, without gradient…

Machine Learning · Statistics 2018-08-22 Umberto Noè , Dirk Husmeier

Bayesian optimization (BO) protocol based on Active Learning (AL) principles has garnered significant attention due to its ability to optimize black-box objective functions efficiently. This capability is a prerequisite for guiding…

Chemical Physics · Physics 2024-08-07 Osman Mamun , Markus Bause , Bhuiyan Shameem Mahmud Ebna Hai

Bayesian optimization (BO) has become an established framework and popular tool for hyperparameter optimization (HPO) of machine learning (ML) algorithms. While known for its sample-efficiency, vanilla BO can not utilize readily available…

Machine Learning · Computer Science 2022-04-26 Carl Hvarfner , Danny Stoll , Artur Souza , Marius Lindauer , Frank Hutter , Luigi Nardi

Bayesian Optimization has become the reference method for the global optimization of black box, expensive and possibly noisy functions. Bayesian Op-timization learns a probabilistic model about the objective function, usually a Gaussian…

Machine Learning · Statistics 2020-03-10 Antonio Candelieri , Ilaria Giordani , Riccardo Perego , Francesco Archetti

Many optimization problems arising in applications have to consider several objective functions at the same time. Evolutionary algorithms seem to be a very natural choice for dealing with multi-objective problems as the population of such…

Neural and Evolutionary Computing · Computer Science 2013-09-17 Tobias Friedrich , Frank Neumann , Christian Thyssen

Bayesian Optimisation (BO) methods seek to find global optima of objective functions which are only available as a black-box or are expensive to evaluate. Such methods construct a surrogate model for the objective function, quantifying the…

Machine Learning · Statistics 2023-01-10 Enrico Crovini , Simon L. Cotter , Konstantinos Zygalakis , Andrew B. Duncan
‹ Prev 1 2 3 10 Next ›