English
Related papers

Related papers: Scalarizing Functions in Bayesian Multiobjective O…

200 papers

Bayesian optimization is used in many areas of AI for the optimization of black-box processes and has achieved impressive improvements of the state of the art for a lot of applications. It intelligently explores large and complex design…

Materials Science · Physics 2021-08-03 Lars Kotthoff , Hud Wahab , Patrick Johnson

Bayesian optimization (BO) is a widely-used sequential method for zeroth-order optimization of complex and expensive-to-compute black-box functions. The existing BO methods assume that the function evaluation (feedback) is available to the…

Machine Learning · Computer Science 2022-06-22 Arun Verma , Zhongxiang Dai , Bryan Kian Hsiang Low

Bayesian optimization is a sample-efficient method for finding a global optimum of an expensive-to-evaluate black-box function. A global solution is found by accumulating a pair of query point and its function value, repeating these two…

Machine Learning · Statistics 2020-06-17 Jungtaek Kim , Seungjin Choi

This article addresses the problem of derivative-free (single- or multi-objective) optimization subject to multiple inequality constraints. Both the objective and constraint functions are assumed to be smooth, non-linear and expensive to…

Computation · Statistics 2017-07-28 Paul Feliot , Julien Bect , Emmanuel Vazquez

We present a novel approach to help decision-makers efficiently identify preferred solutions from the Pareto set of a multi-objective optimization problem. Our method uses a Bayesian model to estimate the decision-maker's utility function…

Machine Learning · Statistics 2025-11-13 Felix Huber , Sebastian Rojas Gonzalez , Raul Astudillo

The aim of this literature is to illustrate the application of multi-objective optimization routines through a case study of face milling operation. For this purpose, the face milling operation is designed as a multi-objective optimization…

Optimization and Control · Mathematics 2023-01-24 Nazmul Hasan

The increasing availability of graph-structured data motivates the task of optimising over functions defined on the node set of graphs. Traditional graph search algorithms can be applied in this case, but they may be sample-inefficient and…

Machine Learning · Computer Science 2023-10-31 Xingchen Wan , Pierre Osselin , Henry Kenlay , Binxin Ru , Michael A. Osborne , Xiaowen Dong

Most machine learning methods require careful selection of hyper-parameters in order to train a high performing model with good generalization abilities. Hence, several automatic selection algorithms have been introduced to overcome tedious…

Machine Learning · Computer Science 2020-01-17 Raju Ram , Sabine Müller , Franz-Josef Pfreundt , Nicolas R. Gauger , Janis Keuper

Several fundamental problems in science and engineering consist of global optimization tasks involving unknown high-dimensional (black-box) functions that map a set of controllable variables to the outcomes of an expensive experiment.…

Machine Learning · Computer Science 2023-09-15 Mohamed Aziz Bhouri , Michael Joly , Robert Yu , Soumalya Sarkar , Paris Perdikaris

Bayesian optimization (BO) is a popular method to optimize costly black-box functions. While traditional BO optimizes each new target task from scratch, meta-learning has emerged as a way to leverage knowledge from related tasks to optimize…

Machine Learning · Computer Science 2024-07-01 Jiarong Pan , Stefan Falkner , Felix Berkenkamp , Joaquin Vanschoren

Simulation Optimization (SO) refers to the optimization of an objective function subject to constraints, both of which can be evaluated through a stochastic simulation. To address specific features of a particular simulation---discrete or…

Data Structures and Algorithms · Computer Science 2017-06-28 Satyajith Amaran , Nikolaos V. Sahinidis , Bikram Sharda , Scott J. Bury

Application domains of Bayesian optimization include optimizing black-box functions or very complex functions. The functions we are interested in describe complex real-world systems applied in industrial settings. Even though they do have…

Machine Learning · Computer Science 2021-06-14 Franz Brauße , Zurab Khasidashvili , Konstantin Korovin

Bayesian methods are developed for the multivariate nonparametric regression problem where the domain is taken to be a compact Riemannian manifold. In terms of the latter, the underlying geometry of the manifold induces certain symmetries…

Statistics Theory · Mathematics 2007-06-13 Jean-François Angers , Peter T. Kim

A key drawback of the current generation of artificial decision-makers is that they do not adapt well to changes in unexpected situations. This paper addresses the situation in which an AI for aerial dog fighting, with tunable parameters…

Machine Learning · Statistics 2016-12-14 Brett Israelsen , Nisar Ahmed

Bayesian optimization methods allocate limited sampling budgets to maximize expensive-to-evaluate functions. One-step-lookahead policies are often used, but computing optimal multi-step-lookahead policies remains a challenge. We consider a…

Optimization and Control · Mathematics 2016-07-13 J. Massey Cashore , Lemuel Kumarga , Peter I. Frazier

Frequentist statistical methods, such as hypothesis testing, are standard practice in papers that provide benchmark comparisons. Unfortunately, these methods have often been misused, e.g., without testing for their statistical test…

Methodology · Statistics 2021-05-18 David Issa Mattos , Jan Bosch , Helena Holmström Olsson

We describe a method for Bayesian optimization by which one may incorporate data from multiple systems whose quantitative interrelationships are unknown a priori. All general (nonreal-valued) features of the systems are associated with…

Machine Learning · Computer Science 2020-01-06 Steven Atkinson , Sayan Ghosh , Natarajan Chennimalai-Kumar , Genghis Khan , Liping Wang

Bayesian optimization has become a fundamental global optimization algorithm in many problems where sample efficiency is of paramount importance. Recently, there has been proposed a large number of new applications in fields such as…

Artificial Intelligence · Computer Science 2019-02-06 Ruben Martinez-Cantin

Bayesian optimization has recently emerged as a popular and efficient tool for global optimization and hyperparameter tuning. Currently, the established Bayesian optimization practice requires a user-defined bounding box which is assumed to…

Machine Learning · Statistics 2015-08-18 Bobak Shahriari , Alexandre Bouchard-Côté , Nando de Freitas

Within the framework of complex system design, it is often necessary to solve mixed variable optimization problems, in which the objective and constraint functions can depend simultaneously on continuous and discrete variables.…

Optimization and Control · Mathematics 2020-03-10 Julien Pelamatti , Loic Brevault , Mathieu Balesdent , El-Ghazali Talbi , Yannick Guerin