English
Related papers

Related papers: Multi-objective Bayesian Optimization using Pareto…

200 papers

Bayesian optimization (BO) is a popular framework to optimize black-box functions. In many applications, the objective function can be evaluated at multiple fidelities to enable a trade-off between the cost and accuracy. To reduce the…

Machine Learning · Computer Science 2020-12-11 Shibo Li , Wei Xing , Mike Kirby , Shandian Zhe

Searching large and complex design spaces for a global optimum can be infeasible and unnecessary. A practical alternative is to iteratively refine the neighborhood of an initial design using local optimization methods such as gradient…

Machine Learning · Computer Science 2025-11-25 David Stenger , Armin Lindicke , Alexander von Rohr , Sebastian Trimpe

We consider the problem of multi-objective optimization (MOO) of expensive black-box functions with the goal of discovering high-quality and diverse Pareto fronts where we are allowed to evaluate a batch of inputs. This problem arises in…

Machine Learning · Computer Science 2024-06-14 Alaleh Ahmadianshalchi , Syrine Belakaria , Janardhan Rao Doppa

Traditional robust multi-objective optimization methods typically prioritize convergence while treating robustness as a secondary consideration. This approach can yield solutions that are not genuinely robust optimal under noise-affected…

Computational Engineering, Finance, and Science · Computer Science 2025-12-01 Lihong Xu , Wenxiang Jiang

Bayesian optimization (BO) is a popular method for efficiently inferring optima of an expensive black-box function via a sequence of queries. Existing information-theoretic BO procedures aim to make queries that most reduce the uncertainty…

Machine Learning · Statistics 2022-10-05 Willie Neiswanger , Lantao Yu , Shengjia Zhao , Chenlin Meng , Stefano Ermon

This paper presents novel mixed-type Bayesian optimization (BO) algorithms to accelerate the optimization of a target objective function by exploiting correlated auxiliary information of binary type that can be more cheaply obtained, such…

Machine Learning · Statistics 2019-06-19 Yehong Zhang , Zhongxiang Dai , Kian Hsiang Low

Multi-objective Bayesian optimization aims to find the Pareto front of trade-offs between a set of expensive objectives while collecting as few samples as possible. In some cases, it is possible to evaluate the objectives separately, and a…

Machine Learning · Statistics 2025-03-04 Jack M. Buckingham , Sebastian Rojas Gonzalez , Juergen Branke

Multi-objective optimization aims at finding trade-off solutions to conflicting objectives. These constitute the Pareto optimal set. In the context of expensive-to-evaluate functions, it is impossible and often non-informative to look for…

Machine Learning · Statistics 2020-02-20 David Gaudrie , Rodolphe Le Riche , Victor Picheny , Benoit Enaux , Vincent Herbert

In decision-making problems, the outcome of an intervention often depends on the causal relationships between system components and is highly costly to evaluate. In such settings, causal Bayesian optimization (CBO) can exploit the causal…

Machine Learning · Statistics 2025-02-21 Shriya Bhatija , Paul-David Zuercher , Jakob Thumm , Thomas Bohné

Bayesian optimization is a sample-efficient method for black-box global optimization. How- ever, the performance of a Bayesian optimization method very much depends on its exploration strategy, i.e. the choice of acquisition function, and…

Machine Learning · Statistics 2015-03-06 Bobak Shahriari , Ziyu Wang , Matthew W. Hoffman , Alexandre Bouchard-Côté , Nando de Freitas

Bayesian optimization (BO) is a powerful framework for optimizing black-box, expensive-to-evaluate functions. Over the past decade, many algorithms have been proposed to integrate cheaper, lower-fidelity approximations of the objective…

Machine Learning · Computer Science 2023-02-27 Petrus Mikkola , Julien Martinelli , Louis Filstroff , Samuel Kaski

We propose MUMBO, the first high-performing yet computationally efficient acquisition function for multi-task Bayesian optimization. Here, the challenge is to perform efficient optimization by evaluating low-cost functions somehow related…

Machine Learning · Computer Science 2020-06-23 Henry B. Moss , David S. Leslie , Paul Rayson

Information-based Bayesian optimization (BO) algorithms have achieved state-of-the-art performance in optimizing a black-box objective function. However, they usually require several approximations or simplifying assumptions (without…

Machine Learning · Computer Science 2021-08-02 Quoc Phong Nguyen , Zhaoxuan Wu , Bryan Kian Hsiang Low , Patrick Jaillet

Optimisation problems often have multiple conflicting objectives that can be computationally and/or financially expensive. Mono-surrogate Bayesian optimisation (BO) is a popular model-based approach for optimising such black-box functions.…

Machine Learning · Computer Science 2022-08-11 George De Ath , Tinkle Chugh , Alma A. M. Rahat

We propose a scheme for investigating the correlation and trade-off among target variables using a multi-objective Bayesian optimization (MBO). We discuss the features of the Pareto front (PF) of ThMn12-type compounds, (R, Z)(Fe,Co,Ti)12 (R…

Materials Science · Physics 2023-01-04 Taro Fukazawa , Takashi Miyake

In the field of evolutionary multi-objective optimization, the approximation of the Pareto front (PF) is achieved by utilizing a collection of representative candidate solutions that exhibit desirable convergence and diversity. Although…

Neural and Evolutionary Computing · Computer Science 2024-07-10 Peng Chen , Jing Liang , Kangjia Qiao , Ponnuthurai Nagaratnam Suganthan , Xuanxuan Ban

Preferential Bayesian optimization (PBO) is a framework for optimizing a decision-maker's latent preferences over available design choices. While preferences often involve multiple conflicting objectives, existing work in PBO assumes that…

Machine Learning · Computer Science 2024-06-24 Raul Astudillo , Kejun Li , Maegan Tucker , Chu Xin Cheng , Aaron D. Ames , Yisong Yue

Analytic continuation of numerical data obtained in imaginary time or frequency has become an essential part of many branches of quantum computational physics. It is, however, an ill-conditioned procedure and thus a hard numerical problem.…

Strongly Correlated Electrons · Physics 2016-08-18 Dominic Bergeron , A. -M. S. Tremblay

Multi-fidelity Bayesian optimization (MFBO) accelerates the search for the global optimum of black-box functions by integrating inexpensive, low-fidelity approximations. The central task of an MFBO policy is to balance the cost-efficiency…

Machine Learning · Computer Science 2026-02-03 Md Abir Hossen , Mohammad Ali Javidian , Vignesh Narayanan , Jason M. O'Kane , Pooyan Jamshidi

Bayesian optimization (BO) is an efficient and flexible global optimization framework that is applicable to a very wide range of engineering applications. To leverage the capability of the classical BO, many extensions, including…

Machine Learning · Statistics 2021-09-01 Anh Tran , Mike Eldred , Scott McCann , Yan Wang