English
Related papers

Related papers: Efficient Computation of Expected Hypervolume Impr…

200 papers

The problem of approximating the Pareto front of a multiobjective optimization problem can be reformulated as the problem of finding a set that maximizes the hypervolume indicator. This paper establishes the analytical expression of the…

Optimization and Control · Mathematics 2023-01-03 André H. Deutz , Michael T. M. Emmerich , Hao Wang

Solving linear systems of equations is an important problem in science and engineering. Many quantum algorithms, such as the Harrow-Hassidim-Lloyd (HHL) algorithm (for quantum-gate computers) and the box algorithm (for quantum-annealing…

Computational Engineering, Finance, and Science · Computer Science 2024-05-07 Sanjay Suresh , Krishnan Suresh

Extreme value theory (EVT) is well suited to model extreme events, such as floods, heatwaves, or mechanical failures, which is required for reliability assessment of systems across multiple domains for risk management and loss prevention.…

Applications · Statistics 2025-10-15 Shehzaib Irfan , Nabeel Ahmad , Alexander Vinel , Daniel F. Silva , Shuai Shao , Nima Shamsaei , Jia Liu

Modern machine learning algorithms crucially rely on several design decisions to achieve strong performance, making the problem of Hyperparameter Optimization (HPO) more important than ever. Here, we combine the advantages of the popular…

Machine Learning · Computer Science 2021-10-22 Noor Awad , Neeratyoy Mallik , Frank Hutter

Scaling Bayesian optimisation (BO) to high-dimensional search spaces is a active and open research problems particularly when no assumptions are made on function structure. The main reason is that at each iteration, BO requires to find…

Machine Learning · Statistics 2026-04-28 Hung Tran-The , Sunil Gupta , Santu Rana , Svetha Venkatesh

Hyperparameter optimization (HPO) is a critical component of machine learning pipelines, significantly affecting model robustness, stability, and generalization. However, HPO is often a time-consuming and computationally intensive task.…

Machine Learning · Computer Science 2025-03-10 Ruinan Wang , Ian Nabney , Mohammad Golbabaee

A multi-modal multi-objective optimization problem is a special kind of multi-objective optimization problem with multiple Pareto subsets. In this paper, we propose an efficient multi-modal multi-objective optimization algorithm based on…

Neural and Evolutionary Computing · Computer Science 2020-04-22 Yiming Peng , Hisao Ishibuchi

Many expensive black-box optimisation problems are sensitive to their inputs. In these problems it makes more sense to locate a region of good designs, than a single-possibly fragile-optimal design. Expensive black-box functions can be…

Machine Learning · Computer Science 2021-12-16 Nicholas D. Sanders , Richard M. Everson , Jonathan E. Fieldsend , Alma A. M. Rahat

Recent advances have extended the scope of Bayesian optimization (BO) to expensive-to-evaluate black-box functions with dozens of dimensions, aspiring to unlock impactful applications, for example, in the life sciences, neural architecture…

Machine Learning · Computer Science 2026-05-15 Leonard Papenmeier , Luigi Nardi , Matthias Poloczek

Bayesian optimization is a powerful global optimization technique for expensive black-box functions. One of its shortcomings is that it requires auxiliary optimization of an acquisition function at each iteration. This auxiliary…

Machine Learning · Statistics 2014-02-28 Ziyu Wang , Babak Shakibi , Lin Jin , Nando de Freitas

Bayesian optimization (BO) is a popular paradigm for global optimization of expensive black-box functions, but there are many domains where the function is not completely a black-box. The data may have some known structure (e.g. symmetries)…

Machine Learning · Computer Science 2022-12-08 Samuel Kim , Peter Y. Lu , Charlotte Loh , Jamie Smith , Jasper Snoek , Marin Soljačić

Bayesian optimization (BO) has gained attention as an efficient algorithm for black-box optimization of expensive-to-evaluate systems, where the BO algorithm iteratively queries the system and suggests new trials based on a probabilistic…

Machine Learning · Computer Science 2026-03-13 Eike Cramer , Luis Kutschat , Oliver Stollenwerk , Joel A. Paulson , Alexander Mitsos

Mixture variational distributions in black box variational inference (BBVI) have demonstrated impressive results in challenging density estimation tasks. However, currently scaling the number of mixture components can lead to a linear…

Machine Learning · Computer Science 2024-06-12 Alexandra Hotti , Oskar Kviman , Ricky Molén , Víctor Elvira , Jens Lagergren

Choosing a suitable ML model is a complex task that can depend on several objectives, e.g., accuracy, fairness, or energy consumption. In practice, this requires trading off multiple, often competing, objectives through multi-objective…

Machine Learning · Computer Science 2026-05-07 Daphne Theodorakopoulos , Marcel Wever , Marius Lindauer

Bayesian optimization is a powerful technique for optimizing expensive-to-evaluate black-box functions, consisting of two main components: a surrogate model and an acquisition function. In recent years, myopic acquisition functions have…

Machine Learning · Computer Science 2025-04-30 Hui Chen , Xuhui Fan , Zhangkai Wu , Longbing Cao

Models with dominant advection always posed a difficult challenge for projection-based reduced order modelling. Many methodologies that have recently been proposed are based on the pre-processing of the full-order solutions to accelerate…

Numerical Analysis · Mathematics 2022-03-02 Davide Papapicco , Nicola Demo , Michele Girfoglio , Giovanni Stabile , Gianluigi Rozza

In multiobjective optimization, the result of an optimization algorithm is a set of efficient solutions from which the decision maker selects one. It is common that not all the efficient solutions can be computed in a short time and the…

Neural and Evolutionary Computing · Computer Science 2024-03-20 Miguel Ángel Domínguez-Ríos , Francisco Chicano , Enrique Alba

In multi-objective black-box optimization, the goal is typically to find solutions that optimize a set of $T$ black-box objective functions, $f_1, \ldots f_T$, simultaneously. Traditional approaches often seek a single Pareto-optimal set…

Bayesian Optimization (BO) is a surrogate-assisted global optimization technique that has been successfully applied in various fields, e.g., automated machine learning and design optimization. Built upon a so-called infill-criterion and…

Neural and Evolutionary Computing · Computer Science 2020-07-03 Elena Raponi , Hao Wang , Mariusz Bujny , Simonetta Boria , Carola Doerr

This paper presents a piecewise convexification method for solving non-convex multi-objective optimization problems with box constraints. Based on the ideas of the $\alpha$-based Branch and Bound (${\rm \alpha BB}$) method of global…

Optimization and Control · Mathematics 2022-06-28 Q. Zhu , L. P. Tang , X. M. Yang