English
Related papers

Related papers: PAMELI: A Meta-Algorithm for Computationally Expen…

200 papers

Optimizing nonlinear systems involving expensive computer experiments with regard to conflicting objectives is a common challenge. When the number of experiments is severely restricted and/or when the number of objectives increases,…

Machine Learning · Statistics 2019-07-16 David Gaudrie , Rodolphe Le Riche , Victor Picheny , Benoit Enaux , Vincent Herbert

In this paper, we study optimization methods consisting of iteratively minimizing surrogates of an objective function. By proposing several algorithmic variants and simple convergence analyses, we make two main contributions. First, we…

Machine Learning · Statistics 2013-05-15 Julien Mairal

In multi-task learning, multiple tasks are solved jointly, sharing inductive bias between them. Multi-task learning is inherently a multi-objective problem because different tasks may conflict, necessitating a trade-off. A common compromise…

Machine Learning · Computer Science 2019-01-14 Ozan Sener , Vladlen Koltun

This paper introduces an effective memetic algorithm for the linear ordering problem with cumulative costs. The proposed algorithm combines an order-based recombination operator with an improved forward-backward local search procedure and…

Neural and Evolutionary Computing · Computer Science 2014-05-20 Tao Ye , Kan Zhou , Zhipeng Lu , Jin-Kao Hao

In engineering optimization problems, multiple objectives with a large number of variables under highly nonlinear constraints are usually required to be simultaneously optimized. Significant computing effort are required to find the Pareto…

Neural and Evolutionary Computing · Computer Science 2020-08-06 Junfei Zhang , Yimiao Huang , Guowei Ma , Brett Nener

Expensive optimization problems (EOPs) are prevalent in real-world applications, where the evaluation of a single solution requires a significant amount of resources. In our study of surrogate-assisted evolutionary algorithms (SAEAs) in…

Neural and Evolutionary Computing · Computer Science 2024-12-06 Hao Hao , Xiaoqun Zhang , Aimin Zhou

Query plans are compared according to multiple cost metrics in multi-objective query optimization. The goal is to find the set of Pareto plans realizing optimal cost tradeoffs for a given query. So far, only algorithms with exponential…

Databases · Computer Science 2016-03-02 Immanuel Trummer , Christoph Koch

As the interest in multi- and many-objective optimization algorithms grows, the performance comparison of these algorithms becomes increasingly important. A large number of performance indicators for multi-objective optimization algorithms…

Artificial Intelligence · Computer Science 2024-11-28 Amin Ibrahim , Azam Asilian Bidgoli , Shahryar Rahnamayan , Kalyanmoy Deb

The term `surrogate modeling' in computational science and engineering refers to the development of computationally efficient approximations for expensive simulations, such as those arising from numerical solution of partial differential…

Numerical Analysis · Mathematics 2022-08-12 Maarten V. de Hoop , Daniel Zhengyu Huang , Elizabeth Qian , Andrew M. Stuart

Multiobjective combinatorial optimization deals with problems considering more than one viewpoint or scenario. The problem of aggregating multiple criteria to obtain a globalizing objective function is of special interest when the number of…

Optimization and Control · Mathematics 2013-06-07 Elena Fernández , Miguel A. Pozo , Justo Puerto

We consider computationally expensive blackbox optimization problems and present a method that employs surrogate models and concurrent computing at the search step of the mesh adaptive direct search (MADS) algorithm. Specifically, we solve…

Optimization and Control · Mathematics 2021-07-28 Bastien Talgorn , Stéphane Alarie , Michael Kokkolaras

Balancing competing objectives is omnipresent across disciplines, from drug design to autonomous systems. Multi-objective Bayesian optimization is a promising solution for such expensive, black-box problems: it fits probabilistic surrogates…

Machine Learning · Computer Science 2026-05-13 Xinyu Zhang , Conor Hassan , Julien Martinelli , Daolang Huang , Samuel Kaski

Many real world applications can be framed as multi-objective optimization problems, where we wish to simultaneously optimize for multiple criteria. Bayesian optimization techniques for the multi-objective setting are pertinent when the…

Machine Learning · Computer Science 2019-06-24 Biswajit Paria , Kirthevasan Kandasamy , Barnabás Póczos

Many real-world decision-making problems involve optimizing multiple objectives simultaneously, rendering the selection of the most preferred solution a non-trivial problem: All Pareto optimal solutions are viable candidates, and it is…

Artificial Intelligence · Computer Science 2025-11-17 Niclas Boehmer , Maximilian T. Wittmann

Expensive multi-objective optimization problems (EMOPs) are common in real-world scenarios where evaluating objective functions is costly and involves extensive computations or physical experiments. Current Pareto set learning methods for…

Machine Learning · Computer Science 2025-03-18 Minh-Duc Nguyen , Phuong Mai Dinh , Quang-Huy Nguyen , Long P. Hoang , Dung D. Le

Expensive multi-objective optimization is a prevalent and crucial concern in many real-world scenarios, where sample-efficiency is vital due to the limited evaluations to recover the true Pareto front for decision making. Existing works…

Machine Learning · Computer Science 2026-02-03 Yiming Yao , Fei Liu , Liang Zhao , Xi Lin , Yilu Liu , Qingfu Zhang

Offline optimization is an emerging problem in many experimental engineering domains including protein, drug or aircraft design, where online experimentation to collect evaluation data is too expensive or dangerous. To avoid that, one has…

Machine Learning · Computer Science 2024-05-10 Yassine Chemingui , Aryan Deshwal , Trong Nghia Hoang , Janardhan Rao Doppa

Parametric multi-objective optimization (PMO) addresses the challenge of solving an infinite family of multi-objective optimization problems, where optimal solutions must adapt to varying parameters. Traditional methods require re-execution…

Neural and Evolutionary Computing · Computer Science 2025-11-11 Ji Cheng , Bo Xue , Qingfu Zhang

Significant effort has been made to solve computationally expensive optimization problems in the past two decades, and various optimization methods incorporating surrogates into optimization have been proposed. However, most optimization…

Neural and Evolutionary Computing · Computer Science 2022-04-13 Julian Blank , Kalyanmoy Deb

This work studies the behavior of three elitist multi- and many-objective evolutionary algorithms generating a high-resolution approximation of the Pareto optimal set. Several search-assessment indicators are defined to trace the dynamics…

Neural and Evolutionary Computing · Computer Science 2014-09-29 Hernan Aguirre , Arnaud Liefooghe , Sébastien Verel , Kiyoshi Tanaka