English
Related papers

Related papers: Anytime Bi-Objective Optimization with a Hybrid Mu…

200 papers

Bayesian optimization is a class of data efficient model based algorithms typically focused on global optimization. We consider the more general case where a user is faced with multiple problems that each need to be optimized conditional on…

Machine Learning · Statistics 2020-11-04 Michael Pearce , Janis Klaise , Matthew Groves

Evolutionary multi-objective optimization (EMO) algorithms have been demonstrated to be effective in solving multi-criteria decision-making problems. In real-world applications, analysts often employ several algorithms concurrently and…

Neural and Evolutionary Computing · Computer Science 2024-08-09 Yansong Huang , Zherui Zhang , Ao Jiao , Yuxin Ma , Ran Cheng

Bayesian Optimization (BO) is a well-established method for addressing black-box optimization problems. In many real-world scenarios, optimization often involves multiple functions, emphasizing the importance of leveraging data and learned…

Machine Learning · Computer Science 2025-03-11 Khoa Nguyen , Viet Huynh , Binh Tran , Tri Pham , Tin Huynh , Thin Nguyen

Choosing automatically the right algorithm using problem descriptors is a classical component of combinatorial optimization. It is also a good tool for making evolutionary algorithms fast, robust and versatile. We present Shiwa, an…

Artificial Intelligence · Computer Science 2020-04-30 Jialin Liu , Antoine Moreau , Mike Preuss , Baptiste Roziere , Jeremy Rapin , Fabien Teytaud , Olivier Teytaud

Single-objective optimization algorithms search for the single highest-quality solution with respect to an objective. Quality diversity (QD) optimization algorithms, such as Covariance Matrix Adaptation MAP-Elites (CMA-ME), search for a…

Machine Learning · Computer Science 2023-06-07 Matthew C. Fontaine , Stefanos Nikolaidis

The prospect of quantum solutions for complicated optimization problems is contingent on mapping the original problem onto a tractable quantum energy landscape, e.g. an Ising-type Hamiltonian. Subsequently, techniques like adiabatic…

Quantum Physics · Physics 2025-10-17 Sebastian Egginger , Kristina Kirova , Sonja Bruckner , Stefan Hillmich , Richard Kueng

Stochastic optimization finds a wide range of applications in operations research and management science. However, existing stochastic optimization techniques usually require the information of random samples (e.g., demands in the…

Optimization and Control · Mathematics 2019-04-18 Xi Chen , Qihang Lin , Zizhuo Wang

Coordinating multiple agents to collaboratively maximize submodular functions in unpredictable environments is a critical task with numerous applications in machine learning, robot planning and control. The existing approaches, such as the…

Multiagent Systems · Computer Science 2025-02-10 Qixin Zhang , Zongqi Wan , Yu Yang , Li Shen , Dacheng Tao

We propose a novel constraint-handling technique for the covariance matrix adaptation evolution strategy (CMA-ES). The proposed technique is aimed at solving explicitly constrained black-box continuous optimization problems, in which the…

Neural and Evolutionary Computing · Computer Science 2022-05-11 Naoki Sakamoto , Youhei Akimoto

Real-world problems often involve the optimization of several objectives under multiple constraints. An example is the hyper-parameter tuning problem of machine learning algorithms. In particular, the minimization of the estimation of the…

Machine Learning · Statistics 2021-07-02 Eduardo C. Garrido-Merchán , Daniel Hernández-Lobato

Exploiting knowledge about the structure of a problem can greatly benefit the efficiency and scalability of an Evolutionary Algorithm (EA). Model-Based EAs (MBEAs) are capable of doing this by explicitly modeling the problem structure. The…

Neural and Evolutionary Computing · Computer Science 2023-05-11 Anton Bouter , Peter A. N. Bosman

Bayesian optimization (BO) offers an efficient pipeline for optimizing black-box functions with the help of a Gaussian process prior and an acquisition function (AF). Recently, in the context of single-objective BO, learning-based AFs…

Machine Learning · Computer Science 2025-05-30 Yu-Heng Hung , Kai-Jie Lin , Yu-Heng Lin , Chien-Yi Wang , Cheng Sun , Ping-Chun Hsieh

In solving multi-modal, multi-objective optimization problems (MMOPs), the objective is not only to find a good representation of the Pareto-optimal front (PF) in the objective space but also to find all equivalent Pareto-optimal subsets…

Neural and Evolutionary Computing · Computer Science 2022-10-24 Tapabrata Ray , Mohammad Mohiuddin Mamun , Hemant Kumar Singh

Energy systems optimization problems are complex due to strongly non-linear system behavior and multiple competing objectives, e.g. economic gain vs. environmental impact. Moreover, a large number of input variables and different variable…

The widespread adoption of complex machine learning models in high-stakes domains has brought the "black-box" problem to the forefront of responsible AI research. This paper aims at addressing this issue by improving the Explainable…

Machine Learning · Computer Science 2025-12-02 Isara Liyanage , Uthayasanker Thayasivam

This article addresses the problem of derivative-free (single- or multi-objective) optimization subject to multiple inequality constraints. Both the objective and constraint functions are assumed to be smooth, non-linear and expensive to…

Computation · Statistics 2017-07-28 Paul Feliot , Julien Bect , Emmanuel Vazquez

We present HIghly Parallelisable Pareto Optimisation (HIPPO) -- a batch acquisition function that enables multi-objective Bayesian optimisation methods to efficiently exploit parallel processing resources. Multi-Objective Bayesian…

Machine Learning · Computer Science 2022-06-28 Andrei Paleyes , Henry B. Moss , Victor Picheny , Piotr Zulawski , Felix Newman

Bayesian optimization (BO) is a popular method to optimize costly black-box functions. While traditional BO optimizes each new target task from scratch, meta-learning has emerged as a way to leverage knowledge from related tasks to optimize…

Machine Learning · Computer Science 2024-07-01 Jiarong Pan , Stefan Falkner , Felix Berkenkamp , Joaquin Vanschoren

We introduce a surrogate-based black-box optimization method, termed Polynomial-model-based optimization (PMBO). The algorithm alternates polynomial approximation with Bayesian optimization steps, using Gaussian processes to model the error…

Optimization and Control · Mathematics 2024-03-13 Janina Schreiber , Pau Batlle , Damar Wicaksono , Michael Hecht

This tutorial introduces the CMA Evolution Strategy (ES), where CMA stands for Covariance Matrix Adaptation. The CMA-ES is a stochastic, or randomized, method for real-parameter (continuous domain) optimization of non-linear, non-convex…

Machine Learning · Computer Science 2023-03-13 Nikolaus Hansen