English
Related papers

Related papers: Natural Evolution Strategy for Mixed-Integer Black…

200 papers

In this study, we consider a continuous min--max optimization problem $\min_{x \in \mathbb{X} \max_{y \in \mathbb{Y}}}f(x,y)$ whose objective function is a black-box. We propose a novel approach to minimize the worst-case objective function…

Neural and Evolutionary Computing · Computer Science 2023-03-29 Atsuhiro Miyagi , Yoshiki Miyauchi , Atsuo Maki , Kazuto Fukuchi , Jun Sakuma , Youhei Akimoto

Differential evolution (DE) generally requires parameter control methods (PCMs) for the scale factor and crossover rate. Although a better understanding of PCMs provides a useful clue to designing an efficient DE, their effectiveness is…

Neural and Evolutionary Computing · Computer Science 2024-04-05 Ryoji Tanabe

Existing Meta-Black-Box Optimization (MetaBBO) methods focus on how to search when controlling optimizers, but largely overlook where to search. We propose MetaSG-SAEA, a bi-level MetaBBO framework for expensive constrained multi-objective…

Neural and Evolutionary Computing · Computer Science 2026-05-12 Yukun Du , Haiyue Yu , Jiang Jiang , Shuaiwen Tang , Xiaotong Xie , Haobo Liu , Chongshuang Hu , Shengkun Chang

This paper addresses the development of a covariance matrix self-adaptation evolution strategy (CMSA-ES) for solving optimization problems with linear constraints. The proposed algorithm is referred to as Linear Constraint CMSA-ES…

Neural and Evolutionary Computing · Computer Science 2018-09-24 Patrick Spettel , Hans-Georg Beyer , Michael Hellwig

Despite the state-of-the-art performance of the covariance matrix adaptation evolution strategy (CMA-ES), high-dimensional black-box optimization problems are challenging tasks. Such problems often involve a property called low effective…

Neural and Evolutionary Computing · Computer Science 2024-12-03 Kento Uchida , Teppei Yamaguchi , Shinichi Shirakawa

Black-box optimization is a powerful approach for discovering global optima in noisy and expensive black-box functions, a problem widely encountered in real-world scenarios. Recently, there has been a growing interest in leveraging domain…

Machine Learning · Computer Science 2024-02-06 Dat Phan-Trong , Hung The Tran , Alistair Shilton , Sunil Gupta

Solving optimization problems in which functions are blackboxes and variables involve different types poses significant theoretical and algorithmic challenges. Nevertheless, such settings frequently occur in simulation-based engineering…

Optimization and Control · Mathematics 2025-06-25 Charles Audet , Youssef Diouane , Edward Hallé-Hannan , Sébastien Le Digabel , Christophe Tribes

Proportional integral derivative (PID) controllers are important and widely used tools in system control. Tuning of the controller gains is a laborious task, especially for complex systems such as combustion engines. To minimize the time of…

Systems and Control · Computer Science 2017-06-07 Katerina Henclova

This paper introduces a Multi-Strategy Improved Black Widow Optimization Algorithm (MSBWOA), designed to enhance the performance of the standard Black Widow Algorithm (BW) in solving complex optimization problems. The proposed algorithm…

Neural and Evolutionary Computing · Computer Science 2023-12-22 Xin Xu

Multimodal optimization requires both exploration and exploitation. Exploration identifies promising attraction basins, while exploitation finds the best solutions within these basins. The balance between exploration and exploitation can be…

Neural and Evolutionary Computing · Computer Science 2025-06-03 Chandula Fernando , Kushani De Silva

In the context of the 2018 IEEE Congress of Evolutionary Computation, the Matrix Adaptation Evolution Strategy for constrained optimization turned out to be notably successful in the competition on constrained single objective…

Neural and Evolutionary Computing · Computer Science 2024-05-09 Michael Hellwig , Hans-Georg Beyer

To relieve intensive human-expertise required to design optimization algorithms, recent Meta-Black-Box Optimization (MetaBBO) researches leverage generalization strength of meta-learning to train neural network-based algorithm design…

Machine Learning · Computer Science 2025-11-12 Chen Wang , Yue-Jiao Gong , Zhiguang Cao , Zeyuan Ma

Multiobjective blackbox optimization deals with problems where the objective and constraint functions are the outputs of a numerical simulation. In this context, no derivatives are available, nor can they be approximated by finite…

Optimization and Control · Mathematics 2025-04-07 Sébastien Le Digabel , Antoine Lesage-Landry , Ludovic Salomon , Christophe Tribes

Hyperparameters of deep neural networks are often optimized by grid search, random search or Bayesian optimization. As an alternative, we propose to use the Covariance Matrix Adaptation Evolution Strategy (CMA-ES), which is known for its…

Neural and Evolutionary Computing · Computer Science 2016-04-26 Ilya Loshchilov , Frank Hutter

In this study, we investigate the problem of min-max continuous optimization in a black-box setting $\min_{x} \max_{y}f(x,y)$. A popular approach updates $x$ and $y$ simultaneously or alternatingly. However, two major limitations have been…

Neural and Evolutionary Computing · Computer Science 2022-04-07 Atsuhiro Miyagi , Kazuto Fukuchi , Jun Sakuma , Youhei Akimoto

We present a novel black box optimization algorithm called Hessian Estimation Evolution Strategy. The algorithm updates the covariance matrix of its sampling distribution by directly estimating the curvature of the objective function. This…

Machine Learning · Computer Science 2020-06-11 Tobias Glasmachers , Oswin Krause

The Increasing Population Covariance Matrix Adaptation Evolution Strategy (IPOP-CMA-ES) algorithm is a reference stochastic optimizer dedicated to blackbox optimization, where no prior knowledge about the underlying problem structure is…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-02 David Redon , Pierre Fortin , Bilel Derbel , Miwako Tsuji , Mitsuhisa Sato

Mixed-integer (MI) quadratic models subject to quadratic constraints, known as All-Quadratic MI Programs, constitute a challenging class of NP-complete optimization problems. The particular scenario of unbounded integers defines a subclass…

Optimization and Control · Mathematics 2025-09-16 Guy Zepko , Ofer M. Shir

Bayesian optimization (BO) is a model-based approach to sequentially optimize expensive black-box functions, such as the validation error of a deep neural network with respect to its hyperparameters. In many real-world scenarios, the…

Machine Learning · Statistics 2019-10-17 Valerio Perrone , Iaroslav Shcherbatyi , Rodolphe Jenatton , Cedric Archambeau , Matthias Seeger

Dynamic Optimization Problems (DOPs) are challenging to address due to their complex nature, i.e., dynamic environment variation. Evolutionary Computation methods are generally advantaged in solving DOPs since they resemble dynamic…

Neural and Evolutionary Computing · Computer Science 2026-02-02 Zijian Gao , Yuanting Zhong , Zeyuan Ma , Yue-Jiao Gong , Hongshu Guo