English
Related papers

Related papers: (1+1)-CMA-ES with Margin for Discrete and Mixed-In…

200 papers

When faced with a specific optimization problem, choosing which algorithm to use is always a tough task. Not only is there a vast variety of algorithms to select from, but these algorithms often are controlled by many hyperparameters, which…

Neural and Evolutionary Computing · Computer Science 2020-01-07 Diederick Vermetten , Hao Wang , Carola Doerr , Thomas Bäck

The Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is widely accepted as a robust derivative-free continuous optimization algorithm for non-linear and non-convex optimization problems. CMA-ES is well known to be almost…

Neural and Evolutionary Computing · Computer Science 2014-06-12 Ilya Loshchilov , Marc Schoenauer , Michèle Sebag , Nikolaus Hansen

We focus on the challenge of finding a diverse collection of quality solutions on complex continuous domains. While quality diver-sity (QD) algorithms like Novelty Search with Local Competition (NSLC) and MAP-Elites are designed to generate…

Machine Learning · Computer Science 2020-05-08 Matthew C. Fontaine , Julian Togelius , Stefanos Nikolaidis , Amy K. Hoover

Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is a highly effective optimization technique. A primary challenge when applying CMA-ES in high dimensionality is sampling from a multivariate normal distribution with an arbitrary…

Neural and Evolutionary Computing · Computer Science 2026-01-05 Jarosław Arabas , Adam Stelmaszczyk , Eryk Warchulski , Dariusz Jagodziński , Rafał Biedrzycki

The covariance matrix adaptation evolution strategy (CMA-ES) is a stochastic search algorithm using a multivariate normal distribution for continuous black-box optimization. In addition to strong empirical results, part of the CMA-ES can be…

Neural and Evolutionary Computing · Computer Science 2024-08-12 Ryoki Hamano , Shinichi Shirakawa , Masahiro Nomura

This paper addresses the development of a covariance matrix self-adaptation evolution strategy (CMSA-ES) for solving optimization problems with linear constraints. The proposed algorithm is referred to as Linear Constraint CMSA-ES…

Neural and Evolutionary Computing · Computer Science 2018-09-24 Patrick Spettel , Hans-Georg Beyer , Michael Hellwig

In this paper, we propose an efficient approximated rank one update for covariance matrix adaptation evolution strategy (CMA-ES). It makes use of two evolution paths as simple as that of CMA-ES, while avoiding the computational matrix…

Neural and Evolutionary Computing · Computer Science 2017-10-24 Zhenhua Li , Qingfu Zhang

We propose a novel constraint-handling technique for the covariance matrix adaptation evolution strategy (CMA-ES). The proposed technique is aimed at solving explicitly constrained black-box continuous optimization problems, in which the…

Neural and Evolutionary Computing · Computer Science 2022-05-11 Naoki Sakamoto , Youhei Akimoto

This tutorial introduces the CMA Evolution Strategy (ES), where CMA stands for Covariance Matrix Adaptation. The CMA-ES is a stochastic, or randomized, method for real-parameter (continuous domain) optimization of non-linear, non-convex…

Machine Learning · Computer Science 2023-03-13 Nikolaus Hansen

This study modifies the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) algorithm for multi-modal optimization problems. The enhancements focus on addressing the challenges of multiple global minima, improving the algorithm's…

Neural and Evolutionary Computing · Computer Science 2024-07-02 Wathsala Karunarathne , Indu Bala , Dikshit Chauhan , Matthew Roughan , Lewis Mitchell

This paper proposes RCMAES, a novel variant of the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) for CEC benchmark optimization. RCMAES integrates a dimension-dependent nonlinear population-size reduction strategy with an…

Neural and Evolutionary Computing · Computer Science 2026-05-01 Khoirul Faiq Muzakka , Sören Möller , Martin Finsterbusch

In the post-Moore era, main performance gains of black-box optimizers are increasingly depending on parallelism, especially for large-scale optimization (LSO). Here we propose to parallelize the well-established covariance matrix adaptation…

Neural and Evolutionary Computing · Computer Science 2024-10-14 Qiqi Duan , Chang Shao , Guochen Zhou , Minghan Zhang , Qi Zhao , Yuhui Shi

Black-box optimization problems often require simultaneously optimizing different types of variables, such as continuous, integer, and categorical variables. Unlike integer variables, categorical variables do not necessarily have a…

Neural and Evolutionary Computing · Computer Science 2025-05-22 Ryoki Hamano , Shota Saito , Masahiro Nomura , Kento Uchida , Shinichi Shirakawa

In this study, we consider a continuous min--max optimization problem $\min_{x \in \mathbb{X} \max_{y \in \mathbb{Y}}}f(x,y)$ whose objective function is a black-box. We propose a novel approach to minimize the worst-case objective function…

Neural and Evolutionary Computing · Computer Science 2023-03-29 Atsuhiro Miyagi , Yoshiki Miyauchi , Atsuo Maki , Kazuto Fukuchi , Jun Sakuma , Youhei Akimoto

This paper introduces a novel theoretically sound approach for the celebrated CMA-ES algorithm. Assuming the parameters of the multi variate normal distribution for the minimum follow a conjugate prior distribution, we derive their optimal…

Machine Learning · Computer Science 2019-04-03 Eric Benhamou , David Saltiel , Sebastien Verel , Fabien Teytaud

We propose a computationally efficient limited memory Covariance Matrix Adaptation Evolution Strategy for large scale optimization, which we call the LM-CMA-ES. The LM-CMA-ES is a stochastic, derivative-free algorithm for numerical…

Neural and Evolutionary Computing · Computer Science 2014-04-23 Ilya Loshchilov

Over the past decades, more and more methods gain a giant development due to the development of technology. Evolutionary Algorithms are widely used as a heuristic method. However, the budget of computation increases exponentially when the…

Neural and Evolutionary Computing · Computer Science 2021-05-12 Yangjie Mei , Hao Wang

In this paper we investigate the convergence properties of a variant of the Covariance Matrix Adaptation Evolution Strategy (CMA-ES). Our study is based on the recent theoretical foundation that the pure rank-mu update CMA-ES performs the…

Artificial Intelligence · Computer Science 2017-06-20 Youhei Akimoto

Evolution strategies (ESs) are zeroth-order stochastic black-box optimization heuristics invariant to monotonic transformations of the objective function. They evolve a multivariate normal distribution, from which candidate solutions are…

Numerical Analysis · Mathematics 2022-02-09 Youhei Akimoto , Anne Auger , Tobias Glasmachers , Daiki Morinaga

The covariance matrix adaptive evolution strategy (CMA-ES) has been widely used in the field of 2D/3D registration in recent years. This optimization method exhibits exceptional robustness and usability for complex surgical scenarios.…

Image and Video Processing · Electrical Eng. & Systems 2024-05-17 Zhirun Zhang , Minheng Chen