English
Related papers

Related papers: The CMA Evolution Strategy: A Tutorial

200 papers

In this study, we consider a continuous min--max optimization problem $\min_{x \in \mathbb{X} \max_{y \in \mathbb{Y}}}f(x,y)$ whose objective function is a black-box. We propose a novel approach to minimize the worst-case objective function…

Neural and Evolutionary Computing · Computer Science 2023-03-29 Atsuhiro Miyagi , Yoshiki Miyauchi , Atsuo Maki , Kazuto Fukuchi , Jun Sakuma , Youhei Akimoto

Theoretical analyses of evolution strategies are indispensable for gaining a deep understanding of their inner workings. For constrained problems, rather simple problems are of interest in the current research. This work presents a…

Neural and Evolutionary Computing · Computer Science 2019-08-12 Patrick Spettel , Hans-Georg Beyer

This paper introduces a novel theoretically sound approach for the celebrated CMA-ES algorithm. Assuming the parameters of the multi variate normal distribution for the minimum follow a conjugate prior distribution, we derive their optimal…

Machine Learning · Computer Science 2019-04-03 Eric Benhamou , David Saltiel , Sebastien Verel , Fabien Teytaud

Water distribution system design is a challenging optimisation problem with a high number of search dimensions and constraints. In this way, Evolutionary Algorithms (EAs) have been widely applied to optimise WDS to minimise cost subject…

Neural and Evolutionary Computing · Computer Science 2019-09-12 Mehdi Neshat , Bradley Alexander , Angus Simpson

We propose a novel constraint-handling technique for the covariance matrix adaptation evolution strategy (CMA-ES). The proposed technique is aimed at solving explicitly constrained black-box continuous optimization problems, in which the…

Neural and Evolutionary Computing · Computer Science 2022-05-11 Naoki Sakamoto , Youhei Akimoto

The Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is one of the most successful examples of a derandomized evolution strategy. However, it still relies on randomly sampling offspring, which can be done via a uniform distribution…

Neural and Evolutionary Computing · Computer Science 2024-09-25 Jacob de Nobel , Diederick Vermetten , Thomas H. W. Bäck , Anna V. Kononova

The covariance matrix adaptation evolution strategy (CMA-ES) is one of the most successful methods for solving black-box continuous optimization problems. One practically useful aspect of the CMA-ES is that it can be used without…

Neural and Evolutionary Computing · Computer Science 2023-09-15 Masahiro Nomura , Youhei Akimoto , Isao Ono

Pre-training a diverse set of neural network controllers in simulation has enabled robots to adapt online to damage in robot locomotion tasks. However, finding diverse, high-performing controllers requires expensive network training and…

Robotics · Computer Science 2023-09-19 Bryon Tjanaka , Matthew C. Fontaine , David H. Lee , Aniruddha Kalkar , Stefanos Nikolaidis

The CSA-ES is an Evolution Strategy with Cumulative Step size Adaptation, where the step size is adapted measuring the length of a so-called cumulative path. The cumulative path is a combination of the previous steps realized by the…

Machine Learning · Computer Science 2012-07-02 Alexandre Adrien Chotard , Anne Auger , Nikolaus Hansen

In the post-Moore era, main performance gains of black-box optimizers are increasingly depending on parallelism, especially for large-scale optimization (LSO). Here we propose to parallelize the well-established covariance matrix adaptation…

Neural and Evolutionary Computing · Computer Science 2024-10-14 Qiqi Duan , Chang Shao , Guochen Zhou , Minghan Zhang , Qi Zhao , Yuhui Shi

The CSA-ES is an Evolution Strategy with Cumulative Step size Adaptation, where the step size is adapted measuring the length of a so-called cumulative path. The cumulative path is a combination of the previous steps realized by the…

Machine Learning · Computer Science 2013-02-19 Alexandre Chotard , Anne Auger , Nikolaus Hansen

In several real-world applications in medical and control engineering, there are unsafe solutions whose evaluations involve inherent risk. This optimization setting is known as safe optimization and formulated as a specialized type of…

Neural and Evolutionary Computing · Computer Science 2024-05-20 Kento Uchida , Ryoki Hamano , Masahiro Nomura , Shota Saito , Shinichi Shirakawa

Discrete and mixed-variable optimization problems have appeared in several real-world applications. Most of the research on mixed-variable optimization considers a mixture of integer and continuous variables, and several integer handlings…

Optimization and Control · Mathematics 2024-08-26 Kento Uchida , Ryoki Hamano , Masahiro Nomura , Shota Saito , Shinichi Shirakawa

The performance of deep neural networks, such as Deep Belief Networks formed by Restricted Boltzmann Machines (RBMs), strongly depends on their training, which is the process of adjusting their parameters. This process can be posed as an…

Neural and Evolutionary Computing · Computer Science 2019-07-16 S. Ivvan Valdez , Alfonso Rojas-Domínguez

Fitting the continuum component of a quasar spectrum in UV/optical band is challenging due to contamination of numerous emission lines. Traditional fitting algorithms such as the least-square fitting and the Levenberg-Marquardt algorithm…

Instrumentation and Methods for Astrophysics · Physics 2013-12-31 Jian Wu , Daniel E. Vanden Berk

Evolutionarily stable strategy (ESS) is an important solution concept in game theory which has been applied frequently to biological models. Informally an ESS is a strategy that if followed by the population cannot be taken over by a…

Computer Science and Game Theory · Computer Science 2019-01-18 Sam Ganzfried

In this article we present an automatic method for charge and mass identification of charged nuclear fragments produced in heavy ion collisions at intermediate energies. The algorithm combines a generative model of DeltaE - E relation and a…

Instrumentation and Detectors · Physics 2017-10-04 Katarzyna Schmidt , Oskar Wyszynski

Rather than obtaining a single good solution for a given optimization problem, users often seek alternative design choices, because the best-found solution may perform poorly with respect to additional objectives or constraints that are…

Neural and Evolutionary Computing · Computer Science 2025-08-06 Maria Laura Santoni , Christoph Dürr , Carola Doerr , Mike Preuss , Elena Raponi

The performance of evolutionary algorithms can be heavily undermined when constraints limit the feasible areas of the search space. For instance, while Covariance Matrix Adaptation Evolution Strategy is one of the most efficient algorithms…

Neural and Evolutionary Computing · Computer Science 2018-10-08 A. Maesani , G. Iacca , D. Floreano

Robots that interact with humans must adapt to individual users' preferences to operate effectively in human-centered environments. An intuitive and effective technique to learn non-expert users' preferences is through rankings of robot…

Robotics · Computer Science 2026-03-11 Nathaniel Dennler , Zhonghao Shi , Yiran Tao , Andreea Bobu , Stefanos Nikolaidis , Maja Matarić