English
Related papers

Related papers: Injecting External Solutions Into CMA-ES

200 papers

Hyperparameters of deep neural networks are often optimized by grid search, random search or Bayesian optimization. As an alternative, we propose to use the Covariance Matrix Adaptation Evolution Strategy (CMA-ES), which is known for its…

Neural and Evolutionary Computing · Computer Science 2016-04-26 Ilya Loshchilov , Frank Hutter

Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is a highly effective optimization technique. A primary challenge when applying CMA-ES in high dimensionality is sampling from a multivariate normal distribution with an arbitrary…

Neural and Evolutionary Computing · Computer Science 2026-01-05 Jarosław Arabas , Adam Stelmaszczyk , Eryk Warchulski , Dariusz Jagodziński , Rafał Biedrzycki

Bilinear Matrix Inequalities (BMIs) are fundamental to control system design but are notoriously difficult to solve due to their nonconvexity. This study addresses BMI-based control optimization problems by adapting and integrating advanced…

Systems and Control · Electrical Eng. & Systems 2026-01-14 Syue-Cian Lin , Wei-Yu Chiu , Chien-Feng Wu

The Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is widely accepted as a robust derivative-free continuous optimization algorithm for non-linear and non-convex optimization problems. CMA-ES is well known to be almost…

Neural and Evolutionary Computing · Computer Science 2014-06-12 Ilya Loshchilov , Marc Schoenauer , Michèle Sebag , Nikolaus Hansen

This paper leverages the recently introduced concept of algorithm footprints to investigate the interplay between algorithm configurations and problem characteristics. Performance footprints are calculated for six modular variants of the…

Neural and Evolutionary Computing · Computer Science 2025-07-04 Ana Nikolikj , Mario Andrés Muñoz , Eva Tuba , Tome Eftimov

Evolutionary multi-agent systems (EMASs) are very good at dealing with difficult, multi-dimensional problems, their efficacy was proven theoretically based on analysis of the relevant Markov-Chain based model. Now the research continues on…

Neural and Evolutionary Computing · Computer Science 2022-10-25 Mateusz Godzik , Jacek Dajda , Marek Kisiel-Dorohinicki , Aleksander Byrski , Leszek Rutkowski , Patryk Orzechowski , Joost Wagenaar , Jason H. Moore

This paper addresses the development of a covariance matrix self-adaptation evolution strategy (CMSA-ES) for solving optimization problems with linear constraints. The proposed algorithm is referred to as Linear Constraint CMSA-ES…

Neural and Evolutionary Computing · Computer Science 2018-09-24 Patrick Spettel , Hans-Georg Beyer , Michael Hellwig

Experimental robot optimization often requires evaluating each candidate policy for seconds to minutes. The chosen evaluation time influences optimization because of a speed-accuracy tradeoff: shorter evaluations enable faster iteration,…

Neural and Evolutionary Computing · Computer Science 2026-01-15 Russell M. Martin , Steven H. Collins

Software model checking is a challenging problem, and generating relevant invariants is a key factor in proving the safety properties of a program. Program invariants can be obtained by various approaches, including lightweight procedures…

Software Engineering · Computer Science 2024-10-28 Dirk Beyer , Po-Chun Chien , Nian-Ze Lee

We present our asynchronous implementation of the LM-CMA-ES algorithm, which is a modern evolution strategy for solving complex large-scale continuous optimization problems. Our implementation brings the best results when the number of…

Neural and Evolutionary Computing · Computer Science 2016-11-15 Viktor Arkhipov , Maxim Buzdalov , Anatoly Shalyto

Machine learning is a powerful tool for extracting valuable information and making various predictions from diverse datasets. Traditional machine learning algorithms rely on well-defined input and output variables; however, there are…

Machine Learning · Computer Science 2025-02-05 Anh T. Hoang , Zsolt J. Viharos

The Expectation--Maximization (EM) algorithm is a simple meta-algorithm that has been used for many years as a methodology for statistical inference when there are missing measurements in the observed data or when the data is composed of…

Machine Learning · Statistics 2022-11-15 Hideitsu Hino , Shotaro Akaho , Noboru Murata

We introduce an acceleration for covariance matrix adaptation evolution strategies (CMA-ES) by means of adaptive diagonal decoding (dd-CMA). This diagonal acceleration endows the default CMA-ES with the advantages of separable CMA-ES…

Neural and Evolutionary Computing · Computer Science 2019-05-16 Youhei Akimoto , Nikolaus Hansen

We present the results of a comprehensive study of optimization algorithms for the calibration of quantum devices. As part of our ongoing efforts to automate bring-up, tune-up, and system identification procedures, we investigate a broad…

Quantum Physics · Physics 2026-04-14 Kevin Pack , Shai Machnes , Frank K. Wilhelm

We propose a computationally efficient limited memory Covariance Matrix Adaptation Evolution Strategy for large scale optimization, which we call the LM-CMA-ES. The LM-CMA-ES is a stochastic, derivative-free algorithm for numerical…

Neural and Evolutionary Computing · Computer Science 2014-04-23 Ilya Loshchilov

Evolution strategies (ESs) are zeroth-order stochastic black-box optimization heuristics invariant to monotonic transformations of the objective function. They evolve a multivariate normal distribution, from which candidate solutions are…

Numerical Analysis · Mathematics 2022-02-09 Youhei Akimoto , Anne Auger , Tobias Glasmachers , Daiki Morinaga

This paper proposes RCMAES, a novel variant of the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) for CEC benchmark optimization. RCMAES integrates a dimension-dependent nonlinear population-size reduction strategy with an…

Neural and Evolutionary Computing · Computer Science 2026-05-01 Khoirul Faiq Muzakka , Sören Möller , Martin Finsterbusch

The covariance matrix adaptation evolution strategy (CMA-ES) is one of the most successful methods for solving black-box continuous optimization problems. One practically useful aspect of the CMA-ES is that it can be used without…

Neural and Evolutionary Computing · Computer Science 2023-09-15 Masahiro Nomura , Youhei Akimoto , Isao Ono

The covariance matrix adaptation evolution strategy (CMA-ES) is a stochastic search algorithm using a multivariate normal distribution for continuous black-box optimization. In addition to strong empirical results, part of the CMA-ES can be…

Neural and Evolutionary Computing · Computer Science 2024-08-12 Ryoki Hamano , Shinichi Shirakawa , Masahiro Nomura

Contextual policy search (CPS) is a class of multi-task reinforcement learning algorithms that is particularly useful for robotic applications. A recent state-of-the-art method is Contextual Covariance Matrix Adaptation Evolution Strategies…

Machine Learning · Computer Science 2019-04-16 Alexander Fabisch