English
Related papers

Related papers: Improving CMA-ES Convergence Speed, Efficiency, an…

200 papers

This study modifies the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) algorithm for multi-modal optimization problems. The enhancements focus on addressing the challenges of multiple global minima, improving the algorithm's…

Neural and Evolutionary Computing · Computer Science 2024-07-02 Wathsala Karunarathne , Indu Bala , Dikshit Chauhan , Matthew Roughan , Lewis Mitchell

Various variants of the well known Covariance Matrix Adaptation Evolution Strategy (CMA-ES) have been proposed recently, which improve the empirical performance of the original algorithm by structural modifications. However, in practice it…

Neural and Evolutionary Computing · Computer Science 2018-08-20 Sander van Rijn , Hao Wang , Matthijs van Leeuwen , Thomas Bäck

This paper proposes RCMAES, a novel variant of the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) for CEC benchmark optimization. RCMAES integrates a dimension-dependent nonlinear population-size reduction strategy with an…

Neural and Evolutionary Computing · Computer Science 2026-05-01 Khoirul Faiq Muzakka , Sören Möller , Martin Finsterbusch

Robots that interact with humans must adapt to individual users' preferences to operate effectively in human-centered environments. An intuitive and effective technique to learn non-expert users' preferences is through rankings of robot…

Robotics · Computer Science 2026-03-11 Nathaniel Dennler , Zhonghao Shi , Yiran Tao , Andreea Bobu , Stefanos Nikolaidis , Maja Matarić

Evolutionary optimization algorithms often face defects and limitations that complicate the evolution processes or even prevent them from reaching the global optimum. A notable constraint pertains to the considerable quantity of function…

Neural and Evolutionary Computing · Computer Science 2025-05-23 Farshid Farhadi Khouzani , Abdolreza Mirzaei , Paul La Plante , Laxmi Gewali

In the recent past, several sampling-based algorithms have been proposed to compute trajectories that are collision-free and dynamically-feasible. However, the outputs of such algorithms are notoriously jagged. In this paper, by focusing on…

Robotics · Computer Science 2015-10-28 Zhijie Zhu , Edward Schmerling , Marco Pavone

The multi-reference alignment (MRA) problem entails estimating an image from multiple noisy and rotated copies of itself. If the noise level is low, one can reconstruct the image by estimating the missing rotations, aligning the images, and…

Signal Processing · Electrical Eng. & Systems 2022-06-17 Noam Janco , Tamir Bendory

When faced with a specific optimization problem, choosing which algorithm to use is always a tough task. Not only is there a vast variety of algorithms to select from, but these algorithms often are controlled by many hyperparameters, which…

Neural and Evolutionary Computing · Computer Science 2020-01-07 Diederick Vermetten , Hao Wang , Carola Doerr , Thomas Bäck

Bilinear Matrix Inequalities (BMIs) are fundamental to control system design but are notoriously difficult to solve due to their nonconvexity. This study addresses BMI-based control optimization problems by adapting and integrating advanced…

Systems and Control · Electrical Eng. & Systems 2026-01-14 Syue-Cian Lin , Wei-Yu Chiu , Chien-Feng Wu

This paper introduces a novel theoretically sound approach for the celebrated CMA-ES algorithm. Assuming the parameters of the multi variate normal distribution for the minimum follow a conjugate prior distribution, we derive their optimal…

Machine Learning · Computer Science 2019-04-03 Eric Benhamou , David Saltiel , Sebastien Verel , Fabien Teytaud

Automated algorithm selection promises to support the user in the decisive task of selecting a most suitable algorithm for a given problem. A common component of these machine-trained techniques are regression models which predict the…

Neural and Evolutionary Computing · Computer Science 2020-06-18 Anja Jankovic , Carola Doerr

In this paper, we propose an efficient approximated rank one update for covariance matrix adaptation evolution strategy (CMA-ES). It makes use of two evolution paths as simple as that of CMA-ES, while avoiding the computational matrix…

Neural and Evolutionary Computing · Computer Science 2017-10-24 Zhenhua Li , Qingfu Zhang

This tutorial introduces the CMA Evolution Strategy (ES), where CMA stands for Covariance Matrix Adaptation. The CMA-ES is a stochastic, or randomized, method for real-parameter (continuous domain) optimization of non-linear, non-convex…

Machine Learning · Computer Science 2023-03-13 Nikolaus Hansen

This paper presents a novel mechanism to adapt surrogate-assisted population-based algorithms. This mechanism is applied to ACM-ES, a recently proposed surrogate-assisted variant of CMA-ES. The resulting algorithm, saACM-ES, adjusts online…

Neural and Evolutionary Computing · Computer Science 2012-04-12 Ilya Loshchilov , Marc Schoenauer , Michèle Sebag

Randomized experiments are the gold standard for evaluating the effects of changes to real-world systems. Data in these tests may be difficult to collect and outcomes may have high variance, resulting in potentially large measurement error.…

Machine Learning · Statistics 2018-06-27 Benjamin Letham , Brian Karrer , Guilherme Ottoni , Eytan Bakshy

Black-box optimization is a very active area of research, with many new algorithms being developed every year. This variety is needed, on the one hand, since different algorithms are most suitable for different types of optimization…

Neural and Evolutionary Computing · Computer Science 2021-02-11 Anja Jankovic , Tome Eftimov , Carola Doerr

Deep diffusion models have revolutionized image generation by producing high-quality outputs. However, achieving specific objectives with these models often requires costly adaptations such as fine-tuning, which can be resource-intensive…

Neural and Evolutionary Computing · Computer Science 2026-04-13 Domício Pereira Neto , João Correia , Penousal Machado

Recently it was shown by Nesterov (2011) that techniques form convex optimization can be used to successfully accelerate simple derivative-free randomized optimization methods. The appeal of those schemes lies in their low complexity, which…

Optimization and Control · Mathematics 2014-06-13 Sebastian U. Stich

Robotic automation is a key technology that increases the efficiency and flexibility of manufacturing processes. However, one of the challenges in deploying robots in novel environments is finding the optimal base pose for the robot, which…

Robotics · Computer Science 2026-03-10 Matthias Mayer , Matthias Althoff

The Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is one of the most successful examples of a derandomized evolution strategy. However, it still relies on randomly sampling offspring, which can be done via a uniform distribution…

Neural and Evolutionary Computing · Computer Science 2024-09-25 Jacob de Nobel , Diederick Vermetten , Thomas H. W. Bäck , Anna V. Kononova