English
Related papers

Related papers: MMES: Mixture Model based Evolution Strategy for L…

200 papers

The Covariance Matrix Adaptation Evolution Strategy (CMA-ES) has been the most successful Evolution Strategy at exploiting covariance information; it uses a form of Principle Component Analysis which, under certain conditions, is suggested…

Neural and Evolutionary Computing · Computer Science 2011-12-20 Ofer M. Shir , Jonathan Roslund , Darrell Whitley , Herschel Rabitz

Evolution Strategies (ES) emerged as a scalable alternative to popular Reinforcement Learning (RL) techniques, providing an almost perfect speedup when distributed across hundreds of CPU cores thanks to a reduced communication overhead.…

Machine Learning · Statistics 2018-11-13 Víctor Campos , Xavier Giro-i-Nieto , Jordi Torres

Experimental robot optimization often requires evaluating each candidate policy for seconds to minutes. The chosen evaluation time influences optimization because of a speed-accuracy tradeoff: shorter evaluations enable faster iteration,…

Neural and Evolutionary Computing · Computer Science 2026-01-15 Russell M. Martin , Steven H. Collins

An evolutionary algorithm (EA) is developed as an alternative to the EM algorithm for parameter estimation in model-based clustering. This EA facilitates a different search of the fitness landscape, i.e., the likelihood surface, utilizing…

Computation · Statistics 2020-06-09 Sharon M. McNicholas , Paul D. McNicholas , Daniel A. Ashlock

In the field of evolutionary computation, one of the most challenging topics is algorithm selection. Knowing which heuristics to use for which optimization problem is key to obtaining high-quality solutions. We aim to extend this research…

Neural and Evolutionary Computing · Computer Science 2019-04-17 Diederick Vermetten , Sander van Rijn , Thomas Bäck , Carola Doerr

Evolution strategies (ESs) are zeroth-order stochastic black-box optimization heuristics invariant to monotonic transformations of the objective function. They evolve a multivariate normal distribution, from which candidate solutions are…

Numerical Analysis · Mathematics 2022-02-09 Youhei Akimoto , Anne Auger , Tobias Glasmachers , Daiki Morinaga

We propose a method for evolving solutions that are robust with respect to variations of the environmental conditions (i.e. that can operate effectively in new conditions immediately, without the need to adapt to variations). The obtained…

Neural and Evolutionary Computing · Computer Science 2019-06-19 Paolo Pagliuca , Stefano Nolfi

This study targets the mixed-integer black-box optimization (MI-BBO) problem where continuous and integer variables should be optimized simultaneously. The CMA-ES, our focus in this study, is a population-based stochastic search method that…

Neural and Evolutionary Computing · Computer Science 2023-01-13 Ryoki Hamano , Shota Saito , Masahiro Nomura , Shinichi Shirakawa

Outline of several strategies for using Gaussian processes as surrogate models for the covariance matrix adaptation evolution strategy (CMA-ES).

Neural and Evolutionary Computing · Computer Science 2014-12-01 Lukáš Bajer , Martin Holeňa

Designing evolutionary algorithms capable of uncovering highly evolvable representations is an open challenge; such evolvability is important because it accelerates evolution and enables fast adaptation to changing circumstances. This paper…

Neural and Evolutionary Computing · Computer Science 2019-07-16 Alexander Gajewski , Jeff Clune , Kenneth O. Stanley , Joel Lehman

This paper presents a novel mechanism to adapt surrogate-assisted population-based algorithms. This mechanism is applied to ACM-ES, a recently proposed surrogate-assisted variant of CMA-ES. The resulting algorithm, saACM-ES, adjusts online…

Neural and Evolutionary Computing · Computer Science 2012-04-12 Ilya Loshchilov , Marc Schoenauer , Michèle Sebag

We design a class of variable metric evolution strategies well suited for high-dimensional problems. We target problems with many variables, not (necessarily) with many objectives. The construction combines two independent developments:…

Neural and Evolutionary Computing · Computer Science 2024-12-23 Tobias Glasmachers

Three state-of-the-art adaptive population control strategies (PCS) are theoretically and empirically investigated for a multi-recombinative, cumulative step-size adaptation Evolution Strategy $(\mu/\mu_I, \lambda)$-CSA-ES. First, scaling…

Neural and Evolutionary Computing · Computer Science 2024-10-02 Amir Omeradzic , Hans-Georg Beyer

The performance of evolutionary algorithms can be heavily undermined when constraints limit the feasible areas of the search space. For instance, while Covariance Matrix Adaptation Evolution Strategy is one of the most efficient algorithms…

Neural and Evolutionary Computing · Computer Science 2018-10-08 A. Maesani , G. Iacca , D. Floreano

A new model for evolving Evolutionary Algorithms (EAs) is proposed in this paper. The model is based on the Multi Expression Programming (MEP) technique. Each MEP chromosome encodes an evolutionary pattern that is repeatedly used for…

Neural and Evolutionary Computing · Computer Science 2021-10-13 Mihai Oltean

Deep learning-based multivariate and multistep-ahead traffic forecasting models are typically trained with the mean squared error (MSE) or mean absolute error (MAE) as the loss function in a sequence-to-sequence setting, simply assuming…

Machine Learning · Computer Science 2026-01-28 Seongjin Choi , Nicolas Saunier , Vincent Zhihao Zheng , Martin Trepanier , Lijun Sun

Many state-of-the-art automated machine learning (AutoML) systems use greedy ensemble selection (GES) by Caruana et al. (2004) to ensemble models found during model selection post hoc. Thereby, boosting predictive performance and likely…

Machine Learning · Computer Science 2023-07-04 Lennart Purucker , Joeran Beel

In the context of the 2018 IEEE Congress of Evolutionary Computation, the Matrix Adaptation Evolution Strategy for constrained optimization turned out to be notably successful in the competition on constrained single objective…

Neural and Evolutionary Computing · Computer Science 2024-05-09 Michael Hellwig , Hans-Georg Beyer

This paper proposes a way to combine the Mesh Adaptive Direct Search (MADS) algorithm with the Cross-Entropy (CE) method for non smooth constrained optimization. The CE method is used as a Search step by the MADS algorithm. The result of…

Optimization and Control · Mathematics 2023-08-15 Charles Audet , Romain Couderc , Jean Bigeon

Penalized likelihood and quasi-likelihood methods dominate inference in high-dimensional linear mixed-effects models. Sampling-based Bayesian inference is less explored due to the computational bottlenecks introduced by the random effects…

Methodology · Statistics 2025-07-24 Sreya Sarkar , Kshitij Khare , Sanvesh Srivastava