English
Related papers

Related papers: Covariance Matrix Adaptation MAP-Annealing

200 papers

Traditional optimization algorithms search for a single global optimum that maximizes (or minimizes) the objective function. Multimodal optimization algorithms search for the highest peaks in the search space that can be more than one.…

Neural and Evolutionary Computing · Computer Science 2020-12-18 Konstantinos Chatzilygeroudis , Antoine Cully , Vassilis Vassiliades , Jean-Baptiste Mouret

In many practical optimization problems, the derivatives of the functions to be optimized are unavailable or unreliable. Such optimization problems are solved using derivative-free optimization techniques. One of the state-of-the-art…

Neural and Evolutionary Computing · Computer Science 2018-05-30 Najeeb Khan

Water distribution system design is a challenging optimisation problem with a high number of search dimensions and constraints. In this way, Evolutionary Algorithms (EAs) have been widely applied to optimise WDS to minimise cost subject…

Neural and Evolutionary Computing · Computer Science 2019-09-12 Mehdi Neshat , Bradley Alexander , Angus Simpson

In this study, we consider a continuous min--max optimization problem $\min_{x \in \mathbb{X} \max_{y \in \mathbb{Y}}}f(x,y)$ whose objective function is a black-box. We propose a novel approach to minimize the worst-case objective function…

Neural and Evolutionary Computing · Computer Science 2023-03-29 Atsuhiro Miyagi , Yoshiki Miyauchi , Atsuo Maki , Kazuto Fukuchi , Jun Sakuma , Youhei Akimoto

A prevalent limitation of optimizing over a single objective is that it can be misguided, becoming trapped in local optimum. This can be rectified by Quality-Diversity (QD) algorithms, where a population of high-quality and diverse…

Machine Learning · Computer Science 2023-04-18 Ryan Wickman , Bibek Poudel , Michael Villarreal , Xiaofei Zhang , Weizi Li

By combining Genetic Programming, MAP-Elites and Covariance Matrix Adaptation Evolution Strategy, we demonstrate very high success rates in Symbolic Regression problems. MAP-Elites is used to improve exploration while preserving diversity…

Neural and Evolutionary Computing · Computer Science 2019-06-11 J. -P. Bruneton , L. Cazenille , A. Douin , V. Reverdy

We present the results of a comprehensive study of optimization algorithms for the calibration of quantum devices. As part of our ongoing efforts to automate bring-up, tune-up, and system identification procedures, we investigate a broad…

Quantum Physics · Physics 2026-04-14 Kevin Pack , Shai Machnes , Frank K. Wilhelm

In Evolutionary Robotics a population of solutions is evolved to optimize robots that solve a given task. However, in traditional Evolutionary Algorithms, the population of solutions tends to converge to local optima when the problem is…

Robotics · Computer Science 2020-08-06 Jørgen Nordmoen , Frank Veenstra , Kai Olav Ellefsen , Kyrre Glette

Quality-Diversity algorithms, such as MAP-Elites, are a branch of Evolutionary Computation generating collections of diverse and high-performing solutions, that have been successfully applied to a variety of domains and particularly in…

Neural and Evolutionary Computing · Computer Science 2023-03-08 Maxence Faldor , Félix Chalumeau , Manon Flageat , Antoine Cully

Quality Diversity (QD) has shown great success in discovering high-performing, diverse policies for robot skill learning. While current benchmarks have led to the development of powerful QD methods, we argue that new paradigms must be…

Robotics · Computer Science 2024-07-26 Sumeet Batra , Bryon Tjanaka , Stefanos Nikolaidis , Gaurav Sukhatme

The covariance matrix adaptation evolution strategy (CMA-ES) is an efficient continuous black-box optimization method. The CMA-ES possesses many attractive features, including invariance properties and a well-tuned default hyperparameter…

Neural and Evolutionary Computing · Computer Science 2023-05-02 Yohei Watanabe , Kento Uchida , Ryoki Hamano , Shota Saito , Masahiro Nomura , Shinichi Shirakawa

Quality-Diversity optimisation (QD) has proven to yield promising results across a broad set of applications. However, QD approaches struggle in the presence of uncertainty in the environment, as it impacts their ability to quantify the…

Neural and Evolutionary Computing · Computer Science 2023-03-28 Manon Flageat , Antoine Cully

Quality Diversity (QD) algorithms have been proposed to search for a large collection of both diverse and high-performing solutions instead of a single set of local optima. While early QD algorithms view the objective and descriptor…

Artificial Intelligence · Computer Science 2023-09-14 Raphael Boige , Guillaume Richard , Jérémie Dona , Thomas Pierrot , Antoine Cully

Evolution-based neural architecture search requires high computational resources, resulting in long search time. In this work, we propose a framework of applying the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) to the neural…

Neural and Evolutionary Computing · Computer Science 2021-07-16 Nilotpal Sinha , Kuan-Wen Chen

When using Quality Diversity (QD) optimization to solve hard exploration or deceptive search problems, we assume that diversity is extrinsically valuable. This means that diversity is important to help us reach an objective, but is not an…

Neural and Evolutionary Computing · Computer Science 2023-05-16 Ryan Boldi , Lee Spector

The covariance matrix adaptation evolution strategy (CMA-ES) is a powerful optimization method for continuous black-box optimization problems. Several noise-handling methods have been proposed to bring out the optimization performance of…

Neural and Evolutionary Computing · Computer Science 2024-05-21 Kento Uchida , Kenta Nishihara , Shinichi Shirakawa

In Quality-Diversity (QD) algorithms, which evolve a behaviourally diverse archive of high-performing solutions, the behaviour space is a difficult design choice that should be tailored to the target application. In QD meta-evolution, one…

Neural and Evolutionary Computing · Computer Science 2024-01-08 David M. Bossens , Danesh Tarapore

This work provides an efficient sampling method for the covariance matrix adaptation evolution strategy (CMA-ES) in large-scale settings. In contract to the Gaussian sampling in CMA-ES, the proposed method generates mutation vectors from a…

Neural and Evolutionary Computing · Computer Science 2022-03-25 Xiaoyu He , Zibin Zheng , Yuren Zhou

Various variants of the well known Covariance Matrix Adaptation Evolution Strategy (CMA-ES) have been proposed recently, which improve the empirical performance of the original algorithm by structural modifications. However, in practice it…

Neural and Evolutionary Computing · Computer Science 2018-08-20 Sander van Rijn , Hao Wang , Matthijs van Leeuwen , Thomas Bäck

Constrained optimization problems are often characterized by multiple constraints that, in the practice, must be satisfied with different tolerance levels. While some constraints are hard and as such must be satisfied with zero-tolerance,…

Neural and Evolutionary Computing · Computer Science 2020-12-21 Stefano Fioravanzo , Giovanni Iacca