English
Related papers

Related papers: Modified CMA-ES Algorithm for Multi-Modal Optimiza…

200 papers

This paper introduces a novel theoretically sound approach for the celebrated CMA-ES algorithm. Assuming the parameters of the multi variate normal distribution for the minimum follow a conjugate prior distribution, we derive their optimal…

Machine Learning · Computer Science 2019-04-03 Eric Benhamou , David Saltiel , Sebastien Verel , Fabien Teytaud

The covariance matrix adaptation evolution strategy (CMA-ES) is a stochastic search algorithm using a multivariate normal distribution for continuous black-box optimization. In addition to strong empirical results, part of the CMA-ES can be…

Neural and Evolutionary Computing · Computer Science 2024-08-12 Ryoki Hamano , Shinichi Shirakawa , Masahiro Nomura

In solving multi-modal, multi-objective optimization problems (MMOPs), the objective is not only to find a good representation of the Pareto-optimal front (PF) in the objective space but also to find all equivalent Pareto-optimal subsets…

Neural and Evolutionary Computing · Computer Science 2022-10-24 Tapabrata Ray , Mohammad Mohiuddin Mamun , Hemant Kumar Singh

Black-box optimization problems often require simultaneously optimizing different types of variables, such as continuous, integer, and categorical variables. Unlike integer variables, categorical variables do not necessarily have a…

Neural and Evolutionary Computing · Computer Science 2025-05-22 Ryoki Hamano , Shota Saito , Masahiro Nomura , Kento Uchida , Shinichi Shirakawa

Experimental robot optimization often requires evaluating each candidate policy for seconds to minutes. The chosen evaluation time influences optimization because of a speed-accuracy tradeoff: shorter evaluations enable faster iteration,…

Neural and Evolutionary Computing · Computer Science 2026-01-15 Russell M. Martin , Steven H. Collins

The performance of evolutionary algorithms can be heavily undermined when constraints limit the feasible areas of the search space. For instance, while Covariance Matrix Adaptation Evolution Strategy is one of the most efficient algorithms…

Neural and Evolutionary Computing · Computer Science 2018-10-08 A. Maesani , G. Iacca , D. Floreano

In several real-world applications in medical and control engineering, there are unsafe solutions whose evaluations involve inherent risk. This optimization setting is known as safe optimization and formulated as a specialized type of…

Neural and Evolutionary Computing · Computer Science 2024-05-20 Kento Uchida , Ryoki Hamano , Masahiro Nomura , Shota Saito , Shinichi Shirakawa

The Increasing Population Covariance Matrix Adaptation Evolution Strategy (IPOP-CMA-ES) algorithm is a reference stochastic optimizer dedicated to blackbox optimization, where no prior knowledge about the underlying problem structure is…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-02 David Redon , Pierre Fortin , Bilel Derbel , Miwako Tsuji , Mitsuhisa Sato

Evolutionary algorithms are particularly effective for optimisation problems with dynamic and stochastic components. We propose multi-objective evolutionary approaches for the knapsack problem with stochastic profits under static and…

Neural and Evolutionary Computing · Computer Science 2024-04-15 Kokila Kasuni Perera , Aneta Neumann

Evolution-based neural architecture search requires high computational resources, resulting in long search time. In this work, we propose a framework of applying the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) to the neural…

Neural and Evolutionary Computing · Computer Science 2021-07-16 Nilotpal Sinha , Kuan-Wen Chen

Dynamic multimodal multiobjective optimization presents the dual challenge of simultaneously tracking multiple equivalent pareto optimal sets and maintaining population diversity in time-varying environments. However, existing dynamic…

Artificial Intelligence · Computer Science 2025-12-23 Li Yan , Bolun Liu , Chao Li , Jing Liang , Kunjie Yu , Caitong Yue , Xuzhao Chai , Boyang Qu

In the context of the 2018 IEEE Congress of Evolutionary Computation, the Matrix Adaptation Evolution Strategy for constrained optimization turned out to be notably successful in the competition on constrained single objective…

Neural and Evolutionary Computing · Computer Science 2024-05-09 Michael Hellwig , Hans-Georg Beyer

Multi-modal learning aims to enhance performance by unifying models from various modalities but often faces the "modality imbalance" problem in real data, leading to a bias towards dominant modalities and neglecting others, thereby limiting…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Yang Yang , Hongpeng Pan , Qing-Yuan Jiang , Yi Xu , Jinghui Tang

Solving constrained multi-objective optimization problems with evolutionary algorithms has attracted considerable attention. Various constrained multi-objective optimization evolutionary algorithms (CMOEAs) have been developed with the use…

Artificial Intelligence · Computer Science 2024-02-21 Fei Ming , Wenyin Gong , Ling Wang , Yaochu Jin

This report presents benchmarking results of the latest version of the Hill-Valley Evolutionary Algorithm (HillVallEA) on the CEC2013 niching benchmark suite. The benchmarking follows restrictions required by the GECCO 2018 competition on…

Neural and Evolutionary Computing · Computer Science 2018-07-12 S. C. Maree , T. Alderliesten , D. Thierens , P. A. N. Bosman

We propose a novel constraint-handling technique for the covariance matrix adaptation evolution strategy (CMA-ES). The proposed technique is aimed at solving explicitly constrained black-box continuous optimization problems, in which the…

Neural and Evolutionary Computing · Computer Science 2022-05-11 Naoki Sakamoto , Youhei Akimoto

Evolutionary multi-objective algorithms have been widely shown to be successful when utilized for a variety of stochastic combinatorial optimization problems. Chance constrained optimization plays an important role in complex real-world…

Neural and Evolutionary Computing · Computer Science 2023-03-06 Kokila Perera , Aneta Neumann , Frank Neumann

Scalability of evolutionary algorithms refers to assessing how their performance changes as problem size increases. In the area of multi-objective optimisation, research on the scalability of multi-objective evolutionary algorithms (MOEAs)…

Neural and Evolutionary Computing · Computer Science 2026-04-21 Menghao Tang , Zimin Liang , Miqing Li

Contextual policy search (CPS) is a class of multi-task reinforcement learning algorithms that is particularly useful for robotic applications. A recent state-of-the-art method is Contextual Covariance Matrix Adaptation Evolution Strategies…

Machine Learning · Computer Science 2019-04-16 Alexander Fabisch

In this article we provide a comprehensive review of the different evolutionary algorithm techniques used to address multimodal optimization problems, classifying them according to the nature of their approach. On the one hand there are…

Neural and Evolutionary Computing · Computer Science 2015-08-24 Noe Casas