English
Related papers

Related papers: A Covariance Matrix Self-Adaptation Evolution Stra…

200 papers

In this study, we consider simulation-based worst-case optimization problems with continuous design variables and a finite scenario set. To reduce the number of simulations required and increase the number of restarts for better local…

Neural and Evolutionary Computing · Computer Science 2022-12-01 Atsuhiro Miyagi , Kazuto Fukuchi , Jun Sakuma , Youhei Akimoto

Single-objective optimization algorithms search for the single highest-quality solution with respect to an objective. Quality diversity (QD) optimization algorithms, such as Covariance Matrix Adaptation MAP-Elites (CMA-ME), search for a…

Machine Learning · Computer Science 2023-06-07 Matthew C. Fontaine , Stefanos Nikolaidis

Evolutionary strategies have recently been shown to achieve competing levels of performance for complex optimization problems in reinforcement learning. In such problems, one often needs to optimize an objective function subject to a set of…

Neural and Evolutionary Computing · Computer Science 2022-02-23 Youssef Diouane , Aurelien Lucchi , Vihang Patil

The performance of deep neural networks, such as Deep Belief Networks formed by Restricted Boltzmann Machines (RBMs), strongly depends on their training, which is the process of adjusting their parameters. This process can be posed as an…

Neural and Evolutionary Computing · Computer Science 2019-07-16 S. Ivvan Valdez , Alfonso Rojas-Domínguez

In several real-world applications in medical and control engineering, there are unsafe solutions whose evaluations involve inherent risk. This optimization setting is known as safe optimization and formulated as a specialized type of…

Neural and Evolutionary Computing · Computer Science 2024-05-20 Kento Uchida , Ryoki Hamano , Masahiro Nomura , Shota Saito , Shinichi Shirakawa

A key challenge to make effective use of evolutionary algorithms is to choose appropriate settings for their parameters. However, the appropriate parameter setting generally depends on the structure of the optimisation problem, which is…

Neural and Evolutionary Computing · Computer Science 2020-04-02 Brendan Case , Per Kristian Lehre

When faced with a specific optimization problem, choosing which algorithm to use is always a tough task. Not only is there a vast variety of algorithms to select from, but these algorithms often are controlled by many hyperparameters, which…

Neural and Evolutionary Computing · Computer Science 2020-01-07 Diederick Vermetten , Hao Wang , Carola Doerr , Thomas Bäck

This paper introduces a multi-level (m-lev) mechanism into Evolution Strategies (ESs) in order to address a class of global optimization problems that could benefit from fine discretization of their decision variables. Such problems arise…

Neural and Evolutionary Computing · Computer Science 2020-10-06 Ofer M. Shir , Xi Xing , Herschel Rabitz

We present our asynchronous implementation of the LM-CMA-ES algorithm, which is a modern evolution strategy for solving complex large-scale continuous optimization problems. Our implementation brings the best results when the number of…

Neural and Evolutionary Computing · Computer Science 2016-11-15 Viktor Arkhipov , Maxim Buzdalov , Anatoly Shalyto

We describe the decomposition of QSO absorption line ensembles applying an evolutionary forward modelling technique. The modelling is optimized using an evolution strategy (ES) based on a novel concept of completely derandomized…

Astrophysics · Physics 2009-11-10 R. Quast , R. Baade , D. Reimers

Parameter adaptation, that is the capability to automatically adjust an algorithm's hyperparameters depending on the problem being faced, is one of the main trends in evolutionary computation applied to numerical optimization. While several…

Neural and Evolutionary Computing · Computer Science 2022-06-30 Michele Tessari , Giovanni Iacca

Automated algorithm selection promises to support the user in the decisive task of selecting a most suitable algorithm for a given problem. A common component of these machine-trained techniques are regression models which predict the…

Neural and Evolutionary Computing · Computer Science 2020-06-18 Anja Jankovic , Carola Doerr

Self-evolution methods enhance code generation through iterative "generate-verify-refine" cycles, yet existing approaches suffer from low exploration efficiency, failing to discover solutions with superior complexity within limited budgets.…

Computation and Language · Computer Science 2026-02-13 Tu Hu , Ronghao Chen , Shuo Zhang , Jianghao Yin , Mou Xiao Feng , Jingping Liu , Shaolei Zhang , Wenqi Jiang , Yuqi Fang , Sen Hu , Huacan Wang , Yi Xu

Evolution Strategies such as CMA-ES (covariance matrix adaptation evolution strategy) and NES (natural evolution strategy) have been widely used in machine learning applications, where an objective function is optimized without using its…

Optimization and Control · Mathematics 2019-10-28 Haishan Ye , Tong Zhang

This paper introduces a novel theoretically sound approach for the celebrated CMA-ES algorithm. Assuming the parameters of the multi variate normal distribution for the minimum follow a conjugate prior distribution, we derive their optimal…

Machine Learning · Computer Science 2019-04-03 Eric Benhamou , David Saltiel , Sebastien Verel , Fabien Teytaud

The Covariance Matrix Adaptation Evolution Strategy (CMA-ES) has been the most successful Evolution Strategy at exploiting covariance information; it uses a form of Principle Component Analysis which, under certain conditions, is suggested…

Neural and Evolutionary Computing · Computer Science 2011-12-20 Ofer M. Shir , Jonathan Roslund , Darrell Whitley , Herschel Rabitz

Evolutionary algorithms have been frequently applied to constrained continuous optimisation problems. We carry out feature based comparisons of different types of evolutionary algorithms such as evolution strategies, differential evolution…

Artificial Intelligence · Computer Science 2015-09-24 Shayan Poursoltan , Frank Neumann

We propose a method for evolving solutions that are robust with respect to variations of the environmental conditions (i.e. that can operate effectively in new conditions immediately, without the need to adapt to variations). The obtained…

Neural and Evolutionary Computing · Computer Science 2019-06-19 Paolo Pagliuca , Stefano Nolfi

This study presents constructions of the space-time Conservation Element and Solution Element (CESE) methods to accommodate adaptive unstructured quadrilateral meshes. Subsequently, a novel algorithm is devised to effectively manage the…

Fluid Dynamics · Physics 2025-03-10 Lisong Shi , Chaoxiong Zhang , Chih-Yung Wen

This paper introduces the inverse modeling constrained multi-objective evolutionary algorithm based on decomposition (IM-C-MOEA/D) for addressing constrained real-world optimization problems. Our research builds upon the advancements made…

Neural and Evolutionary Computing · Computer Science 2024-10-28 Lucas R. C. Farias , Aluizio F. R. Araújo