English
Related papers

Related papers: Self-Adaptive Surrogate-Assisted Covariance Matrix…

200 papers

The covariance matrix adaptation evolution strategy (CMA-ES) is one of the most successful methods for solving continuous black-box optimization problems. A practically useful aspect of the CMA-ES is that it can be used without…

Neural and Evolutionary Computing · Computer Science 2024-09-30 Masahiro Nomura , Youhei Akimoto , Isao Ono

In this paper we investigate the convergence properties of a variant of the Covariance Matrix Adaptation Evolution Strategy (CMA-ES). Our study is based on the recent theoretical foundation that the pure rank-mu update CMA-ES performs the…

Artificial Intelligence · Computer Science 2017-06-20 Youhei Akimoto

There is now significant historical data available on decision making in organizations, consisting of the decision problem, what decisions were made, and how desirable the outcomes were. Using this data, it is possible to learn a surrogate…

Neural and Evolutionary Computing · Computer Science 2020-04-23 Olivier Francon , Santiago Gonzalez , Babak Hodjat , Elliot Meyerson , Risto Miikkulainen , Xin Qiu , Hormoz Shahrzad

It has been shown that cooperative coevolution (CC) can effectively deal with large scale optimization problems (LSOPs) through a divide-and-conquer strategy. However, its performance is severely restricted by the current…

Neural and Evolutionary Computing · Computer Science 2018-02-28 Zhigang Ren , Bei Pang , Yongsheng Liang , An Chen , Yipeng Zhang

By remarkably reducing real fitness evaluations, surrogate-assisted evolutionary algorithms (SAEAs), especially hierarchical SAEAs, have been shown to be effective in solving computationally expensive optimization problems. The success of…

Neural and Evolutionary Computing · Computer Science 2021-03-02 Xiaodong Ren , Daofu Guo , Zhigang Ren , Yongsheng Liang , An Chen

Surrogate-assisted evolutionary algorithms (SAEAs) hold significant importance in resolving expensive optimization problems~(EOPs). Extensive efforts have been devoted to improving the efficacy of SAEAs through the development of proficient…

Neural and Evolutionary Computing · Computer Science 2023-10-10 Hao Hao , Xiaoqun Zhang , Aimin Zhou

Hyperparameters of deep neural networks are often optimized by grid search, random search or Bayesian optimization. As an alternative, we propose to use the Covariance Matrix Adaptation Evolution Strategy (CMA-ES), which is known for its…

Neural and Evolutionary Computing · Computer Science 2016-04-26 Ilya Loshchilov , Frank Hutter

Surrogate-assisted evolutionary algorithms (SAEAs) have been proposed to solve expensive optimization problems. Although SAEAs use surrogate models that approximate the evaluations of solutions using machine learning techniques, prior…

Neural and Evolutionary Computing · Computer Science 2026-01-21 Yuki Hanawa , Tomohiro Harada , Yukiya Miura

Chemical plant design and optimisation have proven challenging due to the complexity of these real-world systems. The resulting complexity translates into high computational costs for these systems' mathematical formulations and simulation…

Neural and Evolutionary Computing · Computer Science 2022-04-28 Liezl Stander , Matthew Woolway , Terence L. Van Zyl

The covariance matrix adaptive evolution strategy (CMA-ES) has been widely used in the field of 2D/3D registration in recent years. This optimization method exhibits exceptional robustness and usability for complex surgical scenarios.…

Image and Video Processing · Electrical Eng. & Systems 2024-05-17 Zhirun Zhang , Minheng Chen

Advances in Reinforcement Learning (RL) have demonstrated data efficiency and optimal control over large state spaces at the cost of scalable performance. Genetic methods, on the other hand, provide scalability but depict hyperparameter…

Machine Learning · Computer Science 2021-01-19 Karush Suri , Xiao Qi Shi , Konstantinos N. Plataniotis , Yuri A. Lawryshyn

The covariance matrix adaptation evolution strategy (CMA-ES) is a powerful optimization method for continuous black-box optimization problems. Several noise-handling methods have been proposed to bring out the optimization performance of…

Neural and Evolutionary Computing · Computer Science 2024-05-21 Kento Uchida , Kenta Nishihara , Shinichi Shirakawa

Modern machine learning uses more and more advanced optimization techniques to find optimal hyper parameters. Whenever the objective function is non-convex, non continuous and with potentially multiple local minima, standard gradient…

Machine Learning · Computer Science 2019-02-13 Eric Benhamou , Jamal Atif , Rida Laraki

The paper proposes and investigates an approach for surrogate-assisted performance prediction of data-driven knowledge discovery algorithms. The approach is based on the identification of surrogate models for prediction of the target…

Machine Learning · Computer Science 2022-01-25 Anastasia A. Funkner , Aleksey N. Yakovlev , Sergey V. Kovalchuk

In this paper, we propose an efficient approximated rank one update for covariance matrix adaptation evolution strategy (CMA-ES). It makes use of two evolution paths as simple as that of CMA-ES, while avoiding the computational matrix…

Neural and Evolutionary Computing · Computer Science 2017-10-24 Zhenhua Li , Qingfu Zhang

Surrogate-assisted evolutionary algorithms (SAEAs) are a key tool for addressing costly optimization tasks, with their efficiency being heavily dependent on the selection of surrogate models and infill sampling criteria. However, designing…

Neural and Evolutionary Computing · Computer Science 2025-07-08 Lindong Xie , Genghui Li , Zhenkun Wang , Edward Chung , Maoguo Gong

We introduce an acceleration for covariance matrix adaptation evolution strategies (CMA-ES) by means of adaptive diagonal decoding (dd-CMA). This diagonal acceleration endows the default CMA-ES with the advantages of separable CMA-ES…

Neural and Evolutionary Computing · Computer Science 2019-05-16 Youhei Akimoto , Nikolaus Hansen

We propose a new way to self-adjust the mutation rate in population-based evolutionary algorithms in discrete search spaces. Roughly speaking, it consists of creating half the offspring with a mutation rate that is twice the current…

Neural and Evolutionary Computing · Computer Science 2018-05-28 Benjamin Doerr , Christian Gießen , Carsten Witt , Jing Yang

Improving predictive understanding of Earth system variability and change requires data-model integration. Efficient data-model integration for complex models requires surrogate modeling to reduce model evaluation time. However, building a…

Machine Learning · Statistics 2019-01-17 Dan Lu , Daniel Ricciuto

Experimental robot optimization often requires evaluating each candidate policy for seconds to minutes. The chosen evaluation time influences optimization because of a speed-accuracy tradeoff: shorter evaluations enable faster iteration,…

Neural and Evolutionary Computing · Computer Science 2026-01-15 Russell M. Martin , Steven H. Collins