English
Related papers

Related papers: CMA-ES with Radial Basis Function Surrogate for Bl…

200 papers

The interest in accelerating black-box optimizers has resulted in several surrogate model-assisted version of the Covariance Matrix Adaptation Evolution Strategy, a state-of-the-art continuous black-box optimizer. The version called…

Neural and Evolutionary Computing · Computer Science 2017-10-02 Jakub Repicky , Lukas Bajer , Zbynek Pitra , Martin Holena

Various variants of the well known Covariance Matrix Adaptation Evolution Strategy (CMA-ES) have been proposed recently, which improve the empirical performance of the original algorithm by structural modifications. However, in practice it…

Neural and Evolutionary Computing · Computer Science 2018-08-20 Sander van Rijn , Hao Wang , Matthijs van Leeuwen , Thomas Bäck

This paper investigates the control of an ML component within the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) devoted to black-box optimization. The known CMA-ES weakness is its sample complexity, the number of evaluations of…

Machine Learning · Computer Science 2013-08-20 Ilya Loshchilov , Marc Schoenauer , Michèle Sebag

This paper presents a novel mechanism to adapt surrogate-assisted population-based algorithms. This mechanism is applied to ACM-ES, a recently proposed surrogate-assisted variant of CMA-ES. The resulting algorithm, saACM-ES, adjusts online…

Neural and Evolutionary Computing · Computer Science 2012-04-12 Ilya Loshchilov , Marc Schoenauer , Michèle Sebag

We introduce a surrogate-based black-box optimization method, termed Polynomial-model-based optimization (PMBO). The algorithm alternates polynomial approximation with Bayesian optimization steps, using Gaussian processes to model the error…

Optimization and Control · Mathematics 2024-03-13 Janina Schreiber , Pau Batlle , Damar Wicaksono , Michael Hecht

The covariance matrix adaptation evolution strategy (CMA-ES) is a powerful optimization method for continuous black-box optimization problems. Several noise-handling methods have been proposed to bring out the optimization performance of…

Neural and Evolutionary Computing · Computer Science 2024-05-21 Kento Uchida , Kenta Nishihara , Shinichi Shirakawa

The Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is a popular method to deal with nonconvex and/or stochastic optimization problems when the gradient information is not available. Being based on the CMA-ES, the recently proposed…

Neural and Evolutionary Computing · Computer Science 2017-05-19 Ilya Loshchilov , Tobias Glasmachers , Hans-Georg Beyer

This paper addresses the development of a covariance matrix self-adaptation evolution strategy (CMSA-ES) for solving optimization problems with linear constraints. The proposed algorithm is referred to as Linear Constraint CMSA-ES…

Neural and Evolutionary Computing · Computer Science 2018-09-24 Patrick Spettel , Hans-Georg Beyer , Michael Hellwig

The Covariance Matrix Adaptation Evolutionary Strategy (CMA-ES) is one of the most advanced algorithms in numerical black-box optimization. For noisy objective functions, several approaches were proposed to mitigate the noise, e.g.,…

Neural and Evolutionary Computing · Computer Science 2025-06-04 Catalin-Viorel Dinu , Yash J. Patel , Xavier Bonet-Monroig , Hao Wang

Over the past decades, more and more methods gain a giant development due to the development of technology. Evolutionary Algorithms are widely used as a heuristic method. However, the budget of computation increases exponentially when the…

Neural and Evolutionary Computing · Computer Science 2021-05-12 Yangjie Mei , Hao Wang

The covariance matrix adaptation evolution strategy (CMA-ES) is an efficient continuous black-box optimization method. The CMA-ES possesses many attractive features, including invariance properties and a well-tuned default hyperparameter…

Neural and Evolutionary Computing · Computer Science 2023-05-02 Yohei Watanabe , Kento Uchida , Ryoki Hamano , Shota Saito , Masahiro Nomura , Shinichi Shirakawa

In many practical optimization problems, the derivatives of the functions to be optimized are unavailable or unreliable. Such optimization problems are solved using derivative-free optimization techniques. One of the state-of-the-art…

Neural and Evolutionary Computing · Computer Science 2018-05-30 Najeeb Khan

The covariance matrix adaptation evolution strategy (CMA-ES) is one of the most successful methods for solving continuous black-box optimization problems. A practically useful aspect of the CMA-ES is that it can be used without…

Neural and Evolutionary Computing · Computer Science 2024-09-30 Masahiro Nomura , Youhei Akimoto , Isao Ono

Black-box optimization problems, which are common in many real-world applications, require optimization through input-output interactions without access to internal workings. This often leads to significant computational resources being…

Neural and Evolutionary Computing · Computer Science 2024-03-25 Hao Hao , Xiaoqun Zhang , Aimin Zhou

In the post-Moore era, main performance gains of black-box optimizers are increasingly depending on parallelism, especially for large-scale optimization (LSO). Here we propose to parallelize the well-established covariance matrix adaptation…

Neural and Evolutionary Computing · Computer Science 2024-10-14 Qiqi Duan , Chang Shao , Guochen Zhou , Minghan Zhang , Qi Zhao , Yuhui Shi

Contextual policy search (CPS) is a class of multi-task reinforcement learning algorithms that is particularly useful for robotic applications. A recent state-of-the-art method is Contextual Covariance Matrix Adaptation Evolution Strategies…

Machine Learning · Computer Science 2019-04-16 Alexander Fabisch

This work provides an efficient sampling method for the covariance matrix adaptation evolution strategy (CMA-ES) in large-scale settings. In contract to the Gaussian sampling in CMA-ES, the proposed method generates mutation vectors from a…

Neural and Evolutionary Computing · Computer Science 2022-03-25 Xiaoyu He , Zibin Zheng , Yuren Zhou

Outline of several strategies for using Gaussian processes as surrogate models for the covariance matrix adaptation evolution strategy (CMA-ES).

Neural and Evolutionary Computing · Computer Science 2014-12-01 Lukáš Bajer , Martin Holeňa

The covariance matrix adaptation evolution strategy (CMA-ES) is a stochastic search algorithm using a multivariate normal distribution for continuous black-box optimization. In addition to strong empirical results, part of the CMA-ES can be…

Neural and Evolutionary Computing · Computer Science 2024-08-12 Ryoki Hamano , Shinichi Shirakawa , Masahiro Nomura

This tutorial introduces the CMA Evolution Strategy (ES), where CMA stands for Covariance Matrix Adaptation. The CMA-ES is a stochastic, or randomized, method for real-parameter (continuous domain) optimization of non-linear, non-convex…

Machine Learning · Computer Science 2023-03-13 Nikolaus Hansen
‹ Prev 1 2 3 10 Next ›