English
Related papers

Related papers: Natural Evolution Strategy for Mixed-Integer Black…

200 papers

One of the most challenging problems in evolutionary computation is to select from its family of diverse solvers one that performs well on a given problem. This algorithm selection problem is complicated by the fact that different phases of…

Neural and Evolutionary Computing · Computer Science 2020-06-12 Diederick Vermetten , Hao Wang , Carola Doerr , Thomas Bäck

The covariance matrix adaptation evolution strategy (CMA-ES) is a powerful optimization method for continuous black-box optimization problems. Several noise-handling methods have been proposed to bring out the optimization performance of…

Neural and Evolutionary Computing · Computer Science 2024-05-21 Kento Uchida , Kenta Nishihara , Shinichi Shirakawa

One of the most challenging types of ill-posedness in global optimization is the presence of insensitivity regions in design parameter space, so the identification of their shape will be crucial, if ill-posedness is irrecoverable. Such…

Neural and Evolutionary Computing · Computer Science 2019-05-20 Jakub Sawicki , Maciej Smołka , Marcin Łoś , Robert Schaefer

This research introduces a novel approach, MBO-NB, that leverages Migrating Birds Optimization (MBO) coupled with Naive Bayes as an internal classifier to address feature selection challenges in text classification having large number of…

Neural and Evolutionary Computing · Computer Science 2024-01-22 Cem Kaya , Zeynep Hilal Kilimci , Mitat Uysal , Murat Kaya

The zeroth-order optimization has been widely used in machine learning applications. However, the theoretical study of the zeroth-order optimization focus on the algorithms which approximate (first-order) gradients using (zeroth-order)…

Machine Learning · Computer Science 2023-08-02 Haishan Ye

We explore the use of Evolution Strategies (ES), a class of black box optimization algorithms, as an alternative to popular MDP-based RL techniques such as Q-learning and Policy Gradients. Experiments on MuJoCo and Atari show that ES is a…

Machine Learning · Statistics 2017-09-11 Tim Salimans , Jonathan Ho , Xi Chen , Szymon Sidor , Ilya Sutskever

With the development of fast and massively parallel evaluations in many domains, Quality-Diversity (QD) algorithms, that already proved promising in a large range of applications, have seen their potential multiplied. However, we have yet…

Neural and Evolutionary Computing · Computer Science 2024-04-15 Manon Flageat , Bryan Lim , Antoine Cully

We propose a method for evolving solutions that are robust with respect to variations of the environmental conditions (i.e. that can operate effectively in new conditions immediately, without the need to adapt to variations). The obtained…

Neural and Evolutionary Computing · Computer Science 2019-06-19 Paolo Pagliuca , Stefano Nolfi

This paper introduces a multi-level (m-lev) mechanism into Evolution Strategies (ESs) in order to address a class of global optimization problems that could benefit from fine discretization of their decision variables. Such problems arise…

Neural and Evolutionary Computing · Computer Science 2020-10-06 Ofer M. Shir , Xi Xing , Herschel Rabitz

Recent research in Cooperative Coevolution~(CC) have achieved promising progress in solving large-scale global optimization problems. However, existing CC paradigms have a primary limitation in that they require deep expertise for selecting…

Machine Learning · Computer Science 2025-04-25 Hongshu Guo , Wenjie Qiu , Zeyuan Ma , Xinglin Zhang , Jun Zhang , Yue-Jiao Gong

The covariance matrix adaptation evolution strategy (CMA-ES) is one of the most successful methods for solving continuous black-box optimization problems. A practically useful aspect of the CMA-ES is that it can be used without…

Neural and Evolutionary Computing · Computer Science 2024-09-30 Masahiro Nomura , Youhei Akimoto , Isao Ono

In this paper, we approach the problem of optimizing blackbox functions over large hybrid search spaces consisting of both combinatorial and continuous parameters. We demonstrate that previous evolutionary algorithms which rely on…

When solving optimization problems with black-box approaches, the algorithms gather valuable information about the problem instance during the optimization process. This information is used to adjust the distributions from which new…

Neural and Evolutionary Computing · Computer Science 2023-01-13 Dominik Schröder , Diederick Vermetten , Hao Wang , Carola Doerr , Thomas Bäck

Modern machine learning uses more and more advanced optimization techniques to find optimal hyper parameters. Whenever the objective function is non-convex, non continuous and with potentially multiple local minima, standard gradient…

Machine Learning · Computer Science 2019-02-13 Eric Benhamou , Jamal Atif , Rida Laraki

Urban land-use allocation represents a complex multi-objective optimization problem critical for sustainable urban development policy. This paper presents novel computational intelligence approaches for optimizing land-use allocation in…

Artificial Intelligence · Computer Science 2025-08-26 Sabab Aosaf , Muhammad Ali Nayeem , Afsana Haque , M Sohel Rahman

The Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is widely accepted as a robust derivative-free continuous optimization algorithm for non-linear and non-convex optimization problems. CMA-ES is well known to be almost…

Neural and Evolutionary Computing · Computer Science 2014-06-12 Ilya Loshchilov , Marc Schoenauer , Michèle Sebag , Nikolaus Hansen

We focus on the challenge of finding a diverse collection of quality solutions on complex continuous domains. While quality diver-sity (QD) algorithms like Novelty Search with Local Competition (NSLC) and MAP-Elites are designed to generate…

Machine Learning · Computer Science 2020-05-08 Matthew C. Fontaine , Julian Togelius , Stefanos Nikolaidis , Amy K. Hoover

A notion of quantum natural evolution strategies is introduced, which provides a geometric synthesis of a number of known quantum/classical algorithms for performing classical black-box optimization. Recent work of Gomes et al. [2019] on…

Quantum Physics · Physics 2020-11-23 Tianchen Zhao , Giuseppe Carleo , James Stokes , Shravan Veerapaneni

The covariance matrix adaptation evolution strategy (CMA-ES) is one of the most successful methods for solving black-box continuous optimization problems. One practically useful aspect of the CMA-ES is that it can be used without…

Neural and Evolutionary Computing · Computer Science 2023-09-15 Masahiro Nomura , Youhei Akimoto , Isao Ono

Restart strategy helps the covariance matrix adaptation evolution strategy (CMA-ES) to increase the probability of finding the global optimum in optimization, while a single run CMA-ES is easy to be trapped in local optima. In this paper,…

Neural and Evolutionary Computing · Computer Science 2020-04-28 Yang Lou , Shiu Yin Yuen , Guanrong Chen , Xin Zhang