English
Related papers

Related papers: Adaptive Generation-Based Evolution Control for Ga…

200 papers

The Increasing Population Covariance Matrix Adaptation Evolution Strategy (IPOP-CMA-ES) algorithm is a reference stochastic optimizer dedicated to blackbox optimization, where no prior knowledge about the underlying problem structure is…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-02 David Redon , Pierre Fortin , Bilel Derbel , Miwako Tsuji , Mitsuhisa Sato

Multimodal optimization requires both exploration and exploitation. Exploration identifies promising attraction basins, while exploitation finds the best solutions within these basins. The balance between exploration and exploitation can be…

Neural and Evolutionary Computing · Computer Science 2025-06-03 Chandula Fernando , Kushani De Silva

The Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is one of the most successful examples of a derandomized evolution strategy. However, it still relies on randomly sampling offspring, which can be done via a uniform distribution…

Neural and Evolutionary Computing · Computer Science 2024-09-25 Jacob de Nobel , Diederick Vermetten , Thomas H. W. Bäck , Anna V. Kononova

We propose a novel constraint-handling technique for the covariance matrix adaptation evolution strategy (CMA-ES). The proposed technique is aimed at solving explicitly constrained black-box continuous optimization problems, in which the…

Neural and Evolutionary Computing · Computer Science 2022-05-11 Naoki Sakamoto , Youhei Akimoto

AI-assisted molecular optimization is a very active research field as it is expected to provide the next-generation drugs and molecular materials. An important difficulty is that the properties to be optimized rely on costly evaluations.…

Machine Learning · Computer Science 2025-05-19 Jules Leguy , Thomas Cauchy , Beatrice Duval , Benoit Da Mota

Optimum implementation of non-conventional wells allows us to increase considerably hydrocarbon recovery. By considering the high drilling cost and the potential improvement in well productivity, well placement decision is an important…

Computational Engineering, Finance, and Science · Computer Science 2010-11-25 Zyed Bouzarkouna , Didier Yu Ding , Anne Auger

Building surrogate models is one common approach when we attempt to learn unknown black-box functions. Bayesian optimization provides a framework which allows us to build surrogate models based on sequential samples drawn from the function…

Machine Learning · Computer Science 2021-09-17 Hengrui Luo , James W. Demmel , Younghyun Cho , Xiaoye S. Li , Yang Liu

Evolutionary Strategies (ES) are known to be an effective black-box optimization technique for deep neural networks when the true gradients cannot be computed, such as in Reinforcement Learning. We continue a recent line of research that…

Neural and Evolutionary Computing · Computer Science 2019-10-14 Florian Meier , Asier Mujika , Marcelo Matheus Gauy , Angelika Steger

The covariance matrix adaptive evolution strategy (CMA-ES) has been widely used in the field of 2D/3D registration in recent years. This optimization method exhibits exceptional robustness and usability for complex surgical scenarios.…

Image and Video Processing · Electrical Eng. & Systems 2024-05-17 Zhirun Zhang , Minheng Chen

We propose a computationally efficient limited memory Covariance Matrix Adaptation Evolution Strategy for large scale optimization, which we call the LM-CMA-ES. The LM-CMA-ES is a stochastic, derivative-free algorithm for numerical…

Neural and Evolutionary Computing · Computer Science 2014-04-23 Ilya Loshchilov

Water distribution system design is a challenging optimisation problem with a high number of search dimensions and constraints. In this way, Evolutionary Algorithms (EAs) have been widely applied to optimise WDS to minimise cost subject…

Neural and Evolutionary Computing · Computer Science 2019-09-12 Mehdi Neshat , Bradley Alexander , Angus Simpson

Feature selection is an intractable problem, therefore practical algorithms often trade off the solution accuracy against the computation time. In this paper, we propose a novel multi-stage feature selection framework utilizing multiple…

Machine Learning · Computer Science 2021-11-18 Mohammed Ghaith Altarabichi , Sławomir Nowaczyk , Sepideh Pashami , Peyman Sheikholharam Mashhad

Surrogate-assisted evolutionary algorithms (SAEAs) have been proposed to solve expensive optimization problems. Although SAEAs use surrogate models that approximate the evaluations of solutions using machine learning techniques, prior…

Neural and Evolutionary Computing · Computer Science 2026-01-21 Yuki Hanawa , Tomohiro Harada , Yukiya Miura

We present a multi-objective evolutionary optimization algorithm that uses Gaussian process (GP) regression-based models to select trial solutions in a multi-generation iterative procedure. In each generation, a surrogate model is…

Neural and Evolutionary Computing · Computer Science 2020-05-22 Xiaobiao Huang , Minghao Song , Zhe Zhang

Evolutionary Algorithms (EAs) are often challenging to apply in real-world settings since evolutionary computations involve a large number of evaluations of a typically expensive fitness function. For example, an evaluation could involve…

Neural and Evolutionary Computing · Computer Science 2024-04-08 Mohammed Ghaith Altarabichi , Sławomir Nowaczyk , Sepideh Pashami , Peyman Sheikholharam Mashhadi

In this paper, we introduce the quantum adaptive distribution search (QuADS), a quantum continuous optimization algorithm that integrates Grover adaptive search (GAS) with the covariance matrix adaptation - evolution strategy (CMA-ES), a…

Quantum Physics · Physics 2024-07-08 Kohei Morimoto , Yusuke Takase , Kosuke Mitarai , Keisuke Fujii

Bilevel optimization is a field of significant theoretical and practical interest, yet solving such optimization problems remains challenging. Evolutionary methods have been employed to address these problems in the black-box setting;…

Neural and Evolutionary Computing · Computer Science 2026-04-06 Marc Ong , Youhei Akimoto

Evolution strategies (ESs) are zeroth-order stochastic black-box optimization heuristics invariant to monotonic transformations of the objective function. They evolve a multivariate normal distribution, from which candidate solutions are…

Numerical Analysis · Mathematics 2022-02-09 Youhei Akimoto , Anne Auger , Tobias Glasmachers , Daiki Morinaga

Building a surrogate model of an objective function has shown to be effective to assist evolutionary algorithms (EAs) to solve real-world complex optimisation problems which involve either computationally expensive numerical simulations or…

Neural and Evolutionary Computing · Computer Science 2020-02-11 Xiaoran Ruan , Ke Li , Bilel Derbel , Arnaud Liefooghe

We propose a novel method for gradient-based optimization of black-box simulators using differentiable local surrogate models. In fields such as physics and engineering, many processes are modeled with non-differentiable simulators with…

Machine Learning · Computer Science 2020-09-30 Sergey Shirobokov , Vladislav Belavin , Michael Kagan , Andrey Ustyuzhanin , Atılım Güneş Baydin