English
Related papers

Related papers: Improving population size adapting CMA-ES algorith…

200 papers

Now-a-days, it is important to find out solutions of Multi-Objective Optimization Problems (MOPs). Evolutionary Strategy helps to solve such real world problems efficiently and quickly. But sequential Evolutionary Algorithms (EAs) require…

Neural and Evolutionary Computing · Computer Science 2016-11-15 Md. Asadul Islam , G. M. Mashrur-E-Elahi , M. M. A. Hashem

Evolutionary algorithms are particularly effective for optimisation problems with dynamic and stochastic components. We propose multi-objective evolutionary approaches for the knapsack problem with stochastic profits under static and…

Neural and Evolutionary Computing · Computer Science 2024-04-15 Kokila Kasuni Perera , Aneta Neumann

Evolution Strategies (ES) emerged as a scalable alternative to popular Reinforcement Learning (RL) techniques, providing an almost perfect speedup when distributed across hundreds of CPU cores thanks to a reduced communication overhead.…

Machine Learning · Statistics 2018-11-13 Víctor Campos , Xavier Giro-i-Nieto , Jordi Torres

In an evolutionary algorithm, the population has a very important role as its size has direct implications regarding solution quality, speed, and reliability. Theoretical studies have been done in the past to investigate the role of…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Fernando G. Lobo , Claudio F. Lima

A key challenge to make effective use of evolutionary algorithms is to choose appropriate settings for their parameters. However, the appropriate parameter setting generally depends on the structure of the optimisation problem, which is…

Neural and Evolutionary Computing · Computer Science 2020-04-02 Brendan Case , Per Kristian Lehre

We propose a computationally efficient limited memory Covariance Matrix Adaptation Evolution Strategy for large scale optimization, which we call the LM-CMA-ES. The LM-CMA-ES is a stochastic, derivative-free algorithm for numerical…

Neural and Evolutionary Computing · Computer Science 2014-04-23 Ilya Loshchilov

To guide the design of better iterative optimisation heuristics, it is imperative to understand how inherent structural biases within algorithm components affect the performance on a wide variety of search landscapes. This study explores…

Neural and Evolutionary Computing · Computer Science 2024-04-29 Niki van Stein , Sarah L. Thomson , Anna V. Kononova

We propose Multi-Strategy Coevolving Aging Particles (MS-CAP), a novel population-based algorithm for black-box optimization. In a memetic fashion, MS-CAP combines two components with complementary algorithm logics. In the first stage, each…

Neural and Evolutionary Computing · Computer Science 2018-10-12 Giovanni Iacca , Fabio Caraffini , Ferrante Neri

Differential evolution (DE) algorithm with a small population size is called Micro-DE (MDE). A small population size decreases the computational complexity but also reduces the exploration ability of DE by limiting the population diversity.…

Neural and Evolutionary Computing · Computer Science 2017-09-22 Hojjat Salehinejad , Shahryar Rahnamayan , Hamid R. Tizhoosh

Estimation-of-distribution algorithms (EDAs) are optimization algorithms that learn a distribution on the search space from which good solutions can be sampled easily. A key parameter of most EDAs is the sample size (population size). If…

Neural and Evolutionary Computing · Computer Science 2023-11-06 Weijie Zheng , Benjamin Doerr

We propose PESA, a novel approach combining Particle Swarm Optimisation (PSO), Evolution Strategy (ES), and Simulated Annealing (SA) in a hybrid Algorithm, inspired from reinforcement learning. PESA hybridizes the three algorithms by…

Neural and Evolutionary Computing · Computer Science 2020-09-21 Majdi I. Radaideh , Koroush Shirvan

This report considers how to inject external candidate solutions into the CMA-ES algorithm. The injected solutions might stem from a gradient or a Newton step, a surrogate model optimizer or any other oracle or search mechanism. They can…

Machine Learning · Computer Science 2011-10-20 Nikolaus Hansen

The differential evolution (DE) algorithm suffers from high computational time due to slow nature of evaluation. In contrast, micro-DE (MDE) algorithms employ a very small population size, which can converge faster to a reasonable solution.…

Neural and Evolutionary Computing · Computer Science 2016-09-27 Hojjat Salehinejad , Shahryar Rahnamayan , Hamid R. Tizhoosh

Most real-world optimization problems often come with multiple global optima or local optima. Therefore, increasing niching metaheuristic algorithms, which devote to finding multiple optima in a single run, are developed to solve these…

Neural and Evolutionary Computing · Computer Science 2019-07-08 Bing Zeng , Xinyu Li , Liang Gao , Yuyan Zhang , Haozhen Dong

Recent LLM-guided evolutionary search methods have shown that iterative program mutation can discover strong algorithms, but they typically optimize each task independently, even when related tasks share reusable structure. We introduce…

Machine Learning · Computer Science 2026-05-22 Halil Alperen Gozeten , Xuechen Zhang , Emrullah Ildiz , Ege Onur Taga , Tara Javidi , Samet Oymak

This paper explores an idealized dynamic population sizing strategy for solving additive decomposable problems of uniform scale. The method is designed on top of the foundations of existing population sizing theory for this class of…

Neural and Evolutionary Computing · Computer Science 2011-04-15 Fernando G. Lobo

The stochastic multi-armed bandit problem is a well-known model for studying the exploration-exploitation trade-off. It has significant possible applications in adaptive clinical trials, which allow for dynamic changes in the treatment…

Machine Learning · Computer Science 2019-06-11 Hossein Aboutalebi , Doina Precup , Tibor Schuster

We determined scaling laws for the numerical effort to find the optimal configurations of a simple model potential energy surface (PES) with a perfect funnel structure that reflects key characteristics of the protein interactions.…

Biological Physics · Physics 2009-10-31 K. Hamacher , W. Wenzel

Multimodal optimization requires finding many optima rather than merely keeping a diverse population. Yet most niching-based evolutionary algorithms rely on distances or density estimators without explicitly recovering the underlying…

Neural and Evolutionary Computing · Computer Science 2026-05-19 Meng Xiang , Pei Yan

Understanding when evolutionary algorithms are efficient or not, and how they efficiently solve problems, is one of the central research tasks in evolutionary computation. In this work, we make progress in understanding the interplay…

Neural and Evolutionary Computing · Computer Science 2019-04-16 Denis Antipov , Benjamin Doerr , Quentin Yang