English
Related papers

Related papers: Natural Evolution Strategy for Mixed-Integer Black…

200 papers

This research reports on the recent development of a black-box optimization method based on single-step deep reinforcement learning (DRL), and on its conceptual proximity to evolution strategy (ES) techniques. In the fashion of policy…

Optimization and Control · Mathematics 2021-11-29 Jonathan Viquerat , Régis Duvigneau , Philippe Meliga , Alexander Kuhnle , Elie Hachem

We derive an optimal policy for adaptively restarting a randomized algorithm, based on observed features of the run-so-far, so as to minimize the expected time required for the algorithm to successfully terminate. Given a suitable Bayesian…

Machine Learning · Computer Science 2019-02-25 Matthew Streeter

This paper introduces a novel competitive mechanism into differential evolution (DE), presenting an effective DE variant named competitive DE (CDE). CDE features a simple yet efficient mutation strategy: DE/winner-to-best/1. Essentially,…

Neural and Evolutionary Computing · Computer Science 2024-06-11 Rui Zhong , Yang Cao , Enzhi Zhang , Masaharu Munetomo

Energy systems optimization problems are complex due to strongly non-linear system behavior and multiple competing objectives, e.g. economic gain vs. environmental impact. Moreover, a large number of input variables and different variable…

While evolutionary computation is well suited for automatic discovery in engineering, it can also be used to gain insight into how humans and organizations could perform more effectively. Using a real-world problem of innovation search in…

Neural and Evolutionary Computing · Computer Science 2023-07-04 Erkin Bahceci , Riitta Katila , Risto Miikkulainen

Many optimization problems in science and engineering are highly nonlinear, and thus require sophisticated optimization techniques to solve. Traditional techniques such as gradient-based algorithms are mostly local search methods, and often…

Neural and Evolutionary Computing · Computer Science 2019-03-28 Xin-She Yang , Suash Deb , Sudhanshu K Mishra

A mathematical framework for modelling constrained mixed-variable optimization problems is presented in a blackbox optimization context. The framework introduces a new notation and allows solution strategies. The notation framework allows…

Optimization and Control · Mathematics 2022-04-05 Charles Audet , Edward Hallé-Hannan , Sébastien Le Digabel

This work proposes the integration of two new constraint-handling approaches into the blackbox constrained multiobjective optimization algorithm DMulti-MADS, an extension of the Mesh Adaptive Direct Search (MADS) algorithm for…

Optimization and Control · Mathematics 2022-04-05 Jean Bigeon , Sébastien Le Digabel , Ludovic Salomon

Self-evolution methods enhance code generation through iterative "generate-verify-refine" cycles, yet existing approaches suffer from low exploration efficiency, failing to discover solutions with superior complexity within limited budgets.…

Computation and Language · Computer Science 2026-02-13 Tu Hu , Ronghao Chen , Shuo Zhang , Jianghao Yin , Mou Xiao Feng , Jingping Liu , Shaolei Zhang , Wenqi Jiang , Yuqi Fang , Sen Hu , Huacan Wang , Yi Xu

In this paper, an evolutionary many-objective optimization algorithm based on corner solution search (MaOEA-CS) was proposed. MaOEA-CS implicitly contains two phases: the exploitative search for the most important boundary optimal solutions…

Artificial Intelligence · Computer Science 2018-06-11 Xinye Cai , Haoran Sun , Chunyang Zhu , Zhenyu Li , Qingfu Zhang

Extending a recent suggestion to generate new instances for numerical black-box optimization benchmarking by interpolating pairs of the well-established BBOB functions from the COmparing COntinuous Optimizers (COCO) platform, we propose in…

Machine Learning · Computer Science 2023-06-21 Diederick Vermetten , Furong Ye , Thomas Bäck , Carola Doerr

Evolutionary algorithms (EAs) have emerged as a powerful framework for optimization, especially for black-box optimization. Existing evolutionary algorithms struggle to comprehend and effectively utilize task-specific information for…

Neural and Evolutionary Computing · Computer Science 2024-12-24 Kai Wu , Xiaobin Li , Penghui Liu , Jing Liu

In this paper we propose a technique to reduce the number of function evaluations, which is often the bottleneck of the black-box optimization, in the information geometric optimization (IGO) that is a generic framework of the probability…

Neural and Evolutionary Computing · Computer Science 2018-06-01 Shinichi Shirakawa , Youhei Akimoto , Kazuki Ouchi , Kouzou Ohara

In expensive multi-objective optimization, where the evaluation budget is strictly limited, selecting promising candidate solutions for expensive fitness evaluations is critical for accelerating convergence and improving algorithmic…

Neural and Evolutionary Computing · Computer Science 2025-06-16 Huixiang Zhen , Xiaotong Li , Wenyin Gong , Xiangyun Hu

Despite significant empirical and theoretically supported evidence that non-static parameter choices can be strongly beneficial in evolutionary computation, the question how to best adjust parameter values plays only a marginal role in…

Neural and Evolutionary Computing · Computer Science 2018-03-06 Carola Doerr , Markus Wagner

Evolution strategies (ES) are a family of black-box optimization algorithms able to train deep neural networks roughly as well as Q-learning and policy gradient methods on challenging deep reinforcement learning (RL) problems, but are much…

Artificial Intelligence · Computer Science 2018-10-31 Edoardo Conti , Vashisht Madhavan , Felipe Petroski Such , Joel Lehman , Kenneth O. Stanley , Jeff Clune

Memetic computation (MC) has emerged recently as a new paradigm of efficient algorithms for solving the hardest optimization problems. On the other hand, artificial bees colony (ABC) algorithms demonstrate good performances when solving…

Neural and Evolutionary Computing · Computer Science 2016-11-17 Iztok Fister , Iztok Fister , Janez Brest , Viljem Žumer

Black-box policy optimization is a class of reinforcement learning algorithms that explores and updates the policies at the parameter level. This class of algorithms is widely applied in robotics with movement primitives or…

Machine Learning · Computer Science 2022-03-22 Marius Memmel , Puze Liu , Davide Tateo , Jan Peters

Diversity optimization seeks to discover a set of solutions that elicit diverse features. Prior work has proposed Novelty Search (NS), which, given a current set of solutions, seeks to expand the set by finding points in areas of low…

Machine Learning · Computer Science 2024-05-31 David H. Lee , Anishalakshmi V. Palaparthi , Matthew C. Fontaine , Bryon Tjanaka , Stefanos Nikolaidis

We propose a computationally efficient limited memory Covariance Matrix Adaptation Evolution Strategy for large scale optimization, which we call the LM-CMA-ES. The LM-CMA-ES is a stochastic, derivative-free algorithm for numerical…

Neural and Evolutionary Computing · Computer Science 2014-04-23 Ilya Loshchilov