English
Related papers

Related papers: Proven Runtime Guarantees for How the MOEA/D Compu…

200 papers

Multi-objective optimization (MOO) is a prevalent challenge for Deep Learning, however, there exists no scalable MOO solution for truly deep neural networks. Prior work either demand optimizing a new network for every point on the Pareto…

Machine Learning · Computer Science 2021-10-15 Michael Ruchte , Josif Grabocka

As evolutionary algorithms (EAs) are general-purpose optimization algorithms, recent theoretical studies have tried to analyze their performance for solving general problem classes, with the goal of providing a general theoretical…

Neural and Evolutionary Computing · Computer Science 2022-11-29 Chao Qian

Diversity optimization is the class of optimization problems in which we aim to find a diverse set of good solutions. One of the frequently-used approaches to solve such problems is to use evolutionary algorithms that evolve a desired…

Neural and Evolutionary Computing · Computer Science 2025-12-17 Denis Antipov , Aneta Neumann , Frank Neumann , Andrew M. Sutton

It is known that the evolutionary algorithm $(1+1)$-EA with mutation rate $c/n$ optimises every monotone function efficiently if $c<1$, and needs exponential time on some monotone functions (HotTopic functions) if $c\geq 2.2$. We study the…

Neural and Evolutionary Computing · Computer Science 2018-03-29 Johannes Lengler

A core feature of evolutionary algorithms is their mutation operator. Recently, much attention has been devoted to the study of mutation operators with dynamic and non-uniform mutation rates. Following up on this line of work, we propose a…

Data Structures and Algorithms · Computer Science 2018-11-22 Tobias Friedrich , Andreas Göbel , Francesco Quinzan , Markus Wagner

The Non-dominated Sorting Genetic Algorithm-II (NSGA-II) is one of the most prominent algorithms to solve multi-objective optimization problems. Recently, the first mathematical runtime guarantees have been obtained for this algorithm,…

Artificial Intelligence · Computer Science 2023-08-22 Sacha Cerf , Benjamin Doerr , Benjamin Hebras , Yakob Kahane , Simon Wietheger

Together with the NSGA-II, the SPEA2 is one of the most widely used domination-based multi-objective evolutionary algorithms. For both algorithms, the known runtime guarantees are linear in the population size; for the NSGA-II, matching…

Neural and Evolutionary Computing · Computer Science 2026-01-06 Benjamin Doerr , Martin S. Krejca , Milan Stanković

Theory of evolutionary computation (EC) aims at providing mathematically founded statements about the performance of evolutionary algorithms (EAs). The predominant topic in this research domain is runtime analysis, which studies the time it…

Neural and Evolutionary Computing · Computer Science 2018-12-04 Eduardo Carvalho Pinto , Carola Doerr

We propose a new method based on discrete Fourier analysis to analyze the time evolutionary algorithms spend on plateaus. This immediately gives a concise proof of the classic estimate of the expected runtime of the $(1+1)$ evolutionary…

Neural and Evolutionary Computing · Computer Science 2025-01-30 Benjamin Doerr , Andrew James Kelley

Deep neural networks suffer from storing millions and billions of weights in memory post-training, making challenging memory-intensive models to deploy on embedded devices. The weight-sharing technique is one of the popular compression…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Rasa Khosrowshahli , Shahryar Rahnamayan , Beatrice Ombuki-Berman

In this paper, an evolutionary many-objective optimization algorithm based on corner solution search (MaOEA-CS) was proposed. MaOEA-CS implicitly contains two phases: the exploitative search for the most important boundary optimal solutions…

Artificial Intelligence · Computer Science 2018-06-11 Xinye Cai , Haoran Sun , Chunyang Zhu , Zhenyu Li , Qingfu Zhang

The performance of multi-objective evolutionary algorithms deteriorates appreciably in solving many-objective optimization problems which encompass more than three objectives. One of the known rationales is the loss of selection pressure…

Neural and Evolutionary Computing · Computer Science 2018-02-27 Yanan Sun , Gary G. Yen , Zhang Yi

The performance of a Multiobjective Evolutionary Algorithm (MOEA) is crucially dependent on the parameter setting of the operators. The most desired control of such parameters presents the characteristic of adaptiveness, i.e., the capacity…

Neural and Evolutionary Computing · Computer Science 2013-05-23 Arthur Carvalho , Aluizio F. R. Araujo

Very recently, the first mathematical runtime analyses of the multi-objective evolutionary optimizer NSGA-II have been conducted. We continue this line of research with a first runtime analysis of this algorithm on a benchmark problem…

Neural and Evolutionary Computing · Computer Science 2024-01-05 Benjamin Doerr , Zhongdi Qu

Real-world and complex problems have usually many objective functions that have to be optimized all at once. Over the last decades, Multi-Objective Evolutionary Algorithms (MOEAs) are designed to solve this kind of problems. Nevertheless,…

Neural and Evolutionary Computing · Computer Science 2020-02-21 Cristian Ramirez-Atencia , Sanaz Mostaghim , David Camacho

Linear functions play a key role in the runtime analysis of evolutionary algorithms and studies have provided a wide range of new insights and techniques for analyzing evolutionary computation methods. Motivated by studies on separable…

Neural and Evolutionary Computing · Computer Science 2022-08-12 Frank Neumann , Carsten Witt

We perform a rigorous runtime analysis for the Univariate Marginal Distribution Algorithm on the LeadingOnes function, a well-known benchmark function in the theory community of evolutionary computation with a high correlation between…

Neural and Evolutionary Computing · Computer Science 2019-04-22 Per Kristian Lehre , Phan Trung Hai Nguyen

Semantic diversity in Genetic Programming has proved to be highly beneficial in evolutionary search. We have witnessed a surge in the number of scientific works in the area, starting first in discrete spaces and moving then to continuous…

Neural and Evolutionary Computing · Computer Science 2021-04-15 Fergal Stapleton , Edgar Galván

Data-driven evolutionary multi-objective optimization (EMO) has been recognized as an effective approach for multi-objective optimization problems with expensive objective functions. The current research is mainly developed for problems…

Neural and Evolutionary Computing · Computer Science 2022-05-31 Renzhi Chen , Ke Li

In this paper we revisit the question how hard it can be for the $(1+1)$ Evolutionary Algorithm to optimize monotone pseudo-Boolean functions. By introducing a more pessimistic stochastic process, the partially-ordered evolutionary…

Neural and Evolutionary Computing · Computer Science 2025-07-02 Marc Kaufmann , Maxime Larcher , Johannes Lengler , Oliver Sieberling