English
Related papers

Related papers: Self-Adjusting Evolutionary Algorithms Are Slow on…

200 papers

In recent work, Lissovoi, Oliveto, and Warwicker (Artificial Intelligence (2023)) proved that the Move Acceptance Hyper-Heuristic (MAHH) leaves the local optimum of the multimodal cliff benchmark with remarkable efficiency. With its…

Neural and Evolutionary Computing · Computer Science 2024-07-22 Benjamin Doerr , Arthur Dremaux , Johannes Lutzeyer , Aurélien Stumpf

Large Language Models (LLMs) are highly resource-intensive to fine-tune due to their enormous size. While low-rank adaptation is a prominent parameter-efficient fine-tuning approach, it suffers from sensitivity to hyperparameter choices,…

Evolutionary algorithms (EAs) have achieved remarkable success in tackling complex combinatorial optimization problems. However, EAs often demand carefully-designed operators with the aid of domain expertise to achieve satisfactory…

Neural and Evolutionary Computing · Computer Science 2024-04-29 Shengcai Liu , Caishun Chen , Xinghua Qu , Ke Tang , Yew-Soon Ong

Evolutionary Algorithms (EAs) are being routinely applied for a variety of optimization tasks, and real-parameter optimization in the presence of constraints is one such important area. During constrained optimization EAs often create…

Neural and Evolutionary Computing · Computer Science 2015-04-20 Nikhil Padhye , Pulkit Mittal , Kalyanmoy Deb

We introduce the technique of adaptive discretization to design an efficient model-based episodic reinforcement learning algorithm in large (potentially continuous) state-action spaces. Our algorithm is based on optimistic one-step value…

Machine Learning · Computer Science 2020-10-26 Sean R. Sinclair , Tianyu Wang , Gauri Jain , Siddhartha Banerjee , Christina Lee Yu

This paper extends the runtime analysis of non-elitist evolutionary algorithms (EAs) with fitness-proportionate selection from the simple OneMax function to the linear functions. Not only does our analysis cover a larger class of fitness…

Neural and Evolutionary Computing · Computer Science 2019-08-26 Duc-Cuong Dang , Anton Eremeev , Per Kristian Lehre

A core feature of evolutionary algorithms is their mutation operator. Recently, much attention has been devoted to the study of mutation operators with dynamic and non-uniform mutation rates. Following up on this line of work, we propose a…

Data Structures and Algorithms · Computer Science 2018-11-22 Tobias Friedrich , Andreas Göbel , Francesco Quinzan , Markus Wagner

This paper analyses a $(1,\lambda)$-Evolution Strategy, a randomised comparison-based adaptive search algorithm, on a simple constraint optimisation problem. The algorithm uses resampling to handle the constraint and optimizes a linear…

Neural and Evolutionary Computing · Computer Science 2014-12-09 Alexandre Chotard , Anne Auger , Nikolaus Hansen

Multi-objective evolutionary algorithms (MOEAs) are widely used to solve multi-objective optimization problems. The algorithms rely on setting appropriate parameters to find good solutions. However, this parameter tuning could be very…

Neural and Evolutionary Computing · Computer Science 2022-11-18 Remco Coppens , Robbert Reijnen , Yingqian Zhang , Laurens Bliek , Berend Steenhuisen

We study evolutionary algorithms in a dynamic setting, where for each generation a different fitness function is chosen, and selection is performed with respect to the current fitness function. Specifically, we consider Dynamic BinVal, in…

Neural and Evolutionary Computing · Computer Science 2021-07-09 Johannes Lengler , Simone Riedi

It is generally accepted that populations are useful for the global exploration of multi-modal optimisation problems. Indeed, several theoretical results are available showing such advantages over single-trajectory search heuristics. In…

Neural and Evolutionary Computing · Computer Science 2019-03-27 Dogan Corus , Pietro S. Oliveto

The compact Genetic Algorithm (cGA), parameterized by its hypothetical population size $K$, offers a low-memory alternative to evolving a large offspring population of solutions. It evolves a probability distribution, biasing it towards…

Neural and Evolutionary Computing · Computer Science 2024-04-19 Cella Florescu , Marc Kaufmann , Johannes Lengler , Ulysse Schaller

The $(1 + (\lambda,\lambda))$ genetic algorithm is a younger evolutionary algorithm trying to profit also from inferior solutions. Rigorous runtime analyses on unimodal fitness functions showed that it can indeed be faster than classical…

Neural and Evolutionary Computing · Computer Science 2022-06-17 Denis Antipov , Benjamin Doerr , Vitalii Karavaev

The range of applications of traditional optimization methods are limited by the features of the object variables, and of both the objective and the constraint functions. In contrast, population-based algorithms whose optimization…

Neural and Evolutionary Computing · Computer Science 2021-01-27 Mauro S. Innocente , Johann Sienz

Population-based evolutionary algorithms (EAs) have been widely applied to solve various optimization problems. The question of how the performance of a population-based EA depends on the population size arises naturally. The performance of…

Neural and Evolutionary Computing · Computer Science 2013-05-13 Jun He , Tianshi Chen , Boris Mitavskiy

This paper is devoted to the design of efficient primal-dual algorithm (PDA) for solving convex optimization problems with known saddle-point structure. We present a new PDA with larger acceptable range of parameters and correction, which…

Optimization and Control · Mathematics 2019-12-04 Xiaokai Chang , Sanyang Liu

Multi-modal optimization involves identifying multiple global and local optima of a function, offering valuable insights into diverse optimal solutions within the search space. Evolutionary algorithms (EAs) excel at finding multiple…

Neural and Evolutionary Computing · Computer Science 2025-09-09 Dikshit Chauhan , Shivani , Donghwi Jung , Anupam Yadav

Evolutionary algorithms (EAs) form a popular optimisation paradigm inspired by natural evolution. In recent years the field of evolutionary computation has developed a rigorous analytical theory to analyse their runtime on many illustrative…

Neural and Evolutionary Computing · Computer Science 2015-10-02 Tiago Paixão , Jorge Pérez Heredia , Dirk Sudholt , Barbora Trubenová

We study how Reinforcement Learning can be employed to optimally control parameters in evolutionary algorithms. We control the mutation probability of a (1+1) evolutionary algorithm on the OneMax function. This problem is modeled as a…

Neural and Evolutionary Computing · Computer Science 2019-05-10 Luca Mossina , Emmanuel Rachelson , Daniel Delahaye

Multi-objective optimization is a common problem in practical applications, and multi-objective evolutionary algorithm (MOEA) is considered as one of the effective methods to solve these problems. However, their randomness sometimes…

Neural and Evolutionary Computing · Computer Science 2024-10-04 Wanyi Liu , Long Chen , Zhenzhou Tang