English
Related papers

Related papers: Optimal Parameter Choices Through Self-Adjustment:…

200 papers

Evolutionary algorithms are bio-inspired algorithms that can easily adapt to changing environments. Recent results in the area of runtime analysis have pointed out that algorithms such as the (1+1)~EA and Global SEMO can efficiently…

Neural and Evolutionary Computing · Computer Science 2022-06-07 Vahid Roostapour , Aneta Neumann , Frank Neumann

The analysis of vast amounts of data constitutes a major challenge in modern high energy physics experiments. Machine learning (ML) methods, typically trained on simulated data, are often employed to facilitate this task. Several choices…

High Energy Physics - Experiment · Physics 2021-02-25 Laurits Tani , Diana Rand , Christian Veelken , Mario Kadastik

We study the $(1:s+1)$ success rule for controlling the population size of the $(1,\lambda)$-EA. It was shown by Hevia Fajardo and Sudholt that this parameter control mechanism can run into problems for large $s$ if the fitness landscape is…

Neural and Evolutionary Computing · Computer Science 2024-01-25 Marc Kaufmann , Maxime Larcher , Johannes Lengler , Xun Zou

Algorithms typically come with tunable parameters that have a considerable impact on the computational resources they consume. Too often, practitioners must hand-tune the parameters, a tedious and error-prone task. A recent line of research…

Machine Learning · Computer Science 2020-11-24 Maria-Florina Balcan , Tuomas Sandholm , Ellen Vitercik

We study differentially private (DP) algorithms for stochastic convex optimization: the problem of minimizing the population loss given i.i.d. samples from a distribution over convex loss functions. A recent work of Bassily et al. (2019)…

Machine Learning · Computer Science 2020-05-12 Vitaly Feldman , Tomer Koren , Kunal Talwar

Most research in the theory of evolutionary computation assumes that the problem at hand has a fixed problem size. This assumption does not always apply to real-world optimization challenges, where the length of an optimal solution may be…

Neural and Evolutionary Computing · Computer Science 2015-06-22 Benjamin Doerr , Carola Doerr , Timo Kötzing

Evolutionary algorithms (EAs) are population-based general-purpose optimization algorithms, and have been successfully applied in various real-world optimization tasks. However, previous theoretical studies often employ EAs with only a…

Neural and Evolutionary Computing · Computer Science 2016-06-13 Chao Qian , Yang Yu , Zhi-Hua Zhou

Dynamic linear functions on the hypercube are functions which assign to each bit a positive weight, but the weights change over time. Throughout optimization, these functions maintain the same global optimum, and never have defecting local…

Neural and Evolutionary Computing · Computer Science 2020-04-22 Johannes Lengler , Jonas Meier

We study how Reinforcement Learning can be employed to optimally control parameters in evolutionary algorithms. We control the mutation probability of a (1+1) evolutionary algorithm on the OneMax function. This problem is modeled as a…

Neural and Evolutionary Computing · Computer Science 2019-05-10 Luca Mossina , Emmanuel Rachelson , Daniel Delahaye

Modern large-scale statistical models require to estimate thousands to millions of parameters. This is often accomplished by iterative algorithms such as gradient descent, projected gradient descent or their accelerated versions. What are…

Machine Learning · Statistics 2020-03-04 Michael Celentano , Andrea Montanari , Yuchen Wu

Design of experiments, random search, initialization of population-based methods, or sampling inside an epoch of an evolutionary algorithm use a sample drawn according to some probability distribution for approximating the location of an…

Neural and Evolutionary Computing · Computer Science 2020-04-27 Laurent Meunier , Carola Doerr , Jeremy Rapin , Olivier Teytaud

Hyperparameter optimization is a crucial problem in Evolutionary Computation. In fact, the values of the hyperparameters directly impact the trajectory taken by the optimization process, and their choice requires extensive reasoning by…

Neural and Evolutionary Computing · Computer Science 2024-08-06 Leonardo Lucio Custode , Fabio Caraffini , Anil Yaman , Giovanni Iacca

We investigate a family of $(\mu+\lambda)$ Genetic Algorithms (GAs) which creates offspring either from mutation or by recombining two randomly chosen parents. By scaling the crossover probability, we can thus interpolate from a fully…

Neural and Evolutionary Computing · Computer Science 2021-02-16 Furong Ye , Hao Wang , Carola Doerr , Thomas Bäck

Evolutionary strategies have recently been shown to achieve competing levels of performance for complex optimization problems in reinforcement learning. In such problems, one often needs to optimize an objective function subject to a set of…

Neural and Evolutionary Computing · Computer Science 2022-02-23 Youssef Diouane , Aurelien Lucchi , Vihang Patil

Evolutionary algorithms, inspired by natural evolution, aim to optimize difficult objective functions without computing derivatives. Here we detail the relationship between population genetics and evolutionary optimization and formulate a…

Populations and Evolution · Quantitative Biology 2023-07-19 Jakub Otwinowski , Colin LaMont

Population-based evolutionary algorithms have great potential to handle multiobjective optimisation problems. However, these algorithms depends largely on problem characteristics, and there is a need to improve their performance for a wider…

Neural and Evolutionary Computing · Computer Science 2019-10-17 Shouyong Jiang , Hongru Li , Jinglei Guo , Mingjun Zhong , Shengxiang Yang , Marcus Kaiser , Natalio Krasnogor

Motivation: Estimating parameters from data is a key stage of the modelling process, particularly in biological systems where many parameters need to be estimated from sparse and noisy data sets. Over the years, a variety of heuristics have…

Quantitative Methods · Quantitative Biology 2011-11-07 Mariano Beguerisse-Diaz , Baojun Wang , Radhika Desikan , Mauricio Barahona

It was recently observed that the $(1+(\lambda,\lambda))$ genetic algorithm can comparably easily escape the local optimum of the jump functions benchmark. Consequently, this algorithm can optimize the jump function with jump size $k$ in an…

Neural and Evolutionary Computing · Computer Science 2020-06-08 Denis Antipov , Benjamin Doerr

It is generally accepted that populations are useful for the global exploration of multi-modal optimisation problems. Indeed, several theoretical results are available showing such advantages over single-trajectory search heuristics. In…

Neural and Evolutionary Computing · Computer Science 2019-03-27 Dogan Corus , Pietro S. Oliveto

In real-world applications, many optimization problems have the time-linkage property, that is, the objective function value relies on the current solution as well as the historical solutions. Although the rigorous theoretical analysis on…

Neural and Evolutionary Computing · Computer Science 2021-02-25 Weijie Zheng , Huanhuan Chen , Xin Yao