English
Related papers

Related papers: On the Effectiveness of Simple Success-Based Param…

200 papers

Feature-based algorithm selection aims to automatically find the best one from a portfolio of optimization algorithms on an unseen problem based on its landscape features. Feature-based algorithm selection has recently received attention in…

Neural and Evolutionary Computing · Computer Science 2022-04-27 Ryoji Tanabe

The one-fifth rule and its generalizations are a classical parameter control mechanism in discrete domains. They have also been transferred to control the offspring population size of the $(1, \lambda)$-EA. This has been shown to work very…

Neural and Evolutionary Computing · Computer Science 2024-04-19 Johannes Lengler , Konstantin Sturm

The runtime of evolutionary algorithms (EAs) depends critically on their parameter settings, which are often problem-specific. Automated schemes for parameter tuning have been developed to alleviate the high costs of manual parameter…

Neural and Evolutionary Computing · Computer Science 2016-06-20 Duc-Cuong Dang , Per Kristian Lehre

Online parameter controllers for evolutionary algorithms adjust values of parameters during the run of an evolutionary algorithm. Recently a new efficient parameter controller based on reinforcement learning was proposed by Karafotias et…

Neural and Evolutionary Computing · Computer Science 2016-03-23 Arkady Rost , Irina Petrova , Arina Buzdalova

One important goal of black-box complexity theory is the development of complexity models allowing to derive meaningful lower bounds for whole classes of randomized search heuristics. Complementing classical runtime analysis, black-box…

Neural and Evolutionary Computing · Computer Science 2016-04-11 Carola Doerr , Johannes Lengler

Most evolutionary algorithms have parameters, which allow a great flexibility in controlling their behavior and adapting them to new problems. To achieve the best performance, it is often needed to control some of the parameters during…

Neural and Evolutionary Computing · Computer Science 2021-06-07 Maxim Buzdalov , Carola Doerr

Theoretical and empirical research on evolutionary computation methods complement each other by providing two fundamentally different approaches towards a better understanding of black-box optimization heuristics. In discrete optimization,…

Neural and Evolutionary Computing · Computer Science 2018-08-20 Carola Doerr , Furong Ye , Sander van Rijn , Hao Wang , Thomas Bäck

It is well known that evolutionary algorithms (EAs) achieve peak performance only when their parameters are suitably tuned to the given problem. Even more, it is known that the best parameter values can change during the optimization…

Neural and Evolutionary Computing · Computer Science 2020-06-22 Arina Buzdalova , Carola Doerr , Anna Rodionova

A key challenge in the application of evolutionary algorithms in practice is the selection of an algorithm instance that best suits the problem at hand. What complicates this decision further is that different algorithms may be best suited…

Neural and Evolutionary Computing · Computer Science 2021-02-15 Furong Ye , Carola Doerr , Thomas Bäck

Dynamic Optimization Problems (DOPs) are challenging to address due to their complex nature, i.e., dynamic environment variation. Evolutionary Computation methods are generally advantaged in solving DOPs since they resemble dynamic…

Neural and Evolutionary Computing · Computer Science 2026-02-02 Zijian Gao , Yuanting Zhong , Zeyuan Ma , Yue-Jiao Gong , Hongshu Guo

Robust iterative methods for solving large sparse systems of linear algebraic equations often suffer from the problem of optimizing the corresponding tuning parameters. To improve the performance of the problem of interest, specific…

Numerical Analysis · Mathematics 2023-10-18 Andrey Petrushov , Boris Krasnopolsky

The selection of the most appropriate algorithm to solve a given problem instance, known as algorithm selection, is driven by the potential to capitalize on the complementary performance of different algorithms across sets of problem…

Machine Learning · Computer Science 2024-06-12 Gjorgjina Cenikj , Ana Nikolikj , Gašper Petelin , Niki van Stein , Carola Doerr , Tome Eftimov

One of the problems in applying Genetic Algorithm is that there is some situation where the evolutionary process converges too fast to a solution which causes it to be trapped in local optima. To overcome this problem, a proper diversity in…

Neural and Evolutionary Computing · Computer Science 2011-09-02 Chaiwat Jassadapakorn , Prabhas Chongstitvatana

In this paper, a novel derivative-free pattern search based algorithm for Black-box optimization is proposed over a simplex constrained parameter space. At each iteration, starting from the current solution, new possible set of solutions…

Optimization and Control · Mathematics 2026-04-16 Priyam Das

Deep learning algorithms have recently shown to be a successful tool in estimating parameters of statistical models for which simulation is easy, but likelihood computation is challenging. But the success of these approaches depends on…

Machine Learning · Statistics 2024-02-20 Amanda Lenzi , Haavard Rue

Many applications seek to optimize LLM outputs at test time by iteratively proposing, scoring, and refining candidates over a discrete output space. Existing methods use a calibrated scalar evaluator for the target objective to guide…

Machine Learning · Computer Science 2026-02-27 Sweta Karlekar , Carolina Zheng , Magnus Saebo , Nicolas Beltran-Velez , Shuyang Yu , John Bowlan , Michal Kucer , David Blei

Black box discrete optimization (BBDO) appears in wide range of engineering tasks. Evolutionary or other BBDO approaches have been applied, aiming at automating necessary tuning of system parameters, such as hyper parameter tuning of…

Machine Learning · Computer Science 2018-09-19 Kouhei Nishida , Hernan Aguirre , Shota Saito , Shinichi Shirakawa , Youhei Akimoto

The performance of many algorithms in the fields of hard combinatorial problem solving, machine learning or AI in general depends on tuned hyperparameter configurations. Automated methods have been proposed to alleviate users from the…

Machine Learning · Computer Science 2019-08-23 André Biedenkapp , H. Furkan Bozkurt , Frank Hutter , Marius Lindauer

Recent theoretical research has shown that self-adjusting and self-adaptive mechanisms can provably outperform static settings in evolutionary algorithms for binary search spaces. However, the vast majority of these studies focuses on…

Neural and Evolutionary Computing · Computer Science 2020-06-03 Amirhossein Rajabi , Carsten Witt

It is well known that evolutionary algorithms can benefit from dynamic choices of the key parameters that control their behavior, to adjust their search strategy to the different stages of the optimization process. A prominent example where…

Machine Learning · Computer Science 2025-07-22 Tai Nguyen , Phong Le , Carola Doerr , Nguyen Dang