English
Related papers

Related papers: Exploration and Exploitation in Symbolic Regressio…

200 papers

Quality-Diversity algorithms have transformed optimization by prioritizing the discovery of diverse, high-performing solutions over a single optimal result. However, traditional Quality-Diversity methods, such as MAP-Elites, rely heavily on…

Neural and Evolutionary Computing · Computer Science 2025-11-21 Constantinos Tsakonas , Konstantinos Chatzilygeroudis

Water distribution system design is a challenging optimisation problem with a high number of search dimensions and constraints. In this way, Evolutionary Algorithms (EAs) have been widely applied to optimise WDS to minimise cost subject…

Neural and Evolutionary Computing · Computer Science 2019-09-12 Mehdi Neshat , Bradley Alexander , Angus Simpson

Several works have demonstrated the use of variational autoencoders (VAEs) for generating levels in the style of existing games and blending levels across different games. Further, quality-diversity (QD) algorithms have also become popular…

Machine Learning · Computer Science 2021-07-23 Anurag Sarkar , Seth Cooper

We combine two popular optimization approaches to derive learning algorithms for generative models: variational optimization and evolutionary algorithms. The combination is realized for generative models with discrete latents by using…

Machine Learning · Statistics 2022-02-07 Jakob Drefs , Enrico Guiraud , Jörg Lücke

We present a new method of blackbox optimization via gradient approximation with the use of structured random orthogonal matrices, providing more accurate estimators than baselines and with provable theoretical guarantees. We show that this…

Machine Learning · Computer Science 2018-06-13 Krzysztof Choromanski , Mark Rowland , Vikas Sindhwani , Richard E. Turner , Adrian Weller

The Increasing Population Covariance Matrix Adaptation Evolution Strategy (IPOP-CMA-ES) algorithm is a reference stochastic optimizer dedicated to blackbox optimization, where no prior knowledge about the underlying problem structure is…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-02 David Redon , Pierre Fortin , Bilel Derbel , Miwako Tsuji , Mitsuhisa Sato

Multi-Armed Bandit (MAB) algorithms are widely used in recommender systems that require continuous, incremental learning. A core aspect of MABs is the exploration-exploitation trade-off: choosing between exploiting items likely to be…

Machine Learning · Computer Science 2026-04-20 Pedro R. Pires , Gregorio F. Azevedo , Pietro L. Campos , Rafael T. Sereicikas , Tiago A. Almeida

Designing agents that are able to achieve different play-styles while maintaining a competitive level of play is a difficult task, especially for games for which the research community has not found super-human performance yet, like…

Artificial Intelligence · Computer Science 2021-06-29 Diego Perez-Liebana , Cristina Guerrero-Romero , Alexander Dockhorn , Linjie Xu , Jorge Hurtado , Dominik Jeurissen

Finding the optimal parameter setting (i.e. the optimal population size, the optimal mutation probability, the optimal evolutionary model etc) for an Evolutionary Algorithm (EA) is a difficult task. Instead of evolving only the parameters…

Neural and Evolutionary Computing · Computer Science 2021-09-29 Mihai Oltean , Crina Groşan

With the rapid development of quantum computers, several applications are being proposed for them. Quantum simulations, simulation of chemical reactions, solution of optimization problems and quantum neural networks (QNNs) are some…

Quantum Physics · Physics 2023-03-02 Lucas Friedrich , Jonas Maziero

This paper presents how the most recent improvements made on covariance matrix estimation and model order selection can be applied to the portfolio optimisation problem. The particular case of the Maximum Variety Portfolio is treated but…

Applications · Statistics 2018-04-03 Emmanuelle Jay , Eugénie Terreaux , Jean-Philippe Ovarlez , Frédéric Pascal

In building practical applications of evolutionary computation (EC), two optimizations are essential. First, the parameters of the search method need to be tuned to the domain in order to balance exploration and exploitation effectively.…

Neural and Evolutionary Computing · Computer Science 2023-04-25 Hormoz Shahrzad , Risto Miikkulainen

Evolutionary algorithms (EAs) are general-purpose problem solvers that usually perform an unbiased search. This is reasonable and desirable in a black-box scenario. For combinatorial optimization problems, often more knowledge about the…

Neural and Evolutionary Computing · Computer Science 2020-04-23 Vahid Roostapour , Jakob Bossek , Frank Neumann

In [1], we have explored the theoretical aspects of feature selection and evolutionary algorithms. In this chapter, we focus on optimization algorithms for enhancing data analytic process, i.e., we propose to explore applications of…

Machine Learning · Computer Science 2019-08-26 Farid Ghareh Mohammadi , M. Hadi Amini , Hamid R. Arabnia

Creating diverse sets of high quality solutions has become an important problem in recent years. Previous works on diverse solutions problems consider solutions' objective quality and diversity where one is regarded as the optimization goal…

Neural and Evolutionary Computing · Computer Science 2024-01-17 Anh Viet Do , Mingyu Guo , Aneta Neumann , Frank Neumann

A key challenge in reinforcement learning (RL) is managing the exploration-exploitation trade-off without sacrificing sample efficiency. Policy gradient (PG) methods excel in exploitation through fine-grained, gradient-based optimization…

Machine Learning · Computer Science 2025-04-18 Zelal Su "Lain" Mustafaoglu , Keshav Pingali , Risto Miikkulainen

We study the problem of determining an effective exploration strategy in static and non-linear optimization problems, which depend on an unknown scalar parameter to be learned from online collected noisy data. An optimal trade-off between…

Optimization and Control · Mathematics 2024-09-13 Ying Wang , Mirko Pasquini , Kévin Colin , Håkan Hjalmarsson

In a regression task, a function is learned from labeled data to predict the labels at new data points. The goal is to achieve small prediction errors. In symbolic regression, the goal is more ambitious, namely, to learn an interpretable…

Machine Learning · Computer Science 2025-06-25 Paul Kahlmeyer , Joachim Giesen , Michael Habeck , Henrik Voigt

The lack of diversity in a genetic algorithm's population may lead to a bad performance of the genetic operators since there is not an equilibrium between exploration and exploitation. In those cases, genetic algorithms present a fast and…

Artificial Intelligence · Computer Science 2017-02-14 Andrés Herrera-Poyatos , Francisco Herrera

Exploratory landscape analysis (ELA) supports supervised learning approaches for automated algorithm selection and configuration by providing sets of features that quantify the most relevant characteristics of the optimization problem at…

Neural and Evolutionary Computing · Computer Science 2022-12-08 Quentin Renau , Carola Doerr , Johann Dreo , Benjamin Doerr