English
Related papers

Related papers: Exploitation and Exploration Analysis of Elitist E…

200 papers

A well-balanced exploration-exploitation trade-off is crucial for successful acquisition functions in Bayesian optimization. However, there is a lack of quantitative measures for exploration, making it difficult to analyze and compare…

Machine Learning · Computer Science 2026-05-15 Leonard Papenmeier , Nuojin Cheng , Stephen Becker , Luigi Nardi

Stochastic gradient descent is the most prevalent algorithm to train neural networks. However, other approaches such as evolutionary algorithms are also applicable to this task. Evolutionary algorithms bring unique trade-offs that are worth…

Neural and Evolutionary Computing · Computer Science 2018-06-27 Jonas Prellberg , Oliver Kramer

In the field of artificial intelligence, real parameter single objective optimization is an important direction. Both the Differential Evolution (DE) and the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) demonstrate good…

Neural and Evolutionary Computing · Computer Science 2026-01-16 Mingxuan Du , Tingzhang Luo , Ziyang Wang , Chengjun Li

Exploration-exploitation is a powerful and practical tool in multi-agent learning (MAL), however, its effects are far from understood. To make progress in this direction, we study a smooth analogue of Q-learning. We start by showing that…

Computer Science and Game Theory · Computer Science 2020-12-16 Stefanos Leonardos , Georgios Piliouras

Some experimental investigations have shown that evolutionary algorithms (EAs) are efficient for the minimum label spanning tree (MLST) problem. However, we know little about that in theory. As one step towards this issue, we theoretically…

Neural and Evolutionary Computing · Computer Science 2014-09-11 Xinsheng Lai , Yuren Zhou , Jun He , Jun Zhang

Evolutionary and bioinspired computation are crucial for efficiently addressing complex optimization problems across diverse application domains. By mimicking processes observed in nature, like evolution itself, these algorithms offer…

Neural and Evolutionary Computing · Computer Science 2025-01-14 Daniel Molina , Javier Del Ser , Javier Poyatos , Francisco Herrera

We consider Bayesian optimization using Gaussian Process models, also referred to as kernel-based bandit optimization. We study the methodology of exploring the domain using random samples drawn from a distribution. We show that this random…

Machine Learning · Computer Science 2024-02-05 Sudeep Salgia , Sattar Vakili , Qing Zhao

Evolutionary Strategies (ES) are a popular family of black-box zeroth-order optimization algorithms which rely on search distributions to efficiently optimize a large variety of objective functions. This paper investigates the potential…

Neural and Evolutionary Computing · Computer Science 2019-02-01 Louis Faury , Clement Calauzenes , Olivier Fercoq , Syrine Krichen

Discovering diverse visual patterns in continuous cellular automata (CA) is challenging due to the vastness and redundancy of high-dimensional behavioral spaces. Traditional exploration methods like Novelty Search (NS) expand locally by…

Artificial Intelligence · Computer Science 2025-09-05 Sina Khajehabdollahi , Gautier Hamon , Marko Cvjetko , Pierre-Yves Oudeyer , Clément Moulin-Frier , Cédric Colas

Constrained optimization problems are often characterized by multiple constraints that, in the practice, must be satisfied with different tolerance levels. While some constraints are hard and as such must be satisfied with zero-tolerance,…

Neural and Evolutionary Computing · Computer Science 2020-12-21 Stefano Fioravanzo , Giovanni Iacca

Initialization profoundly affects evolutionary algorithm (EA) efficacy by dictating search trajectories and convergence. This study introduces a hybrid initialization strategy combining empty-space search algorithm (ESA) and…

Neural and Evolutionary Computing · Computer Science 2025-05-12 Xinyu Zhang , Mário Antunes , Tyler Estro , Erez Zadok , Klaus Mueller

Adaptive information sampling approaches enable efficient selection of mobile robot's waypoints through which accurate sensing and mapping of a physical process, such as the radiation or field intensity, can be obtained. This paper analyzes…

Robotics · Computer Science 2021-11-23 Aiman Munir , Ramviyas Parasuraman

Large language models (LLMs) have not only revolutionized natural language processing but also extended their prowess to various domains, marking a significant stride towards artificial general intelligence. The interplay between LLMs and…

Neural and Evolutionary Computing · Computer Science 2024-05-30 Xingyu Wu , Sheng-hao Wu , Jibin Wu , Liang Feng , Kay Chen Tan

Drift analysis is a powerful tool for analyzing the time complexity of evolutionary algorithms. However, it requires manual construction of drift functions to bound hitting time for each specific algorithm and problem. To address this…

Neural and Evolutionary Computing · Computer Science 2026-03-04 Jun He , Siang Yew Chong , Xin Yao

Surrogate-assisted evolutionary algorithms (SAEAs) are recently among the most widely studied methods for their capability to solve expensive real-world optimization problems. However, the development of new methods and benchmarking with…

Neural and Evolutionary Computing · Computer Science 2024-02-27 Jakub Kudela , Ladislav Dobrovsky

Evolutionary algorithms (EAs) serve as powerful black-box optimizers inspired by biological evolution. However, most existing EAs predominantly focus on heuristic operators such as crossover and mutation, while usually overlooking…

Neural and Evolutionary Computing · Computer Science 2026-01-21 Kaichen Ouyang , Mingyang Yu , Zong Ke , Junbo Jacob Lian , Shengwei Fu , Xiaoyang Hao , Shengju Yu , Dayu Hu

We consider a simple setting in neuroevolution where an evolutionary algorithm optimizes the weights and activation functions of a simple artificial neural network. We then define simple example functions to be learned by the network and…

Neural and Evolutionary Computing · Computer Science 2023-10-17 Paul Fischer , Emil Lundt Larsen , Carsten Witt

The research area of evolutionary multiobjective optimization (EMO) is reaching better understandings of the properties and capabilities of EMO algorithms, and accumulating much evidence of their worth in practical scenarios. An urgent…

Neural and Evolutionary Computing · Computer Science 2009-08-24 David Corne , Joshua Knowles

Recently, it has been proven that evolutionary algorithms produce good results for a wide range of combinatorial optimization problems. Some of the considered problems are tackled by evolutionary algorithms that use a representation which…

Neural and Evolutionary Computing · Computer Science 2013-01-18 Benjamin Doerr , Anton Eremeev , Frank Neumann , Madeleine Theile , Christian Thyssen

Addressing a complex real-world optimization problem is a challenging task. The chance-constrained knapsack problem with correlated uniform weights plays an important role in the case where dependent stochastic components are considered. We…

Data Structures and Algorithms · Computer Science 2021-02-12 Yue Xie , Aneta Neumann , Frank Neumann , Andrew M. Sutton