English
Related papers

Related papers: Exploitation and Exploration Analysis of Elitist E…

200 papers

In the absence of extensive human-annotated data for complex reasoning tasks, self-improvement -- where models are trained on their own outputs -- has emerged as a primary method for enhancing performance. However, the critical factors…

Artificial Intelligence · Computer Science 2025-03-05 Weihao Zeng , Yuzhen Huang , Lulu Zhao , Yijun Wang , Zifei Shan , Junxian He

Exploration is a crucial skill for in-context reinforcement learning in unknown environments. However, it remains unclear if large language models can effectively explore a partially hidden state space. This work isolates exploration as the…

Machine Learning · Computer Science 2025-08-26 Tim Grams , Patrick Betz , Sascha Marton , Stefan Lüdtke , Christian Bartelt

Evolving one-dimensional cellular automata (CAs) with genetic algorithms has provided insight into how improved performance on a task requiring global coordination emerges when only local interactions are possible. Two approaches that can…

adap-org · Physics 2007-05-23 Justin Werfel , Melanie Mitchell , James P. Crutchfield

This paper explores the enhancement of solution diversity in evolutionary algorithms (EAs) for the maximum matching problem, concentrating on complete bipartite graphs and paths. We adopt binary string encoding for matchings and use Hamming…

Neural and Evolutionary Computing · Computer Science 2024-04-19 Jonathan Gadea Harder , Aneta Neumann , Frank Neumann

Many applications in machine learning require optimizing a function whose true gradient is unknown, but where surrogate gradient information (directions that may be correlated with, but not necessarily identical to, the true gradient) is…

Neural and Evolutionary Computing · Computer Science 2019-06-12 Niru Maheswaranathan , Luke Metz , George Tucker , Dami Choi , Jascha Sohl-Dickstein

Evolutionary processes proved very useful for solving optimization problems. In this work, we build a formalization of the notion of cooperation and competition of multiple systems working toward a common optimization goal of the population…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Mark Burgin , Eugene Eberbach

In real-world applications, many optimization problems have the time-linkage property, that is, the objective function value relies on the current solution as well as the historical solutions. Although the rigorous theoretical analysis on…

Neural and Evolutionary Computing · Computer Science 2021-02-25 Weijie Zheng , Huanhuan Chen , Xin Yao

Black-box complexity theory provides lower bounds for the runtime of black-box optimizers like evolutionary algorithms and serves as an inspiration for the design of new genetic algorithms. Several black-box models covering different…

Neural and Evolutionary Computing · Computer Science 2015-08-28 Carola Doerr , Johannes Lengler

We argue that proven exponential upper bounds on runtimes, an established area in classic algorithms, are interesting also in heuristic search and we prove several such results. We show that any of the algorithms randomized local search,…

Neural and Evolutionary Computing · Computer Science 2021-10-12 Benjamin Doerr

In the era of deep reinforcement learning, making progress is more complex, as the collected experience must be compressed into a deep model for future exploitation and sampling. Many papers have shown that training a deep learning policy…

Machine Learning · Computer Science 2025-08-05 Glen Berseth

Efficient exploration is an unsolved problem in Reinforcement Learning which is usually addressed by reactively rewarding the agent for fortuitously encountering novel situations. This paper introduces an efficient active exploration…

Machine Learning · Computer Science 2019-06-17 Pranav Shyam , Wojciech Jaśkowski , Faustino Gomez

The lack of diversity in a genetic algorithm's population may lead to a bad performance of the genetic operators since there is not an equilibrium between exploration and exploitation. In those cases, genetic algorithms present a fast and…

Artificial Intelligence · Computer Science 2017-02-14 Andrés Herrera-Poyatos , Francisco Herrera

We are often interested in identifying the feasible subset of a decision space under multiple constraints to permit effective design exploration. If determining feasibility required computationally expensive simulations, the cost of…

Machine Learning · Computer Science 2020-06-25 Alma Rahat , Michael Wood

The ideal objective vector, which comprises the optimal values of the $m$ objective functions in an $m$-objective optimization problem, is an important concept in evolutionary multi-objective optimization. Accurate estimation of this vector…

Neural and Evolutionary Computing · Computer Science 2025-05-29 Ruihao Zheng , Zhenkun Wang , Yin Wu , Maoguo Gong

Along with the development of manufacture and services, the problem of distribution network optimization has been growing in importance, thus receiving much attention from the research community. One of the most recently introduced network…

Neural and Evolutionary Computing · Computer Science 2019-08-21 Huynh Thi Thanh Binh , Pham Dinh Thanh , Ta Bao Thang

In recent years, to improve the evolutionary algorithms used to solve optimization problems involving a large number of decision variables, many attempts have been made to simplify the problem solution space of a given problem for the…

Neural and Evolutionary Computing · Computer Science 2021-02-25 Liang Feng , Qingxia Shang , Yaqing Hou , Kay Chen Tan , Yew-Soon Ong

Many evolutionary algorithms (EAs) take advantage of parallel evaluation of candidates. However, if evaluation times vary significantly, many worker nodes (i.e.,\ compute clients) are idle much of the time, waiting for the next generation…

Neural and Evolutionary Computing · Computer Science 2024-01-02 Jason Liang , Hormoz Shahrzad , Risto Miikkulainen

Many real-world optimization problems occur in environments that change dynamically or involve stochastic components. Evolutionary algorithms and other bio-inspired algorithms have been widely applied to dynamic and stochastic problems.…

Neural and Evolutionary Computing · Computer Science 2020-01-30 Vahid Roostapour , Mojgan Pourhassan , Frank Neumann

Evolution has produced an astonishing diversity of species, each filling a different niche. Algorithms like MAP-Elites mimic this divergent evolutionary process to find a set of behaviorally diverse but high-performing solutions, called the…

Neural and Evolutionary Computing · Computer Science 2018-04-12 Vassilis Vassiliades , Jean-Baptiste Mouret

Evolutionary algorithms (EAs) have found many successful real-world applications, where the optimization problems are often subject to a wide range of uncertainties. To understand the practical behaviors of EAs theoretically, there are a…

Computational Complexity · Computer Science 2022-12-07 Chao Bian , Chao Qian , Ke Tang , Yang Yu