English
Related papers

Related papers: Diversity Policy Gradient for Sample Efficient Qua…

200 papers

In continuous action domains, standard deep reinforcement learning algorithms like DDPG suffer from inefficient exploration when facing sparse or deceptive reward problems. Conversely, evolutionary and developmental methods focusing on…

Machine Learning · Computer Science 2018-09-21 Cédric Colas , Olivier Sigaud , Pierre-Yves Oudeyer

Maximum diversity aims at selecting a diverse set of high-quality objects from a collection, which is a fundamental problem and has a wide range of applications, e.g., in Web search. Diversity under a uniform or partition matroid constraint…

Data Structures and Algorithms · Computer Science 2021-04-13 Guangyi Zhang , Aristides Gionis

In this paper we propose a novel method for learning how algorithms perform. Classically, algorithms are compared on a finite number of existing (or newly simulated) benchmark datasets based on some fixed metrics. The algorithm(s) with the…

Data Structures and Algorithms · Computer Science 2019-11-01 Henry Wilde , Vincent Knight , Jonathan Gillard

Quality-Diversity (QD) optimisation is a new family of learning algorithms that aims at generating collections of diverse and high-performing solutions. Among those algorithms, the recently introduced Covariance Matrix Adaptation MAP-Elites…

Neural and Evolutionary Computing · Computer Science 2021-07-07 Antoine Cully

The majority of standard approaches to financial portfolio optimization (PO) are based on the mean-variance (MV) framework. Given a risk aversion coefficient, the MV procedure yields a single portfolio that represents the optimal trade-off…

Portfolio Management · Quantitative Finance 2024-02-27 Bruno Gašperov , Marko Đurasević , Domagoj Jakobovic

Dataset distillation enables the training of deep neural networks with comparable performance in significantly reduced time by compressing large datasets into small and representative ones. Although the introduction of generative models has…

Machine Learning · Computer Science 2025-05-27 Mingzhuo Li , Guang Li , Jiafeng Mao , Takahiro Ogawa , Miki Haseyama

Hybrid optimization algorithms have gained popularity as it has become apparent there cannot be a universal optimization strategy which is globally more beneficial than any other. Despite their popularity, hybridization frameworks require…

Neural and Evolutionary Computing · Computer Science 2013-03-15 Hassan A. Bashir , Richard S. Neville

Quality-Diversity (QD) optimization is an emerging field that focuses on finding a set of behaviorally diverse and high-quality solutions. While the quality is typically defined w.r.t. a single objective function, recent work on…

Neural and Evolutionary Computing · Computer Science 2025-05-28 Shihan Zhao , Stefanos Nikolaidis

Policy gradient methods have been successfully applied to many complex reinforcement learning problems. However, policy gradient methods suffer from high variance, slow convergence, and inefficient exploration. In this work, we introduce a…

Machine Learning · Computer Science 2017-04-11 Yang Liu , Prajit Ramachandran , Qiang Liu , Jian Peng

Evolutionary Algorithms (EAs) and Deep Reinforcement Learning (DRL) have recently been integrated to take the advantage of the both methods for better exploration and exploitation.The evolutionary part in these hybrid methods maintains a…

Neural and Evolutionary Computing · Computer Science 2022-09-19 Yan Ma , Tianxing Liu , Bingsheng Wei , Yi Liu , Kang Xu , Wei Li

We propose the use of quality-diversity algorithms for mixed-initiative game content generation. This idea is implemented as a new feature of the Evolutionary Dungeon Designer, a system for mixed-initiative design of the type of levels you…

Artificial Intelligence · Computer Science 2020-03-06 Alberto Alvarez , Steve Dahlskog , Jose Font , Julian Togelius

The lack of diversity in a genetic algorithm's population may lead to a bad performance of the genetic operators since there is not an equilibrium between exploration and exploitation. In those cases, genetic algorithms present a fast and…

Artificial Intelligence · Computer Science 2017-02-14 Andrés Herrera-Poyatos , Francisco Herrera

One of the most important lessons from the success of deep learning is that learned representations tend to perform much better at any task compared to representations we design by hand. Yet evolution of evolvability algorithms, which aim…

Neural and Evolutionary Computing · Computer Science 2021-07-21 Adam Katona , Daniel W. Franks , James Alfred Walker

Learning from Demonstration (LfD) approaches empower end-users to teach robots novel tasks via demonstrations of the desired behaviors, democratizing access to robotics. A key challenge in LfD research is that users tend to provide…

Machine Learning · Computer Science 2022-02-16 Sravan Jayanthi , Letian Chen , Matthew Gombolay

Recently, the impressive empirical success of policy gradient (PG) methods has catalyzed the development of their theoretical foundations. Despite the huge efforts directed at the design of efficient stochastic PG-type algorithms, the…

Machine Learning · Computer Science 2023-11-09 Ilyas Fatkhullin , Anas Barakat , Anastasia Kireeva , Niao He

Recent work on designing an appropriate distribution of environments has shown promise for training effective generally capable agents. Its success is partly because of a form of adaptive curriculum learning that generates environment…

Artificial Intelligence · Computer Science 2023-07-26 Dexun Li , Wenjun Li , Pradeep Varakantham

Differential MAP-Elites is a novel algorithm that combines the illumination capacity of CVT-MAP-Elites with the continuous-space optimization capacity of Differential Evolution. The algorithm is motivated by observations that illumination…

Neural and Evolutionary Computing · Computer Science 2021-07-13 Tae Jong Choi , Julian Togelius

Quality-Diversity algorithms, among which MAP-Elites, have emerged as powerful alternatives to performance-only optimisation approaches as they enable generating collections of diverse and high-performing solutions to an optimisation…

Neural and Evolutionary Computing · Computer Science 2023-04-26 Manon Flageat , Felix Chalumeau , Antoine Cully

We consider a setting involving $N$ agents, where each agent interacts with an environment modeled as a Markov Decision Process (MDP). The agents' MDPs differ in their reward functions, capturing heterogeneous objectives/tasks. The…

Machine Learning · Computer Science 2024-09-10 Feng Zhu , Robert W. Heath , Aritra Mitra

The policy gradient approach is a flexible and powerful reinforcement learning method particularly for problems with continuous actions such as robot control. A common challenge in this scenario is how to reduce the variance of policy…

Machine Learning · Computer Science 2013-01-18 Tingting Zhao , Hirotaka Hachiya , Voot Tangkaratt , Jun Morimoto , Masashi Sugiyama