English
Related papers

Related papers: Quality Diversity for Robot Learning: Limitations …

200 papers

In real-world environments, robots need to be resilient to damages and robust to unforeseen scenarios. Quality-Diversity (QD) algorithms have been successfully used to make robots adapt to damages in seconds by leveraging a diverse set of…

Robotics · Computer Science 2022-10-19 Maxime Allard , Simón C. Smith , Konstantinos Chatzilygeroudis , Bryan Lim , Antoine Cully

Quality-Diversity (QD) is a concept from Neuroevolution with some intriguing applications to Reinforcement Learning. It facilitates learning a population of agents where each member is optimized to simultaneously accumulate high…

Machine Learning · Computer Science 2020-11-06 Tanmay Gangwani , Jian Peng , Yuan Zhou

Exploration is a key challenge in Reinforcement Learning, especially in long-horizon, deceptive and sparse-reward environments. For such applications, population-based approaches have proven effective. Methods such as Quality-Diversity…

Neural and Evolutionary Computing · Computer Science 2022-11-24 Bryan Lim , Manon Flageat , Antoine Cully

Quality Diversity (QD) algorithms have been proposed to search for a large collection of both diverse and high-performing solutions instead of a single set of local optima. While early QD algorithms view the objective and descriptor…

Artificial Intelligence · Computer Science 2023-09-14 Raphael Boige , Guillaume Richard , Jérémie Dona , Thomas Pierrot , Antoine Cully

Quality-Diversity optimisation algorithms enable the evolution of collections of both high-performing and diverse solutions. These collections offer the possibility to quickly adapt and switch from one solution to another in case it is not…

Neural and Evolutionary Computing · Computer Science 2023-04-26 Manon Flageat , Antoine Cully

The Reinforcement Learning field is strong on achievements and weak on reapplication; a computer playing GO at a super-human level is still terrible at Tic-Tac-Toe. This paper asks whether the method of training networks improves their…

Neural and Evolutionary Computing · Computer Science 2023-03-28 Brad Windsor , Brandon O'Shea , Mengxi Wu

Deep Reinforcement Learning (RL) has emerged as a powerful paradigm for training neural policies to solve complex control tasks. However, these policies tend to be overfit to the exact specifications of the task and environment they were…

Neural and Evolutionary Computing · Computer Science 2023-09-11 Felix Chalumeau , Raphael Boige , Bryan Lim , Valentin Macé , Maxime Allard , Arthur Flajolet , Antoine Cully , Thomas Pierrot

In swarm robotics, any of the robots in a swarm may be affected by different faults, resulting in significant performance declines. To allow fault recovery from randomly injected faults to different robots in a swarm, a model-free approach…

Neural and Evolutionary Computing · Computer Science 2024-01-08 David M. Bossens , Danesh Tarapore

Quality-Diversity algorithms are powerful tools for discovering diverse, high-performing solutions. Recently, Multi-Objective Quality-Diversity (MOQD) extends QD to problems with several objectives while preserving solution diversity. MOQD…

Machine Learning · Computer Science 2025-04-08 Hannah Janmohamed , Antoine Cully

We use the Quality Diversity (QD) algorithm with Neural Cellular Automata (NCA) to automatically evaluate Multi-Agent Path Finding (MAPF) algorithms by generating diverse maps. Previously, researchers typically evaluate MAPF algorithms on a…

Multiagent Systems · Computer Science 2026-03-02 Cheng Qian , Yulun Zhang , Varun Bhatt , Matthew Christopher Fontaine , Stefanos Nikolaidis , Jiaoyang Li

Quality-Diversity (QD) algorithms have exhibited promising results across many domains and applications. However, uncertainty in fitness and behaviour estimations of solutions remains a major challenge when QD is used in complex real-world…

Neural and Evolutionary Computing · Computer Science 2025-03-04 Manon Flageat , Hannah Janmohamed , Bryan Lim , Antoine Cully

We present a Quality-Diversity benchmark suite for Deep Neuroevolution in Reinforcement Learning domains for robot control. The suite includes the definition of tasks, environments, behavioral descriptors, and fitness. We specify different…

Neural and Evolutionary Computing · Computer Science 2022-11-07 Manon Flageat , Bryan Lim , Luca Grillotti , Maxime Allard , Simón C. Smith , Antoine Cully

Robots find extensive applications in industry. In recent years, the influence of robots has also increased rapidly in domestic scenarios. The Q-learning algorithm aims to maximise the reward for reaching the goal. This paper proposes a…

Robotics · Computer Science 2024-09-04 Varun Prakash Rajamohan , Senthil Kumar Jagatheesaperumal

Recent works have shown that by curating high quality and diverse instruction tuning datasets, we can significantly improve instruction-following capabilities. However, creating such datasets is difficult and most works rely on manual…

Computation and Language · Computer Science 2024-11-12 Alexander Bukharin , Shiyang Li , Zhengyang Wang , Jingfeng Yang , Bing Yin , Xian Li , Chao Zhang , Tuo Zhao , Haoming Jiang

Quality diversity is a recent family of evolutionary search algorithms which focus on finding several well-performing (quality) yet different (diversity) solutions with the aim to maintain an appropriate balance between divergence and…

Neural and Evolutionary Computing · Computer Science 2018-10-25 Daniele Gravina , Antonios Liapis , Georgios N. Yannakakis

Quality-Diversity optimization is a new family of optimization algorithms that, instead of searching for a single optimal solution to solving a task, searches for a large collection of solutions that all solve the task in a different way.…

Robotics · Computer Science 2019-05-29 Antoine Cully

The representation, or encoding, utilized in evolutionary algorithms has a substantial effect on their performance. Examination of the suitability of widely used representations for quality diversity optimization (QD) in robotic domains has…

Neural and Evolutionary Computing · Computer Science 2023-04-10 Ludovico Scarton , Alexander Hagg

The optimization of functions to find the best solution according to one or several objectives has a central role in many engineering and research fields. Recently, a new family of optimization algorithms, named Quality-Diversity…

Neural and Evolutionary Computing · Computer Science 2017-08-31 Antoine Cully , Yiannis Demiris

Quality-Diversity is a family of evolutionary algorithms that generate diverse, high-performing solutions through local competition principles inspired by natural evolution. While research has focused on improving specific aspects of…

Neural and Evolutionary Computing · Computer Science 2025-02-04 Ryan Bahlous-Boldi , Maxence Faldor , Luca Grillotti , Hannah Janmohamed , Lisa Coiffard , Lee Spector , Antoine Cully

Quality-Diversity algorithms refer to a class of evolutionary algorithms designed to find a collection of diverse and high-performing solutions to a given problem. In robotics, such algorithms can be used for generating a collection of…

Neural and Evolutionary Computing · Computer Science 2022-02-17 Luca Grillotti , Antoine Cully