English
Related papers

Related papers: Quality Diversity for Robot Learning: Limitations …

200 papers

While standard approaches to optimisation focus on producing a single high-performing solution, Quality-Diversity (QD) algorithms allow large diverse collections of such solutions to be found. If QD has proven promising across a large…

Neural and Evolutionary Computing · Computer Science 2023-04-27 Manon Flageat , Luca Grillotti , Antoine Cully

In contrast to humans and animals who naturally execute seamless motions, learning and smoothly executing sequences of actions remains a challenge in robotics. This paper introduces a novel skill-agnostic framework that learns to sequence…

Robotics · Computer Science 2022-06-02 Noémie Jaquier , You Zhou , Julia Starke , Tamim Asfour

Quality Diversity (QD) algorithms such as MAP-Elites are a class of optimisation techniques that attempt to find a set of high-performing points from an objective function while enforcing behavioural diversity of the points over one or more…

Optimization and Control · Mathematics 2020-05-12 Paul Kent , Juergen Branke

Quality-Diversity (QD) algorithms are a recent type of optimisation methods that search for a collection of both diverse and high performing solutions. They can be used to effectively explore a target problem according to features defined…

Neural and Evolutionary Computing · Computer Science 2019-08-22 Leo Cazenille

Increasing interest in integrating advanced robotics within manufacturing has spurred a renewed concentration in developing real-time scheduling solutions to coordinate human-robot collaboration in this environment. Traditionally, the…

Robotics · Computer Science 2020-06-30 Zheyuan Wang , Matthew Gombolay

The synergies between Quality-Diversity (QD) and Deep Reinforcement Learning (RL) have led to powerful hybrid QD-RL algorithms that have shown tremendous potential, and brings the best of both fields. However, only a single deep RL…

Machine Learning · Computer Science 2023-03-14 Bryan Lim , Manon Flageat , Antoine Cully

Reinforcement learning agents need a reward signal to learn successful policies. When this signal is sparse or the corresponding gradient is deceptive, such agents need a dedicated mechanism to efficiently explore their search space without…

Artificial Intelligence · Computer Science 2021-04-13 Alexandre Chenu , Nicolas Perrin-Gilbert , Stéphane Doncieux , Olivier Sigaud

In the context of neuroevolution, Quality-Diversity algorithms have proven effective in generating repertoires of diverse and efficient policies by relying on the definition of a behavior space. A natural goal induced by the creation of…

Neural and Evolutionary Computing · Computer Science 2023-09-14 Valentin Macé , Raphaël Boige , Felix Chalumeau , Thomas Pierrot , Guillaume Richard , Nicolas Perrin-Gilbert

Continually solving new, unsolved tasks is the key to learning diverse behaviors. Through reinforcement learning (RL), we have made massive strides towards solving tasks that have a single goal. However, in the multi-task domain, where an…

Machine Learning · Computer Science 2020-06-18 Yunzhi Zhang , Pieter Abbeel , Lerrel Pinto

Synthesizing planning and control policies in robotics is a fundamental task, further complicated by factors such as complex logic specifications and high-dimensional robot dynamics. This paper presents a novel reinforcement learning…

Robotics · Computer Science 2023-10-03 Zikang Xiong , Daniel Lawson , Joe Eappen , Ahmed H. Qureshi , Suresh Jagannathan

Quality-Diversity (QD) algorithms, and MAP-Elites (ME) in particular, have proven very useful for a broad range of applications including enabling real robots to recover quickly from joint damage, solving strongly deceptive maze tasks or…

Neural and Evolutionary Computing · Computer Science 2020-06-08 Cédric Colas , Joost Huizinga , Vashisht Madhavan , Jeff Clune

While legged robots have achieved significant advancements in recent years, ensuring the robustness of their controllers on unstructured terrains remains challenging. It requires generating diverse and challenging unstructured terrains to…

Robotics · Computer Science 2025-10-13 Arthur Esquerre-Pourtère , Minsoo Kim , Jaeheung Park

Quality-Diversity (QD) algorithms excel at discovering diverse repertoires of skills, but are hindered by poor sample efficiency and often require tens of millions of environment steps to solve complex locomotion tasks. Recent advances in…

Machine Learning · Computer Science 2026-04-23 Behrad Koohy , Jamie Bayne

Quality-Diversity algorithms have transformed optimization by prioritizing the discovery of diverse, high-performing solutions over a single optimal result. However, traditional Quality-Diversity methods, such as MAP-Elites, rely heavily on…

Neural and Evolutionary Computing · Computer Science 2025-11-21 Constantinos Tsakonas , Konstantinos Chatzilygeroudis

Neuroevolution is an alternative to gradient-based optimisation that has the potential to avoid local minima and allows parallelisation. The main limiting factor is that usually it does not scale well with parameter space dimensionality.…

Machine Learning · Computer Science 2021-04-29 Nemanja Rakicevic , Antoine Cully , Petar Kormushev

A key aspect of intelligence is the ability to demonstrate a broad spectrum of behaviors for adapting to unexpected situations. Over the past decade, advancements in deep reinforcement learning have led to groundbreaking achievements to…

Machine Learning · Computer Science 2024-06-04 Luca Grillotti , Maxence Faldor , Borja G. León , Antoine Cully

In Reinforcement Learning (RL), an agent explores the environment and collects trajectories into the memory buffer for later learning. However, the collected trajectories can easily be imbalanced with respect to the achieved goal states.…

Machine Learning · Computer Science 2020-05-27 Rui Zhao , Volker Tresp

Enabling robots to autonomously navigate complex environments is essential for real-world deployment. Prior methods approach this problem by having the robot maintain an internal map of the world, and then use a localization and planning…

Machine Learning · Computer Science 2018-05-21 Gregory Kahn , Adam Villaflor , Bosen Ding , Pieter Abbeel , Sergey Levine

With the development of fast and massively parallel evaluations in many domains, Quality-Diversity (QD) algorithms, that already proved promising in a large range of applications, have seen their potential multiplied. However, we have yet…

Neural and Evolutionary Computing · Computer Science 2024-04-15 Manon Flageat , Bryan Lim , Antoine Cully

With the increasing focus on flexible automation, which emphasizes systems capable of adapting to varied tasks and conditions, exploring future deployments of cloud and edge-based network infrastructures in robotic systems becomes crucial.…