English
Related papers

Related papers: Exploration by Learning Diverse Skills through Suc…

200 papers

Exploration is critical for good results in deep reinforcement learning and has attracted much attention. However, existing multi-agent deep reinforcement learning algorithms still use mostly noise-based techniques. Very recently,…

Artificial Intelligence · Computer Science 2021-07-27 Iou-Jen Liu , Unnat Jain , Raymond A. Yeh , Alexander G. Schwing

Unsupervised Skill Discovery (USD) allows agents to autonomously learn diverse behaviors without task-specific rewards. While recent USD methods have shown promise, their application to real-world robotics remains underexplored. In this…

Robotics · Computer Science 2025-09-01 Rafael Cathomen , Mayank Mittal , Marin Vlastelica , Marco Hutter

Reward-free, unsupervised discovery of skills is an attractive alternative to the bottleneck of hand-designing rewards in environments where task supervision is scarce or expensive. However, current skill pre-training methods, like many RL…

Machine Learning · Computer Science 2022-03-22 Nur Muhammad Shafiullah , Lerrel Pinto

Policy search reinforcement learning allows robots to acquire skills by themselves. However, the learning procedure is inherently unsafe as the robot has no a-priori way to predict the consequences of the exploratory actions it takes.…

Robotics · Computer Science 2018-10-09 Jens Lundell , Robert Krug , Erik Schaffernicht , Todor Stoyanov , Ville Kyrki

Animals have a developed ability to explore that aids them in important tasks such as locating food, exploring for shelter, and finding misplaced items. These exploration skills necessarily track where they have been so that they can plan…

Machine Learning · Computer Science 2023-06-27 Arnav Kumar Jain , Lucas Lehnert , Irina Rish , Glen Berseth

How do you incentivize self-interested agents to $\textit{explore}$ when they prefer to $\textit{exploit}$? We consider complex exploration problems, where each agent faces the same (but unknown) MDP. In contrast with traditional…

Machine Learning · Computer Science 2023-02-21 Max Simchowitz , Aleksandrs Slivkins

Empowerment has the potential to help agents learn large skillsets, but is not yet a scalable solution for training general-purpose agents. Recent empowerment methods learn diverse skillsets by maximizing the mutual information between…

Artificial Intelligence · Computer Science 2024-10-16 Andrew Levy , Alessandro Allievi , George Konidaris

Scaling reinforcement learning to tens of thousands of parallel environments requires overcoming the limited exploration capacity of a single policy. Ensemble-based policy gradient methods, which employ multiple policies to collect diverse…

Machine Learning · Computer Science 2026-03-04 Naoki Shitanda , Motoki Omura , Tatsuya Harada , Takayuki Osa

Effective exploration in reinforcement learning requires not only tracking where an agent has been, but also understanding how the agent perceives and represents the world. To learn powerful representations, an agent should actively explore…

Machine Learning · Computer Science 2026-04-21 Faisal Mohamed , Catherine Ji , Benjamin Eysenbach , Glen Berseth

Model free reinforcement learning suffers from the high sampling complexity inherent to robotic manipulation or locomotion tasks. Most successful approaches typically use random sampling strategies which leads to slow policy convergence. In…

Robotics · Computer Science 2019-08-13 Miroslav Bogdanovic , Ludovic Righetti

Language-conditioned robot behavior plays a vital role in executing complex tasks by associating human commands or instructions with perception and actions. The ability to compose long-horizon tasks based on unconstrained language…

Robotics · Computer Science 2024-02-28 Zhaoxun Ju , Chao Yang , Hongbo Wang , Yu Qiao , Fuchun Sun

Designing agent that can autonomously discover and learn a diversity of structures and skills in unknown changing environments is key for lifelong machine learning. A central challenge is how to learn incrementally representations in order…

Machine Learning · Computer Science 2020-05-14 Mayalen Etcheverry , Pierre-Yves Oudeyer , Chris Reinke

Learning a diverse set of skills by interacting with an environment without any external supervision is an important challenge. In particular, obtaining a goal-conditioned agent that can reach any given state is useful in many applications.…

Machine Learning · Computer Science 2022-06-24 Lina Mezghani , Sainbayar Sukhbaatar , Piotr Bojanowski , Karteek Alahari

Exploration in environments with sparse rewards remains a fundamental challenge in reinforcement learning (RL). Existing approaches such as curriculum learning and Go-Explore often rely on hand-crafted heuristics, while curiosity-driven…

Machine Learning · Computer Science 2026-02-03 Georgios Sotirchos , Zlatan Ajanović , Jens Kober

Autonomously learning diverse behaviors without an extrinsic reward signal has been a problem of interest in reinforcement learning. However, the nature of learning in such mechanisms is unconstrained, often resulting in the accumulation of…

Machine Learning · Computer Science 2023-03-09 Maxence Hussonnois , Thommen George Karimpanal , Santu Rana

In this survey we present different approaches that allow an intelligent agent to explore autonomous its environment to gather information and learn multiple tasks. Different communities proposed different solutions, that are in many cases,…

Artificial Intelligence · Computer Science 2014-03-07 Manuel Lopes , Luis Montesano

Numerous past works have tackled the problem of task-driven navigation. But, how to effectively explore a new environment to enable a variety of down-stream tasks has received much less attention. In this work, we study how agents can…

Robotics · Computer Science 2019-03-06 Tao Chen , Saurabh Gupta , Abhinav Gupta

With expansive state-action spaces, efficient multi-agent exploration remains a longstanding challenge in reinforcement learning. Although pursuing novelty, diversity, or uncertainty attracts increasing attention, redundant efforts brought…

Artificial Intelligence · Computer Science 2024-10-04 Yun Qu , Boyuan Wang , Yuhang Jiang , Jianzhun Shao , Yixiu Mao , Cheems Wang , Chang Liu , Xiangyang Ji

The goal of coordinated multi-robot exploration tasks is to employ a team of autonomous robots to explore an unknown environment as quickly as possible. Compared with human-designed methods, which began with heuristic and rule-based…

Artificial Intelligence · Computer Science 2019-11-06 Shuqi Liu , Zhaoxia Wu

Autonomous 3D environment exploration is a fundamental task for various applications such as navigation. The goal of exploration is to investigate a new environment and build its occupancy map efficiently. In this paper, we propose a new…

Artificial Intelligence · Computer Science 2021-11-03 Liu Juncheng , McCane Brendan , Mills Steven