English
Related papers

Related papers: Planning Goals for Exploration

200 papers

In meta-reinforcement learning, an agent is trained in multiple different environments and attempts to learn a meta-policy that can efficiently adapt to a new environment. This paper presents RAMP, a Reinforcement learning Agent using Model…

Machine Learning · Computer Science 2022-10-28 Gabriel Hartmann , Amos Azaria

Recent works have proven that intricate cooperative behaviors can emerge in agents trained using meta reinforcement learning on open ended task distributions using self-play. While the results are impressive, we argue that self-play and…

Multiagent Systems · Computer Science 2024-05-08 Richard Bornemann , Gautier Hamon , Eleni Nisioti , Clément Moulin-Frier

Learning new skills by observing humans' behaviors is an essential capability of AI. In this work, we leverage instructional videos to study humans' decision-making processes, focusing on learning a model to plan goal-directed actions in…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Jing Bi , Jiebo Luo , Chenliang Xu

In complex tasks, such as those with large combinatorial action spaces, random exploration may be too inefficient to achieve meaningful learning progress. In this work, we use a curriculum of progressively growing action spaces to…

Machine Learning · Computer Science 2019-07-01 Gregory Farquhar , Laura Gustafson , Zeming Lin , Shimon Whiteson , Nicolas Usunier , Gabriel Synnaeve

We introduce exploration potential, a quantity that measures how much a reinforcement learning agent has explored its environment class. In contrast to information gain, exploration potential takes the problem's reward structure into…

Machine Learning · Computer Science 2016-11-21 Jan Leike

When autonomous agents interact in the same environment, they must often cooperate to achieve their goals. One way for agents to cooperate effectively is to form a team, make a binding agreement on a joint plan, and execute it. However,…

Exploration is an essential component of reinforcement learning algorithms, where agents need to learn how to predict and control unknown and often stochastic environments. Reinforcement learning agents depend crucially on exploration to…

Machine Learning · Computer Science 2021-09-03 Susan Amin , Maziar Gomrokchi , Harsh Satija , Herke van Hoof , Doina Precup

Behavioral skills or policies for autonomous agents are conventionally learned from reward functions, via reinforcement learning, or from demonstrations, via imitation learning. However, both modes of task specification have their…

Reinforcement learning (RL) agents need to explore their environments in order to learn optimal policies. In many environments and tasks, safety is of critical importance. The widespread use of simulators offers a number of advantages,…

Robotics · Computer Science 2024-03-01 Luka Kovač , Igor Farkaš

This paper studies the problem of autonomous exploration under localization uncertainty for a mobile robot with 3D range sensing. We present a framework for self-learning a high-performance exploration policy in a single simulation…

Robotics · Computer Science 2021-05-12 Fanfei Chen , Paul Szenher , Yewei Huang , Jinkun Wang , Tixiao Shan , Shi Bai , Brendan Englot

The capacity of an embodied agent to understand, predict, and interact with its environment is fundamentally contingent on an internal world model. This paper introduces a novel framework for investigating the formation and adaptation of…

Neural and Evolutionary Computing · Computer Science 2025-11-05 Brennen Hill

Efficient exploration remains a challenging problem in reinforcement learning, especially for tasks where extrinsic rewards from environments are sparse or even totally disregarded. Significant advances based on intrinsic motivation show…

Machine Learning · Computer Science 2024-04-03 Chenjia Bai , Peng Liu , Kaiyu Liu , Lingxiao Wang , Yingnan Zhao , Lei Han

Learning how to learn efficiently is a fundamental challenge for biological agents and a growing concern for artificial ones. To learn effectively, an agent must regulate its learning speed, balancing the benefits of rapid improvement…

Machine Learning · Computer Science 2026-01-13 Valentina Njaradi , Rodrigo Carrasco-Davis , Peter E. Latham , Andrew Saxe

Robotic exploration of unknown environments is fundamentally a problem of decision making under uncertainty where the robot must account for uncertainty in sensor measurements, localization, action execution, as well as many other factors.…

On-policy reinforcement learning (RL) algorithms have demonstrated great potential in robotic control, where effective exploration is crucial for efficient and high-quality policy learning. However, how to encourage the agent to explore the…

Robotics · Computer Science 2026-04-02 Leixin Chang , Xinchen Yao , Ben Liu , Liangjing Yang , Hua Chen

Embodied robotic AI systems designed to manage complex daily tasks rely on a task planner to understand and decompose high-level tasks. While most research focuses on enhancing the task-understanding abilities of LLMs/VLMs through…

Robotics · Computer Science 2025-12-23 Zhenglong Guo , Yiming Zhao , Feng Jiang , Heng Jin , Zongbao Feng , Jianbin Zhou , Siyuan Xu

Our goal in this paper is to plan the motion of a robot in a partitioned environment with dynamically changing, locally sensed rewards. We assume that arbitrary assumptions on the reward dynamics can be given. The robot aims to accomplish a…

Robotics · Computer Science 2012-08-30 Maria Svorenova , Jana Tumova , Jiri Barnat , Ivana Cerna

Humans and animals explore their environment and acquire useful skills even in the absence of clear goals, exhibiting intrinsic motivation. The study of intrinsic motivation in artificial agents is concerned with the following question:…

Machine Learning · Computer Science 2021-12-08 Nicholas Rhinehart , Jenny Wang , Glen Berseth , John D. Co-Reyes , Danijar Hafner , Chelsea Finn , Sergey Levine

We present a method for learning intrinsic reward functions to drive the learning of an agent during periods of practice in which extrinsic task rewards are not available. During practice, the environment may differ from the one available…

Artificial Intelligence · Computer Science 2019-12-17 Janarthanan Rajendran , Richard Lewis , Vivek Veeriah , Honglak Lee , Satinder Singh

Although exploratory behaviors are ubiquitous in the animal kingdom, their computational underpinnings are still largely unknown. Behavioral Psychology has identified learning as a primary drive underlying many exploratory behaviors.…

Machine Learning · Computer Science 2011-12-14 Daniel Y. Little , Friedrich T. Sommer