English
Related papers

Related papers: Bisimulation Makes Analogies in Goal-Conditioned R…

200 papers

We design a simple reinforcement learning (RL) agent that implements an optimistic version of $Q$-learning and establish through regret analysis that this agent can operate with some level of competence in any environment. While we leverage…

Machine Learning · Computer Science 2021-07-13 Shi Dong , Benjamin Van Roy , Zhengyuan Zhou

We propose a novel approach to learn goal-conditioned policies for locomotion in a batch RL setting. The batch data is collected by a policy that is not goal-conditioned. For the locomotion task, this translates to data collection using a…

Machine Learning · Computer Science 2020-04-20 Aditi Mavalankar

Real-world reinforcement learning (RL) environments, whether in robotics or industrial settings, often involve non-visual observations and require not only efficient but also reliable and thus interpretable and flexible RL approaches. To…

Machine Learning · Computer Science 2024-02-19 Moritz Lange , Noah Krystiniak , Raphael C. Engelhardt , Wolfgang Konen , Laurenz Wiskott

We are interested in the autonomous acquisition of repertoires of skills. Language-conditioned reinforcement learning (LC-RL) approaches are great tools in this quest, as they allow to express abstract goals as sets of constraints on the…

Artificial Intelligence · Computer Science 2021-01-26 Ahmed Akakzia , Cédric Colas , Pierre-Yves Oudeyer , Mohamed Chetouani , Olivier Sigaud

Reinforcement Learning (RL) environments can produce training data with spurious correlations between features due to the amount of training data or its limited feature coverage. This can lead to RL agents encoding these misleading…

Machine Learning · Computer Science 2023-10-13 Mhairi Dunion , Trevor McInroe , Kevin Sebastian Luck , Josiah P. Hanna , Stefano V. Albrecht

Learning generalist embodied agents, able to solve multitudes of tasks in different domains is a long-standing problem. Reinforcement learning (RL) is hard to scale up as it requires a complex reward design for each task. In contrast,…

Artificial Intelligence · Computer Science 2024-11-01 Pietro Mazzaglia , Tim Verbelen , Bart Dhoedt , Aaron Courville , Sai Rajeswar

Safe navigation is essential for autonomous systems operating in hazardous environments. Traditional planning methods excel at long-horizon tasks but rely on a predefined graph with fixed distance metrics. In contrast, safe Reinforcement…

Robotics · Computer Science 2025-09-12 Meng Feng , Viraj Parimi , Brian Williams

The success of Reinforcement Learning (RL) heavily relies on the ability to learn robust representations from the observations of the environment. In most cases, the representations learned purely by the reinforcement learning loss can…

Machine Learning · Computer Science 2024-02-12 Somjit Nath , Rushiv Arora , Samira Ebrahimi Kahou

Teaching an agent to perform new tasks using natural language can easily be hindered by ambiguities in interpretation. When a teacher provides an instruction to a learner about an object by referring to its features, the learner can…

Machine Learning · Computer Science 2023-09-28 Hugo Caselles-Dupré , Olivier Sigaud , Mohamed Chetouani

We study the problem of representation learning in goal-conditioned hierarchical reinforcement learning. In such hierarchical structures, a higher-level controller solves tasks by iteratively communicating goals which a lower-level policy…

Artificial Intelligence · Computer Science 2019-01-10 Ofir Nachum , Shixiang Gu , Honglak Lee , Sergey Levine

Reinforcement Learning (RL) can enable agents to learn complex tasks. However, it is difficult to interpret the knowledge and reuse it across tasks. Inductive biases can address such issues by explicitly providing generic yet useful…

Artificial Intelligence · Computer Science 2022-12-13 Thomas Schnürer , Malte Probst , Horst-Michael Gross

Many relevant tasks require an agent to reach a certain state, or to manipulate objects into a desired configuration. For example, we might want a robot to align and assemble a gear onto an axle or insert and turn a key in a lock. These…

Artificial Intelligence · Computer Science 2018-07-24 Carlos Florensa , David Held , Markus Wulfmeier , Michael Zhang , Pieter Abbeel

Accuracy and generalization of dynamics models is key to the success of model-based reinforcement learning (MBRL). As the complexity of tasks increases, so does the sample inefficiency of learning accurate dynamics models. However, many…

Machine Learning · Computer Science 2021-06-08 Manan Tomar , Amy Zhang , Roberto Calandra , Matthew E. Taylor , Joelle Pineau

Object-centric representations have recently enabled significant progress in tackling relational reasoning tasks. By building a strong object-centric inductive bias into neural architectures, recent efforts have improved generalization and…

Machine Learning · Computer Science 2021-04-20 Wenling Shang , Lasse Espeholt , Anton Raichuk , Tim Salimans

Model-based reinforcement learning (RL) enjoys several benefits, such as data-efficiency and planning, by learning a model of the environment's dynamics. However, learning a global model that can generalize across different dynamics is a…

Machine Learning · Computer Science 2020-06-30 Kimin Lee , Younggyo Seo , Seunghyun Lee , Honglak Lee , Jinwoo Shin

Reinforcement learning (RL) combines a control problem with statistical estimation: The system dynamics are not known to the agent, but can be learned through experience. A recent line of research casts `RL as inference' and suggests a…

Machine Learning · Computer Science 2020-11-05 Brendan O'Donoghue , Ian Osband , Catalin Ionescu

Learning a control policy capable of adapting to time-varying and potentially evolving system dynamics has been a great challenge to the mainstream reinforcement learning (RL). Mainly, the ever-changing system properties would continuously…

Machine Learning · Computer Science 2022-08-31 Po-Hsiang Chiu , Manfred Huber

Teams of people coordinate to perform complex tasks by forming abstract mental models of world and agent dynamics. The use of abstract models contrasts with much recent work in robot learning that uses a high-fidelity simulator and…

Robotics · Computer Science 2025-03-10 Adam Labiosa , Josiah P. Hanna

Goal-conditioned reinforcement learning is a crucial yet challenging algorithm which enables agents to achieve multiple user-specified goals when learning a set of skills in a dynamic environment. However, it typically requires millions of…

Robotics · Computer Science 2022-03-01 Zhifeng Qian , Mingyu You , Hongjun Zhou , Bin He

Vision-language models (VLMs) have tremendous potential for grounding language, and thus enabling language-conditioned agents (LCAs) to perform diverse tasks specified with text. This has motivated the study of LCAs based on reinforcement…

Artificial Intelligence · Computer Science 2024-11-27 Theo Cachet , Christopher R. Dance , Olivier Sigaud