English
Related papers

Related papers: Hierarchical Policy Learning is Sensitive to Goal …

200 papers

Hierarchical reinforcement learning deals with the problem of breaking down large tasks into meaningful sub-tasks. Autonomous discovery of these sub-tasks has remained a challenging problem. We propose a novel method of learning sub-tasks…

Machine Learning · Computer Science 2019-02-19 Saket Tiwari , M. Prannoy

The use of deep neural networks as function approximators has led to striking progress for reinforcement learning algorithms and applications. Yet the knowledge we have on decision boundary geometry and the loss landscape of neural policies…

Machine Learning · Computer Science 2021-12-17 Ezgi Korkmaz

State of the art reinforcement learning has enabled training agents on tasks of ever increasing complexity. However, the current paradigm tends to favor training agents from scratch on every new task or on collections of tasks with a view…

Machine Learning · Computer Science 2023-02-09 Jacob Walker , Eszter Vértes , Yazhe Li , Gabriel Dulac-Arnold , Ankesh Anand , Théophane Weber , Jessica B. Hamrick

What goals should a multi-goal reinforcement learning agent pursue during training in long-horizon tasks? When the desired (test time) goal distribution is too distant to offer a useful learning signal, we argue that the agent should not…

Machine Learning · Computer Science 2020-07-07 Silviu Pitis , Harris Chan , Stephen Zhao , Bradly Stadie , Jimmy Ba

Reinforcement Learning (RL) has proven highly effective at enhancing the complex reasoning abilities of Large Language Models (LLMs), yet underlying mechanisms driving this success remain largely opaque. Our analysis reveals that puzzling…

Artificial Intelligence · Computer Science 2025-09-30 Haozhe Wang , Qixin Xu , Che Liu , Junhong Wu , Fangzhen Lin , Wenhu Chen

Model-Based Reinforcement Learning involves learning a \textit{dynamics model} from data, and then using this model to optimise behaviour, most often with an online \textit{planner}. Much of the recent research along these lines presents a…

Complex, long-horizon planning and its combinatorial nature pose steep challenges for learning-based agents. Difficulties in such settings are exacerbated in low data regimes where over-fitting stifles generalization and compounding errors…

Machine Learning · Computer Science 2023-06-23 Joey Hejna , Pieter Abbeel , Lerrel Pinto

In order to model an efficient learning paradigm, iterative learning algorithms access data one by one, updating the current hypothesis without regress to past data. Past research on iterative learning analyzed for example many important…

Machine Learning · Computer Science 2021-04-29 Ardalan Khazraei , Timo Kötzing , Karen Seidel

We extend the standard reinforcement learning framework to random time horizons. While the classical setting typically assumes finite and deterministic or infinite runtimes of trajectories, we argue that multiple real-world applications…

Machine Learning · Computer Science 2025-08-15 Enric Ribera Borrell , Lorenz Richter , Christof Schütte

We consider a Continual Reinforcement Learning setup, where a learning agent must continuously adapt to new tasks while retaining previously acquired skill sets, with a focus on the challenge of avoiding forgetting past gathered knowledge…

Machine Learning · Computer Science 2026-02-06 Anthony Kobanda , Rémy Portelas , Odalric-Ambrym Maillard , Ludovic Denoyer

Learning to locomote to arbitrary goals on hardware remains a challenging problem for reinforcement learning. In this paper, we present a hierarchical learning framework that improves sample-efficiency and generalizability of locomotion…

Robotics · Computer Science 2019-09-30 Tianyu Li , Nathan Lambert , Roberto Calandra , Franziska Meier , Akshara Rai

Deep Reinforcement Learning (DRL) has become a powerful methodology to solve complex decision-making problems. However, DRL has several limitations when used in real-world problems (e.g., robotics applications). For instance, long training…

Robotics · Computer Science 2019-08-15 Rodrigo Pérez-Dattari , Carlos Celemin , Javier Ruiz-del-Solar , Jens Kober

Following the pivotal success of learning strategies to win at tasks, solely by interacting with an environment without any supervision, agents have gained the ability to make sequential decisions in complex MDPs. Yet, reinforcement…

Machine Learning · Computer Science 2026-03-18 Ezgi Korkmaz

This paper proposes a policy-based deep reinforcement learning hyper-heuristic framework for solving the Job Shop Scheduling Problem. The hyper-heuristic agent learns to switch scheduling rules based on the system state dynamically. We…

Artificial Intelligence · Computer Science 2026-01-19 Sofiene Lassoued , Asrat Gobachew , Stefan Lier , Andreas Schwung

Object packing by autonomous robots is an im-portant challenge in warehouses and logistics industry. Most conventional data-driven packing planning approaches focus on regular cuboid packing, which are usually heuristic and limit the…

Robotics · Computer Science 2022-11-18 Sichao Huang , Ziwei Wang , Jie Zhou , Jiwen Lu

Machine learning is now ubiquitous in societal decision-making, for example in evaluating job candidates or loan applications, and it is increasingly important to take into account how classified agents will react to the learning…

Machine Learning · Computer Science 2025-08-08 Dravyansh Sharma , Alec Sun

The interpretation of spatial references is highly contextual, requiring joint inference over both language and the environment. We consider the task of spatial reasoning in a simulated environment, where an agent can act and receive…

Computation and Language · Computer Science 2017-11-15 Michael Janner , Karthik Narasimhan , Regina Barzilay

Reinforcement learning agents that operate in diverse and complex environments can benefit from the structured decomposition of their behavior. Often, this is addressed in the context of hierarchical reinforcement learning, where the aim is…

Machine Learning · Computer Science 2019-06-26 Anirudh Goyal , Shagun Sodhani , Jonathan Binas , Xue Bin Peng , Sergey Levine , Yoshua Bengio

It is desirable for an agent to be able to solve a rich variety of problems that can be specified through language in the same environment. A popular approach towards obtaining such agents is to reuse skills learned in prior tasks to…

Machine Learning · Computer Science 2024-03-19 Geraud Nangue Tasse , Devon Jarvis , Steven James , Benjamin Rosman

Real-world autonomous decision-making systems, from robots to recommendation engines, must operate in environments that change over time. While deep reinforcement learning (RL) has shown an impressive ability to learn optimal policies in…

Machine Learning · Computer Science 2025-05-16 Jonathan Clifford Balloch