English
Related papers

Related papers: Explicit-Implicit Subgoal Planning for Long-Horizo…

200 papers

Meta-learning owns unique effectiveness and swiftness in tackling emerging tasks with limited data. Its broad applicability is revealed by viewing it as a bi-level optimization problem. The resultant algorithmic viewpoint however, faces…

Machine Learning · Computer Science 2023-12-22 Yilang Zhang , Bingcong Li , Shijian Gao , Georgios B. Giannakis

The objective of this work is to augment the basic abilities of a robot by learning to use new sensorimotor primitives to enable the solution of complex long-horizon problems. Solving long-horizon problems in complex domains requires…

Robotics · Computer Science 2018-08-14 Zi Wang , Caelan Reed Garrett , Leslie Pack Kaelbling , Tomás Lozano-Pérez

This paper investigates a hybrid solution which combines deep reinforcement learning (RL) and classical trajectory planning for the following in front application. Here, an autonomous robot aims to stay ahead of a person as the person…

Robotics · Computer Science 2020-11-09 Payam Nikdel , Richard Vaughan , Mo Chen

Current reinforcement learning (RL) algorithms can be brittle and difficult to use, especially when learning goal-reaching behaviors from sparse rewards. Although supervised imitation learning provides a simple and stable alternative, it…

Machine Learning · Computer Science 2020-10-06 Dibya Ghosh , Abhishek Gupta , Ashwin Reddy , Justin Fu , Coline Devin , Benjamin Eysenbach , Sergey Levine

While using shaped rewards can be beneficial when solving sparse reward tasks, their successful application often requires careful engineering and is problem specific. For instance, in tasks where the agent must achieve some goal state,…

Artificial Intelligence · Computer Science 2019-11-05 Alexander Trott , Stephan Zheng , Caiming Xiong , Richard Socher

The ability to generalize to previously unseen tasks with little to no supervision is a key challenge in modern machine learning research. It is also a cornerstone of a future "General AI". Any artificially intelligent agent deployed in a…

Machine Learning · Computer Science 2022-07-26 Xihan Bian , Oscar Mendez , Simon Hadfield

We address the problem of Bayesian reinforcement learning using efficient model-based online planning. We propose an optimism-free Bayes-adaptive algorithm to induce deeper and sparser exploration with a theoretical bound on its performance…

Machine Learning · Computer Science 2020-06-30 Divya Grover , Debabrota Basu , Christos Dimitrakakis

Social navigation has been gaining attentions with the growth in machine intelligence. Since reinforcement learning can select an action in the prediction phase at a low computational cost, it has been formulated in a social navigation…

Robotics · Computer Science 2021-04-15 Takato Okudo , Seiji Yamada

In this work, we take a first step toward elucidating the mechanisms behind emergent exploration in unsupervised reinforcement learning. We study Single-Goal Contrastive Reinforcement Learning (SGCRL), a self-supervised algorithm capable of…

Machine Learning · Computer Science 2025-10-17 Mahsa Bastankhah , Grace Liu , Dilip Arumugam , Thomas L. Griffiths , Benjamin Eysenbach

In this paper we present ISA, an approach for learning and exploiting subgoals in episodic reinforcement learning (RL) tasks. ISA interleaves reinforcement learning with the induction of a subgoal automaton, an automaton whose edges are…

Artificial Intelligence · Computer Science 2021-03-18 Daniel Furelos-Blanco , Mark Law , Anders Jonsson , Krysia Broda , Alessandra Russo

Finding robot poses and trajectories represents a foundational aspect of robot motion planning. Despite decades of research, efficiently and robustly addressing these challenges is still difficult. Existing approaches are often plagued by…

Robotics · Computer Science 2023-11-06 Chen Liang , Xifeng Gao , Kui Wu , Zherong Pan

Path planning in a changing environment is a challenging task in robotics, as moving objects impose time-dependent constraints. Recent planning methods primarily focus on the spatial aspects, lacking the capability to directly incorporate…

Robotics · Computer Science 2024-10-29 Xi Huang , Gergely Sóti , Christoph Ledermann , Björn Hein , Torsten Kröger

World models simulate environment dynamics from raw sensory inputs like video. However, using them for planning can be challenging due to the vast and unstructured search space. We propose a robust and highly parallelizable planner that…

Machine Learning · Computer Science 2026-02-03 Michael Psenka , Michael Rabbat , Aditi Krishnapriyan , Yann LeCun , Amir Bar

We tackle the challenge of building embodied AI agents that can reliably solve long-horizon planning problems. Imitation learning from demonstrations has shown itself to be effective in training robots to solve a diversity of complex tasks…

Artificial Intelligence · Computer Science 2026-05-20 Dillon Z. Chen , Till Hofmann , Toryn Q. Klassen , Sheila A. McIlraith

Robot learning has proven to be a general and effective technique for programming manipulators. Imitation learning is able to teach robots solely from human demonstrations but is bottlenecked by the capabilities of the demonstrations.…

Robotics · Computer Science 2024-10-24 Zihan Zhou , Animesh Garg , Dieter Fox , Caelan Garrett , Ajay Mandlekar

Learning goal conditioned control in the real world is a challenging open problem in robotics. Reinforcement learning systems have the potential to learn autonomously via trial-and-error, but in practice the costs of manual reward design,…

The Sparse Generalized Eigenvalue Problem (sGEP), a pervasive challenge in statistical learning methods including sparse principal component analysis, sparse Fisher's discriminant analysis, and sparse canonical correlation analysis,…

Optimization and Control · Mathematics 2023-08-24 Qia Li , Jianmin Liao , Lixin Shen , Na Zhang

We study the problem of reinforcement learning in infinite-horizon discounted linear Markov decision processes (MDPs), and propose the first computationally efficient algorithm achieving rate-optimal regret guarantees in this setting. Our…

Machine Learning · Computer Science 2026-03-16 Antoine Moulin , Gergely Neu , Luca Viano

We present a framework for learning useful subgoals that support efficient long-term planning to achieve novel goals. At the core of our framework is a collection of rational subgoals (RSGs), which are essentially binary classifiers over…

Artificial Intelligence · Computer Science 2023-03-10 Zhezheng Luo , Jiayuan Mao , Jiajun Wu , Tomás Lozano-Pérez , Joshua B. Tenenbaum , Leslie Pack Kaelbling

The utilization of broad datasets has proven to be crucial for generalization for a wide range of fields. However, how to effectively make use of diverse multi-task data for novel downstream tasks still remains a grand challenge in…

Robotics · Computer Science 2023-04-19 Kuan Fang , Patrick Yin , Ashvin Nair , Homer Walke , Gengchen Yan , Sergey Levine