English
Related papers

Related papers: Subgoal-Guided Policy Heuristic Search with Learne…

200 papers

Hierarchical reinforcement learning (HRL) learns to make decisions on multiple levels of temporal abstraction. A key challenge in HRL is that the low-level policy changes over time, making it difficult for the high-level policy to generate…

Machine Learning · Computer Science 2025-05-29 Vivienne Huiling Wang , Tinghuai Wang , Joni Pajarinen

Long-horizon planning in realistic environments requires the ability to reason over sequential tasks in high-dimensional state spaces with complex dynamics. Classical motion planning algorithms, such as rapidly-exploring random trees, are…

Robotics · Computer Science 2020-10-14 Brian Ichter , Pierre Sermanet , Corey Lynch

We present a study of several generic tree search techniques applied to the Sequential Ordering Problem. This study enables us to propose a simple and competitive tree search algorithm. It consists of an iterative Beam Search algorithm that…

Discrete Mathematics · Computer Science 2020-01-26 Luc Libralesso , Abdel-Malik Bouhassoun , Hadrien Cambazard , Vincent Jost

Industrial robots can solve very complex tasks in controlled environments, but modern applications require robots able to operate in unpredictable surroundings as well. An increasingly popular reactive policy architecture in robotics is…

Robotics · Computer Science 2021-03-17 Jonathan Styrud , Matteo Iovino , Mikael Norrlöf , Mårten Björkman , Christian Smith

The process of discovery requires active exploration -- the act of collecting new and informative data. However, efficient autonomous exploration remains a major unsolved problem. The dominant paradigm addresses this challenge by using…

Machine Learning · Computer Science 2026-05-14 Zakaria Mhammedi , James Cohan

Consider an agent exploring an unknown graph in search of some goal state. As it walks around the graph, it learns the nodes and their neighbors. The agent only knows where the goal state is when it reaches it. How do we reach this goal…

Data Structures and Algorithms · Computer Science 2023-01-02 Siddhartha Banerjee , Vincent Cohen-Addad , Anupam Gupta , Zhouzi Li

Learning effective policies for sparse objectives is a key challenge in Deep Reinforcement Learning (RL). A common approach is to design task-related dense rewards to improve task learnability. While such rewards are easily interpreted,…

Machine Learning · Computer Science 2020-10-12 Hassam Sheikh , Shauharda Khadka , Santiago Miret , Somdeb Majumdar

In this work, we address the challenging problem of long-horizon goal-reaching policy learning from non-expert, action-free observation data. Unlike fully labeled expert data, our data is more accessible and avoids the costly process of…

Machine Learning · Computer Science 2024-09-09 RenMing Huang , Shaochong Liu , Yunqiang Pei , Peng Wang , Guoqing Wang , Yang Yang , Hengtao Shen

Continuous action policy search is currently the focus of intensive research, driven both by the recent success of deep reinforcement learning algorithms and the emergence of competitors based on evolutionary algorithms. In this paper, we…

Machine Learning · Computer Science 2019-06-14 Olivier Sigaud , Freek Stulp

A longstanding objective in classical planning is to synthesize policies that generalize across multiple problems from the same domain. In this work, we study generalized policy search-based methods with a focus on the score function used…

Artificial Intelligence · Computer Science 2022-04-25 Ryan Yang , Tom Silver , Aidan Curtis , Tomas Lozano-Perez , Leslie Pack Kaelbling

A treap is a classic randomized binary search tree data structure that is easy to implement and supports O(\log n) expected time access. However, classic treaps do not take advantage of the input distribution or patterns in the input. Given…

Data Structures and Algorithms · Computer Science 2022-06-27 Honghao Lin , Tian Luo , David P. Woodruff

We present an algorithm for local, regularized, policy improvement in reinforcement learning (RL) that allows us to formulate model-based and model-free variants in a single framework. Our algorithm can be interpreted as a natural extension…

This paper proposes a new algorithm for learning accurate tree-based models while ensuring the existence of recourse actions. Algorithmic Recourse (AR) aims to provide a recourse action for altering the undesired prediction result given by…

Machine Learning · Computer Science 2024-06-04 Kentaro Kanamori , Takuya Takagi , Ken Kobayashi , Yuichi Ike

Building models of human decision-making from observed behaviour is critical to better understand, diagnose and support real-world policies such as clinical care. As established policy learning approaches remain focused on imitation…

Machine Learning · Computer Science 2022-10-03 Alizée Pace , Alex J. Chan , Mihaela van der Schaar

We propose a novel Reinforcement Learning model for discrete environments, which is inherently interpretable and supports the discovery of deep subgoal hierarchies. In the model, an agent learns information about environment in the form of…

Artificial Intelligence · Computer Science 2022-02-16 Alexander Demin , Denis Ponomaryov

This paper is concerned with the approximation of high-dimensional functions in a statistical learning setting, by empirical risk minimization over model classes of functions in tree-based tensor format. These are particular classes of…

Machine Learning · Statistics 2019-01-15 Erwan Grelier , Anthony Nouy , Mathilde Chevreuil

Building an AI agent that can design on its own has been a goal since the 1980s. Recently, deep learning has shown the ability to learn from large-scale data, enabling significant advances in data-driven design. However, learning over prior…

Machine Learning · Computer Science 2022-11-29 Ayush Raina , Jonathan Cagan , Christopher McComb

Recently, graph-based planning algorithms have gained much attention to solve goal-conditioned reinforcement learning (RL) tasks: they provide a sequence of subgoals to reach the target-goal, and the agents learn to execute…

Machine Learning · Computer Science 2023-03-21 Junsu Kim , Younggyo Seo , Sungsoo Ahn , Kyunghwan Son , Jinwoo Shin

We introduce an adaptive tree search algorithm, that can find high-scoring outputs under translation models that make no assumptions about the form or structure of the search objective. This algorithm -- a deterministic variant of Monte…

Computation and Language · Computer Science 2022-02-24 Wang Ling , Wojciech Stokowiec , Domenic Donato , Laurent Sartran , Lei Yu , Austin Matthews , Chris Dyer

Supervised approaches for text summarisation suffer from the problem of mismatch between the target labels/scores of individual sentences and the evaluation score of the final summary. Reinforcement learning can solve this problem by…

Computation and Language · Computer Science 2017-11-15 Diego Molla