English
Related papers

Related papers: Context-Sensitive Abstractions for Reinforcement L…

200 papers

In this paper we consider self-supervised representation learning to improve sample efficiency in reinforcement learning (RL). We propose a forward prediction objective for simultaneously learning embeddings of states and action sequences.…

Machine Learning · Computer Science 2020-01-15 William Whitney , Rajat Agarwal , Kyunghyun Cho , Abhinav Gupta

Temporal abstraction in reinforcement learning (RL), offers the promise of improving generalization and knowledge transfer in complex environments, by propagating information more efficiently over time. Although option learning was…

Machine Learning · Computer Science 2021-12-07 Martin Klissarov , Doina Precup

Reinforcement Learning (RL) serves as a versatile framework for sequential decision-making, finding applications across diverse domains such as robotics, autonomous driving, recommendation systems, supply chain optimization, biology,…

Machine Learning · Computer Science 2024-08-26 Vaneet Aggarwal , Washim Uddin Mondal , Qinbo Bai

Reinforcement learning (RL) has been successful in training agents in various learning environments, including video-games. However, such work modifies and shrinks the action space from the game's original. This is to avoid trying…

Artificial Intelligence · Computer Science 2020-05-27 Anssi Kanervisto , Christian Scheller , Ville Hautamäki

Skills are temporal abstractions that are intended to improve reinforcement learning (RL) performance through hierarchical RL. Despite our intuition about the properties of an environment that make skills useful, a precise characterization…

Machine Learning · Computer Science 2024-06-13 Zhening Li , Gabriel Poesia , Armando Solar-Lezama

Reinforcement learning (RL) on high-dimensional and complex problems relies on abstraction for improved efficiency and generalization. In this paper, we study abstraction in the continuous-control setting, and extend the definition of…

Machine Learning · Computer Science 2024-03-08 Prakash Panangaden , Sahand Rezaei-Shoshtari , Rosie Zhao , David Meger , Doina Precup

Recent work has shown that reinforcement learning (RL) is a promising approach to control dynamical systems described by partial differential equations (PDE). This paper shows how to use RL to tackle more general PDE control problems that…

Machine Learning · Computer Science 2018-06-20 Yangchen Pan , Amir-massoud Farahmand , Martha White , Saleh Nabi , Piyush Grover , Daniel Nikovski

Accuracy and generalization of dynamics models is key to the success of model-based reinforcement learning (MBRL). As the complexity of tasks increases, so does the sample inefficiency of learning accurate dynamics models. However, many…

Machine Learning · Computer Science 2021-06-08 Manan Tomar , Amy Zhang , Roberto Calandra , Matthew E. Taylor , Joelle Pineau

Despite recent success of deep network-based Reinforcement Learning (RL), it remains elusive to achieve human-level efficiency in learning novel tasks. While previous efforts attempt to address this challenge using meta-learning strategies,…

Machine Learning · Computer Science 2022-05-03 Haozhe Wang , Jiale Zhou , Xuming He

Reinforcement Learning (RL) is a method for learning decision-making tasks that could enable robots to learn and adapt to their situation on-line. For an RL algorithm to be practical for robotic control tasks, it must learn in very few…

Artificial Intelligence · Computer Science 2015-03-19 Todd Hester , Michael Quinlan , Peter Stone

Sampling-based motion planning is a well-established approach in autonomous driving, valued for its modularity and analytical tractability. In complex urban scenarios, however, uniform or heuristic sampling often produces many infeasible or…

Robotics · Computer Science 2026-03-24 Korbinian Moller , Roland Stroop , Mattia Piccinini , Alexander Langmann , Johannes Betz

Being able to reason in an environment with a large number of discrete actions is essential to bringing reinforcement learning to a larger class of problems. Recommender systems, industrial plants and language models are only some of the…

There are relatively few conventions followed in reinforcement learning (RL) environments to structure the action spaces. As a consequence the application of RL algorithms to tasks with large action spaces with multiple components require…

Machine Learning · Computer Science 2021-04-16 Christopher Bamford , Alvaro Ovalle

We propose a novel parameterized skill-learning algorithm that aims to learn transferable parameterized skills and synthesize them into a new action space that supports efficient learning in long-horizon tasks. We propose to leverage…

Machine Learning · Computer Science 2023-07-20 Haotian Fu , Shangqun Yu , Saket Tiwari , Michael Littman , George Konidaris

Deep reinforcement learning (RL) algorithms can learn complex policies to optimize agent operation over time. RL algorithms have shown promising results in solving complicated problems in recent years. However, their application on…

Machine Learning · Computer Science 2021-09-29 Hamed Khorasgani , Haiyan Wang , Chetan Gupta , Susumu Serita

Deep reinforcement learning enables algorithms to learn complex behavior, deal with continuous action spaces and find good strategies in environments with high dimensional state spaces. With deep reinforcement learning being an active area…

Machine Learning · Computer Science 2018-10-17 Winfried Lötzsch

As a key component to intuitive cognition and reasoning solutions in human intelligence, causal knowledge provides great potential for reinforcement learning (RL) agents' interpretability towards decision-making by helping reduce the…

Machine Learning · Computer Science 2025-04-25 Ruichu Cai , Siyang Huang , Jie Qiao , Wei Chen , Yan Zeng , Keli Zhang , Fuchun Sun , Yang Yu , Zhifeng Hao

This paper presents a framework for learning state and action abstractions in sequential decision-making domains. Our framework, planning abstraction from language (PARL), utilizes language-annotated demonstrations to automatically discover…

Robotics · Computer Science 2024-05-08 Weiyu Liu , Geng Chen , Joy Hsu , Jiayuan Mao , Jiajun Wu

State abstraction is an effective technique for planning in robotics environments with continuous states and actions, long task horizons, and sparse feedback. In object-oriented environments, predicates are a particularly useful form of…

Robotics · Computer Science 2023-06-21 Amber Li , Tom Silver

Reinforcement learning (RL) provides a naturalistic framing for learning through trial and error, which is appealing both because of its simplicity and effectiveness and because of its resemblance to how humans and animals acquire skills…

Machine Learning · Computer Science 2022-08-09 Archit Sharma , Kelvin Xu , Nikhil Sardana , Abhishek Gupta , Karol Hausman , Sergey Levine , Chelsea Finn