English
Related papers

Related papers: CAMPs: Learning Context-Specific Abstractions for …

200 papers

Offline meta-reinforcement learning aims to equip agents with the ability to rapidly adapt to new tasks by training on data from a set of different tasks. Context-based approaches utilize a history of state-action-reward transitions --…

Machine Learning · Computer Science 2025-01-23 Mohammadreza Nakhaei , Aidan Scannell , Joni Pajarinen

We study how a Reinforcement Learning (RL) system can remain sample-efficient when learning from an imperfect model of the environment. This is particularly challenging when the learning system is resource-constrained and in continual…

Machine Learning · Computer Science 2024-07-01 Bradley Burega , John D. Martin , Luke Kapeluck , Michael Bowling

We investigated the human capacity to acquire multiple visuomotor mappings for de novo skills. Using a grid navigation paradigm, we tested whether contextual cues implemented as different "grid worlds", allow participants to learn two…

Neurons and Cognition · Quantitative Biology 2024-02-06 Carlos A. Velazquez-Vargas , Isaac Ray Christian , Jordan A. Taylor , Sreejan Kumar

Policy gradient methods are among the most effective methods in challenging reinforcement learning problems with large state and/or action spaces. However, little is known about even their most basic theoretical convergence properties,…

Machine Learning · Computer Science 2020-10-16 Alekh Agarwal , Sham M. Kakade , Jason D. Lee , Gaurav Mahajan

Platooning connected and autonomous vehicles (CAVs) provide significant benefits in terms of traffic efficiency and fuel economy. However, most existing platooning systems assume the availability of pre-determined plans, which is not…

Systems and Control · Electrical Eng. & Systems 2023-08-09 Xi Xiong , Maonan Wang , Dengfeng Sun , Li Jin

This study informs the design of future multi-agent pathfinding (MAPF) and multi-robot motion planning (MRMP) algorithms by guiding choices based on constraint classification for constraint-based search algorithms. We categorize constraints…

Robotics · Computer Science 2025-11-25 Hannah Lee , James D. Motes , Marco Morales , Nancy M. Amato

State abstraction is an effective technique for planning in robotics environments with continuous states and actions, long task horizons, and sparse feedback. In object-oriented environments, predicates are a particularly useful form of…

Robotics · Computer Science 2023-06-21 Amber Li , Tom Silver

We present a framework for learning to plan hierarchically in domains with unknown dynamics. We enhance planning performance by exploiting problem structure in several ways: (i) We simplify the search over plans by leveraging knowledge of…

Artificial Intelligence · Computer Science 2019-06-19 Philippe Morere , Lionel Ott , Fabio Ramos

Deploying reinforcement learning policies in the real world requires adapting to time-varying environments. We study this problem in the contextual Markov Decision Process (cMDP) framework, where a family of environments is indexed by a…

Machine Learning · Computer Science 2026-05-04 Param Budhraja , Aditya Gangrade , Alex Olshevsky , Venkatesh Saligrama

Partially observable Markov decision processes (POMDPs) are a powerful abstraction for tasks that require decision making under uncertainty, and capture a wide range of real world tasks. Today, effective planning approaches exist that…

Machine Learning · Statistics 2018-05-24 Sebastian Tschiatschek , Kai Arulkumaran , Jan Stühmer , Katja Hofmann

To solve complex tasks, individuals often autonomously organize in teams. Examples of complex tasks include disaster relief rescue operations or project development in consulting. The teams that work on such tasks are adaptive at multiple…

General Economics · Economics 2021-03-04 Darío Blanco-Fernández , Stephan Leitner , Alexandra Rausch

We study capacity- and budget-constrained multi-agent MDPs (CB-MA-MDPs), a class that captures many maintenance and scheduling tasks in which each agent can irreversibly fail and a planner must decide (i) when to apply a restorative action…

Machine Learning · Computer Science 2025-10-08 Manav Vora , Ilan Shomorony , Melkior Ornik

Language model (LM)-based agents have demonstrated promising capabilities in automating complex tasks from natural language instructions, yet they continue to struggle with long-horizon planning and reasoning. To address this, we propose an…

Artificial Intelligence · Computer Science 2026-05-05 Wenyi Wu , Sibo Zhu , Kun Zhou , Biwei Huang

Fine-grained simulation of floor construction processes is essential for supporting lean management and the integration of information technology. However, existing research does not adequately address the on-site decision-making of…

Computational Engineering, Finance, and Science · Computer Science 2024-09-04 Bin Yang , Boda Liu , Yilong Han , Xin Meng , Yifan Wang , Hansi Yang , Jianzhuang Xia

Reinforcement learning agents that operate in diverse and complex environments can benefit from the structured decomposition of their behavior. Often, this is addressed in the context of hierarchical reinforcement learning, where the aim is…

Machine Learning · Computer Science 2019-06-26 Anirudh Goyal , Shagun Sodhani , Jonathan Binas , Xue Bin Peng , Sergey Levine , Yoshua Bengio

A mobility map, which provides maximum achievable speed on a given terrain, is essential for path planning of autonomous ground vehicles in off-road settings. While physics-based simulations play a central role in creating next-generation,…

Machine Learning · Computer Science 2020-03-10 Gary R. Marple , David Gorsich , Paramsothy Jayakumar , Shravan Veerapaneni

Sequential decision-making in high-dimensional continuous action spaces, particularly in stochastic environments, faces significant computational challenges. We explore this challenge in the traditional offline RL setting, where an agent…

Machine Learning · Computer Science 2025-03-04 Baiting Luo , Ava Pettet , Aron Laszka , Abhishek Dubey , Ayan Mukhopadhyay

The Constrained Markov Decision Process (CMDP) formulation allows to solve safety-critical decision making tasks that are subject to constraints. While CMDPs have been extensively studied in the Reinforcement Learning literature, little…

Machine Learning · Computer Science 2024-10-29 Dinesh Parthasarathy , Georgios Kontes , Axel Plinge , Christopher Mutschler

This work exploits action equivariance for representation learning in reinforcement learning. Equivariance under actions states that transitions in the input space are mirrored by equivalent transitions in latent space, while the map and…

Machine Learning · Computer Science 2020-02-28 Elise van der Pol , Thomas Kipf , Frans A. Oliehoek , Max Welling

We introduce an efficient optimization-based meta-learning technique for large-scale neural field training by realizing significant memory savings through automated online context point selection. This is achieved by focusing each learning…

Machine Learning · Computer Science 2023-10-25 Jihoon Tack , Subin Kim , Sihyun Yu , Jaeho Lee , Jinwoo Shin , Jonathan Richard Schwarz