English
Related papers

Related papers: Scalable Decision-Making in Stochastic Environment…

200 papers

Long-horizon decision-making with sparse rewards and continuous states and actions remains a fundamental challenge in AI and robotics. Task and motion planning (TAMP) is a model-based framework that addresses this challenge by planning…

Robotics · Computer Science 2026-03-03 Y. Isabel Liu , Bowen Li , Benjamin Eysenbach , Tom Silver

Multi-Agent Path Finding (MAPF) poses a significant and challenging problem critical for applications in robotics and logistics, particularly due to its combinatorial complexity and the partial observability inherent in realistic…

Multiagent Systems · Computer Science 2025-09-29 Merve Atasever , Matthew Hong , Mihir Nitin Kulkarni , Qingpei Li , Jyotirmoy V. Deshmukh

In offline reinforcement learning, a policy is learned using a static dataset in the absence of costly feedback from the environment. In contrast to the online setting, only using static datasets poses additional challenges, such as…

Machine Learning · Computer Science 2025-12-16 Marvin Alles , Philip Becker-Ehmck , Patrick van der Smagt , Maximilian Karl

Planning methods can solve temporally extended sequential decision making problems by composing simple behaviors. However, planning requires suitable abstractions for the states and transitions, which typically need to be designed by hand.…

Machine Learning · Computer Science 2019-11-20 Soroush Nasiriany , Vitchyr H. Pong , Steven Lin , Sergey Levine

Reinforcement learning-based path planning for multi-agent systems of varying size constitutes a research topic with increasing significance as progress in domains such as urban air mobility and autonomous aerial vehicles continues.…

Robotics · Computer Science 2022-03-22 Marc R. Schlichting , Stefan Notter , Walter Fichter

Learning and planning with latent space dynamics has been shown to be useful for sample efficiency in model-based reinforcement learning (MBRL) for discrete and continuous control tasks. In particular, recent work, for discrete action…

Machine Learning · Computer Science 2020-10-21 Anurag Koul , Varun V. Kumar , Alan Fern , Somdeb Majumdar

Deep reinforcement learning (RL) algorithms can use high-capacity deep networks to learn directly from image observations. However, these high-dimensional observation spaces present a number of challenges in practice, since the policy must…

Machine Learning · Computer Science 2020-10-27 Alex X. Lee , Anusha Nagabandi , Pieter Abbeel , Sergey Levine

This paper presents Latent Sampling-based Motion Planning (L-SBMP), a methodology towards computing motion plans for complex robotic systems by learning a plannable latent representation. Recent works in control of robotic systems have…

Robotics · Computer Science 2018-11-07 Brian Ichter , Marco Pavone

Real-time planning for a combined problem of target assignment and path planning for multiple agents, also known as the unlabeled version of Multi-Agent Path Finding (MAPF), is crucial for high-level coordination in multi-agent systems,…

Robotics · Computer Science 2022-03-01 Keisuke Okumura , Xavier Défago

A long-standing goal in AI is to develop agents capable of solving diverse tasks across a range of environments, including those never seen during training. Two dominant paradigms address this challenge: (i) reinforcement learning (RL),…

Machine Learning · Computer Science 2025-10-30 Vlad Sobal , Wancong Zhang , Kyunghyun Cho , Randall Balestriero , Tim G. J. Rudner , Yann LeCun

Exploration capacity shapes both inference-time performance and reinforcement learning (RL) training for large (vision-) language models, as stochastic sampling often yields redundant reasoning paths with little high-level diversity. This…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Rujiao Long , Yang Li , Xingyao Zhang , Weixun Wang , Tianqianjin Lin , Xi Zhao , Yuchi Xu , Wenbo Su , Junchi Yan , Bo Zheng

Planning in learned latent spaces helps to decrease the dimensionality of raw observations. In this work, we propose to leverage the ensemble paradigm to enhance the robustness of latent planning systems. We rely on our Latent Space Roadmap…

Robotics · Computer Science 2023-03-28 Martina Lippi , Michael C. Welle , Andrea Gasparri , Danica Kragic

Sequential planning in large state space and action space quickly becomes intractable due to combinatorial explosion of the search space. Heuristic methods, like monte-carlo tree search, though effective for large state space, but struggle…

Artificial Intelligence · Computer Science 2023-12-13 Swarna Kamal Paul

For an intelligent agent to flexibly and efficiently operate in complex environments, they must be able to reason at multiple levels of temporal, spatial, and conceptual abstraction. At the lower levels, the agent must interpret their…

Robotics · Computer Science 2020-06-12 Nishad Gothoskar , Miguel Lázaro-Gredilla , Dileep George

We present a framework for visual action planning of complex manipulation tasks with high-dimensional state spaces such as manipulation of deformable objects. Planning is performed in a low-dimensional latent state space that embeds images.…

Large language models (LLMs) have shown significant potential in guiding embodied agents to execute language instructions across a range of tasks, including robotic manipulation and navigation. However, existing methods are primarily…

When learning to act in a stochastic, partially observable environment, an intelligent agent should be prepared to anticipate a change in its belief of the environment state, and be capable of adapting its actions on-the-fly to changing…

Machine Learning · Computer Science 2022-04-14 Ugo Lecerf , Christelle Yemdji-Tchassi , Pietro Michiardi

AI agents need to plan to achieve complex goals that involve orchestrating perception, sub-goal decomposition, and execution. These plans consist of ordered steps structured according to a Temporal Execution Order (TEO, a directed acyclic…

Artificial Intelligence · Computer Science 2026-02-17 Gabriel Roccabruna , Olha Khomyn , Giuseppe Riccardi

The safe deployment of autonomous vehicles relies on their ability to effectively react to environmental changes. This can require maneuvering on varying surfaces which is still a difficult problem, especially for slippery terrains. To…

Robotics · Computer Science 2023-03-22 Johan Vertens , Nicolai Dorka , Tim Welschehold , Michael Thompson , Wolfram Burgard

We present the Latent Adaptive Planner (LAP), a trajectory-level latent-variable policy for dynamic nonprehensile manipulation (e.g., box catching) that formulates planning as inference in a low-dimensional latent space and is learned…

Robotics · Computer Science 2025-11-25 Donghun Noh , Deqian Kong , Minglu Zhao , Andrew Lizarraga , Jianwen Xie , Ying Nian Wu , Dennis Hong