English
Related papers

Related papers: Model-Based Planning with Discrete and Continuous …

200 papers

We study reinforcement learning in hybrid discrete-continuous action spaces, such as settings where the discrete component selects a regime (or index) and the continuous component optimizes within it -- a structure common in robotics,…

Machine Learning · Computer Science 2026-05-15 Matias Alvo , Daniel Russo , Yash Kanoria

Reinforcement learning has received high research interest for developing planning approaches in automated driving. Most prior works consider the end-to-end planning task that yields direct control commands and rarely deploy their algorithm…

Robotics · Computer Science 2023-07-31 Marvin Klimke , Benjamin Völz , Michael Buchholz

In this paper, we show how model checking can be used to create multi-step plans for a differential drive wheeled robot so that it can avoid immediate danger. Using a small, purpose built model checking algorithm in situ we generate plans…

Logic in Computer Science · Computer Science 2023-11-17 Christopher Chandler , Bernd Porr , Alice Miller , Giulia Lafratta

In fast-paced, ever-changing environments, dynamic Motion Planning for Multi-Agent Systems in the presence of obstacles is a universal and unsolved problem. Be it from path planning around obstacles to the movement of robotic arms, or in…

Robotics · Computer Science 2025-02-11 Brandon Ho , Batuhan Altundas , Matthew Gombolay

The enduring challenge in the field of artificial intelligence has been the control of systems to achieve desired behaviours. While for systems governed by straightforward dynamics equations, methods like Linear Quadratic Regulation (LQR)…

Machine Learning · Computer Science 2023-12-29 Jyothir S , Siddhartha Jalagam , Yann LeCun , Vlad Sobal

By planning through a learned dynamics model, model-based reinforcement learning (MBRL) offers the prospect of good performance with little environment interaction. However, it is common in practice for the learned model to be inaccurate,…

Machine Learning · Computer Science 2021-03-31 Behzad Haghgoo , Allan Zhou , Archit Sharma , Chelsea Finn

The performance of optimization-based robot motion planning algorithms is highly dependent on the initial solutions, commonly obtained by running a sampling-based planner to obtain a collision-free path. However, these methods can be slow…

Robotics · Computer Science 2025-08-15 J. Carvalho , A. Le , P. Kicki , D. Koert , J. Peters

This paper investigates a new approach to model-based reinforcement learning using background planning: mixing (approximate) dynamic programming updates and model-free updates, similar to the Dyna architecture. Background planning with…

Machine Learning · Computer Science 2024-06-04 Kevin Roice , Parham Mohammad Panahi , Scott M. Jordan , Adam White , Martha White

Task and motion planning represents a powerful set of hybrid planning methods that combine reasoning over discrete task domains and continuous motion generation. Traditional reasoning necessitates task domain models and enough information…

Robotics · Computer Science 2024-06-14 Tianyang Pan , Rahul Shome , Lydia E. Kavraki

Learning and planning with latent space dynamics has been shown to be useful for sample efficiency in model-based reinforcement learning (MBRL) for discrete and continuous control tasks. In particular, recent work, for discrete action…

Machine Learning · Computer Science 2020-10-21 Anurag Koul , Varun V. Kumar , Alan Fern , Somdeb Majumdar

Dyna-style model-based reinforcement learning contains two phases: model rollouts to generate sample for policy learning and real environment exploration using current policy for dynamics model learning. However, due to the complex…

Machine Learning · Computer Science 2024-01-02 Xiyao Wang , Ruijie Zheng , Yanchao Sun , Ruonan Jia , Wichayaporn Wongkamjan , Huazhe Xu , Furong Huang

In model-based reinforcement learning, the agent interleaves between model learning and planning. These two components are inextricably intertwined. If the model is not able to provide sensible long-term prediction, the executed planner…

Machine Learning · Statistics 2019-03-19 Nan Rosemary Ke , Amanpreet Singh , Ahmed Touati , Anirudh Goyal , Yoshua Bengio , Devi Parikh , Dhruv Batra

In this paper, we propose a novel Deep Reinforcement Learning approach to address the mapless navigation problem, in which the locomotion actions of a humanoid robot are taken online based on the knowledge encoded in learned models.…

Robotics · Computer Science 2021-08-10 Andre Brandenburger , Diego Rodriguez , Sven Behnke

It is crucial to ask how agents can achieve goals by generating action plans using only partial models of the world acquired through habituated sensory-motor experiences. Although many existing robotics studies use a forward model…

Robotics · Computer Science 2020-06-01 Takazumi Matsumoto , Jun Tani

In robotics, it is often not possible to learn useful policies using pure model-free reinforcement learning without significant reward shaping or curriculum learning. As a consequence, many researchers rely on expert demonstrations to guide…

Robotics · Computer Science 2021-04-20 Ondrej Biza , Dian Wang , Robert Platt , Jan-Willem van de Meent , Lawson L. S. Wong

This paper presents a Predictive Maneuver Planning with Deep Reinforcement Learning (PMP-DRL) model for maneuver planning. Traditional rule-based maneuver planning approaches often have to improve their abilities to handle the variabilities…

Deep reinforcement learning (DRL) has had success across various domains, but applying it to environments with constraints remains challenging due to poor sample efficiency and slow convergence. Recent literature explored incorporating…

Machine Learning · Computer Science 2024-12-06 Mirco Theile , Lukas Dirnberger , Raphael Trumpp , Marco Caccamo , Alberto L. Sangiovanni-Vincentelli

We introduce a method for real-time navigation and tracking with differentiably rendered world models. Learning models for control has led to impressive results in robotics and computer games, but this success has yet to be extended to…

Machine Learning · Computer Science 2022-01-26 Baris Kayalibay , Atanas Mirchev , Patrick van der Smagt , Justin Bayer

Being able to reason in an environment with a large number of discrete actions is essential to bringing reinforcement learning to a larger class of problems. Recommender systems, industrial plants and language models are only some of the…

By utilizing only depth information, the paper introduces a novel but efficient local planning approach that enhances not only computational efficiency but also planning performances for memoryless local planners. The sampling is first…

Robotics · Computer Science 2023-10-24 Thai Binh Nguyen , Linh Nguyen , Tanveer Choudhury , Kathleen Keogh , Manzur Murshed