English
Related papers

Related papers: Hierarchical Motion Planning under Probabilistic T…

200 papers

Many physical systems have underlying safety considerations that require that the policy employed ensures the satisfaction of a set of constraints. The analytical formulation usually takes the form of a Constrained Markov Decision Process…

Machine Learning · Computer Science 2021-03-03 Aria HasanzadeZonuzy , Archana Bura , Dileep Kalathil , Srinivas Shakkottai

Practical reinforcement learning problems are often formulated as constrained Markov decision process (CMDP) problems, in which the agent has to maximize the expected return while satisfying a set of prescribed safety constraints. In this…

Machine Learning · Computer Science 2019-09-23 Shin-ichi Maeda , Hayato Watahiki , Shintarou Okada , Masanori Koyama

Neural networks have shown great promises in planning, control, and general decision making for learning-enabled cyber-physical systems (LE-CPSs), especially in improving performance under complex scenarios. However, it is very challenging…

Robotics · Computer Science 2022-01-25 Xiangguo Liu , Chao Huang , Yixuan Wang , Bowen Zheng , Qi Zhu

We study feedback motion planning for continuous-time stochastic nonlinear systems under signal temporal logic (STL) specifications. We propose a framework that synthesizes control policies for chance-constrained STL trajectory optimization…

Robotics · Computer Science 2026-05-05 Liqian Ma , Zishun Liu , Glen Chou , Yongxin Chen

This paper addresses the problem of learning optimal control policies for systems with uncertain dynamics and high-level control objectives specified as Linear Temporal Logic (LTL) formulas. Uncertainty is considered in the workspace…

Robotics · Computer Science 2024-10-17 Yiannis Kantaros , Jun Wang

Sequential decision-making and motion planning for robotic manipulation induce combinatorial complexity. For long-horizon tasks, especially when the environment comprises many objects that can be interacted with, planning efficiency becomes…

Robotics · Computer Science 2022-03-08 Cornelius V. Braun , Joaquim Ortiz-Haro , Marc Toussaint , Ozgur S. Oguz

This article presents MAPS$^2$ : a distributed algorithm that allows multi-robot systems to deliver coupled tasks expressed as Signal Temporal Logic (STL) constraints. Classical control theoretical tools addressing STL constraints either…

Robotics · Computer Science 2025-12-17 Mayank Sewlia , Christos K. Verginis , Dimos V. Dimarogonas

In many real-world reinforcement learning (RL) problems, besides optimizing the main objective function, an agent must concurrently avoid violating a number of constraints. In particular, besides optimizing performance it is crucial to…

Machine Learning · Computer Science 2018-05-22 Yinlam Chow , Ofir Nachum , Edgar Duenez-Guzman , Mohammad Ghavamzadeh

This paper investigates the planning and control problems for multi-robot systems under linear temporal logic (LTL) specifications. In contrast to most of existing literature, which presumes a static and known environment, our study focuses…

Robotics · Computer Science 2023-07-13 Pian Yu , Gianmarco Fedeli , Dimos V. Dimarogonas

We address the problem of controlling a noisy differential drive mobile robot such that the probability of satisfying a specification given as a Bounded Linear Temporal Logic (BLTL) formula over a set of properties at the regions in the…

Robotics · Computer Science 2015-03-20 Igor Cizelj , Calin Belta

Controlling high-dimensional stochastic systems, critical in robotics, autonomous vehicles, and hyperchaotic systems, faces the curse of dimensionality, lacks temporal abstraction, and often fails to ensure stochastic stability. To overcome…

Robotics · Computer Science 2025-10-28 Mohammad Ali Labbaf Khaniki , Fateme Taroodi , Benyamin Safizadeh

The optimal robot assembly planning problem is challenging due to the necessity of finding the optimal solution amongst an exponentially vast number of possible plans, all while satisfying a selection of constraints. Traditionally, robotic…

Robotics · Computer Science 2025-02-25 Kartik Nagpal , Negar Mehr

This paper presents a model-free reinforcement learning (RL) algorithm to synthesize a control policy that maximizes the satisfaction probability of linear temporal logic (LTL) specifications. Due to the consideration of environment and…

Formal Languages and Automata Theory · Computer Science 2022-01-04 Mingyu Cai , Shaoping Xiao , Baoluo Li , Zhiliang Li , Zhen Kan

Autonomous systems must solve motion planning problems subject to increasingly complex, time-sensitive, and uncertain missions. These problems often involve high-level task specifications, such as temporal logic or chance constraints, which…

Systems and Control · Electrical Eng. & Systems 2026-04-28 Junyang Cai , Weimin Huang , Brendan Long , Matthew Cleaveland , Jyotirmoy V. Deshmukh , Lars Lindemann , Bistra Dilkina

For autonomous service robots to successfully perform long horizon tasks in the real world, they must act intelligently in partially observable environments. Most Task and Motion Planning approaches assume full observability of their state…

Robotics · Computer Science 2021-10-19 Alphonsus Adu-Bredu , Nikhil Devraj , Pin-Han Lin , Zhen Zeng , Odest Chadwicke Jenkins

In order to solve complex, long-horizon tasks, intelligent robots need to carry out high-level, abstract planning and reasoning in conjunction with motion planning. However, abstract models are typically lossy and plans or policies computed…

Artificial Intelligence · Computer Science 2020-06-02 Naman Shah , Deepak Kala Vasudevan , Kislay Kumar , Pranav Kamojjhala , Siddharth Srivastava

Trajectory planning tasks for non-holonomic or collaborative systems are naturally modeled by state spaces with non-Euclidean metrics. However, existing proofs of convergence for sample-based motion planners only consider the setting of…

Robotics · Computer Science 2023-06-29 Anton Lukyanenko , Damoon Soudbakhsh

In this paper, a robot navigating an environment shared with humans is considered, and a cost function that can be exploited in $\text{RRT}^\text{X}$, a randomized sampling-based replanning algorithm that guarantees asymptotic optimality,…

Robotics · Computer Science 2022-06-16 Basak Sakcak , Luca Bascetta

Linear Temporal Logic (LTL) is a formal way of specifying complex objectives for planning problems modeled as Markov Decision Processes (MDPs). The planning problem aims to find the optimal policy that maximizes the satisfaction probability…

Robotics · Computer Science 2024-08-13 Zetong Xuan , Yu Wang

We propose a hierarchical learning architecture for predictive control in unknown environments. We consider a constrained nonlinear dynamical system and assume the availability of state-input trajectories solving control tasks in different…

Systems and Control · Electrical Eng. & Systems 2020-07-16 Charlott Vallon , Francesco Borrelli