English
Related papers

Related papers: A Model for Optimal Resilient Planning Subject to …

200 papers

In this letter, we consider a distributed submodular maximization problem for multi-robot systems when attacked by adversaries. One of the major challenges for multi-robot systems is to increase resilience against failures or attacks. This…

Robotics · Computer Science 2021-11-19 Jun Liu , Lifeng Zhou , Pratap Tokekar , Ryan K. Williams

We consider the human-aware task planning problem where a human-robot team is given a shared task with a known objective to achieve. Recent approaches tackle it by modeling it as a team of independent, rational agents, where the robot plans…

Robotics · Computer Science 2022-10-18 Anthony Favier , Shashank Shekhar , Rachid Alami

Markov decision processes (MDPs) are a standard model for sequential decision-making problems and are widely used across many scientific areas, including formal methods and artificial intelligence (AI). MDPs do, however, come with the…

Artificial Intelligence · Computer Science 2024-12-11 Marnix Suilen , Thom Badings , Eline M. Bovy , David Parker , Nils Jansen

In this work, we consider an online robust Markov Decision Process (MDP) where we have the information of finitely many prototypes of the underlying transition kernel. We consider an adaptively updated ambiguity set of the prototypes and…

Machine Learning · Computer Science 2024-12-20 Shuo Sun , Meng Qi , Zuo-Jun Max Shen

Models used in modern planning problems to simulate outcomes of real world action executions are becoming increasingly complex, ranging from simulators that do physics-based reasoning to precomputed analytical motion primitives. However,…

Robotics · Computer Science 2020-10-19 Anirudh Vemula , Yash Oza , J. Andrew Bagnell , Maxim Likhachev

Recent research in decision theoretic planning has focussed on making the solution of Markov decision processes (MDPs) more feasible. We develop a family of algorithms for structured reachability analysis of MDPs that are suitable when an…

Artificial Intelligence · Computer Science 2013-04-24 Craig Boutilier , Ronen I. Brafman , Christopher W. Geib

A key component of model-based reinforcement learning (RL) is a dynamics model that predicts the outcomes of actions. Errors in this predictive model can degrade the performance of model-based controllers, and complex Markov decision…

Machine Learning · Computer Science 2023-06-06 Seohong Park , Sergey Levine

The problem of target tracking with multiple robots consists of actively planning the motion of the robots to track the targets. A major challenge for practical deployments is to make the robots resilient to failures. In particular, robots…

Robotics · Computer Science 2018-09-12 Lifeng Zhou , Vasileios Tzoumas , George J. Pappas , Pratap Tokekar

The recent increase in data availability and reliability has led to a surge in the development of learning-based model predictive control (MPC) frameworks for robot systems. Despite attaining substantial performance improvements over their…

Robotics · Computer Science 2023-08-02 Kong Yao Chee , Thales C. Silva , M. Ani Hsieh , George J. Pappas

In this paper we design hybrid control policies for hybrid systems whose mathematical models are unknown. Our contributions are threefold. First, we propose a framework for modelling the hybrid control design problem as a single Markov…

Systems and Control · Electrical Eng. & Systems 2020-09-03 Meet Gandhi , Atreyee Kundu , Shalabh Bhatnagar

One important challenge for a set of agents to achieve more efficient collaboration is for these agents to maintain proper models of each other. An important aspect of these models of other agents is that they are often partial and…

Artificial Intelligence · Computer Science 2014-11-06 Yu Zhang , Subbarao Kambhampati

Reinforcement learning has demonstrated impressive performance in various challenging problems such as robotics, board games, and classical arcade games. However, its real-world applications can be hindered by the absence of robustness and…

Machine Learning · Computer Science 2024-07-02 Siemen Herremans , Ali Anwar , Siegfried Mercelis

In robot planning, tasks can often be achieved through multiple options, each consisting of several actions. This work specifically addresses deadline constraints in task and motion planning, aiming to find a plan that can be executed…

Robotics · Computer Science 2024-10-10 Yoonchang Sung , Shahaf S. Shperberg , Qi Wang , Peter Stone

An in-depth understanding of the particular environment is crucial in reinforcement learning (RL). To address this challenge, the decision-making process of a mobile collaborative robotic assistant modeled by the Markov decision process…

Machine Learning · Computer Science 2021-06-29 Mónika Farsang , Luca Szegletes

Critical systems must be designed resilient to all kinds of malfunctions. We are especially interested by the loss of control authority over actuators. This malfunction considers actuators producing uncontrolled and possibly undesirable…

Systems and Control · Electrical Eng. & Systems 2022-03-25 Jean-Baptiste Bouvier , Melkior Ornik

We consider the problem of multi-task reasoning (MTR), where an agent can solve multiple tasks via (first-order) logic reasoning. This capability is essential for human-like intelligence due to its strong generalizability and simplicity for…

Artificial Intelligence · Computer Science 2022-02-15 Daoming Lyu , Bo Liu , Jianshu Chen

Partial observability and uncertainty are common problems in sequential decision-making that particularly impede the use of formal models such as Markov decision processes (MDPs). However, in practice, agents may be able to employ costly…

Machine Learning · Computer Science 2023-12-19 Merlijn Krale , Thiago D. Simão , Jana Tumova , Nils Jansen

One of the critical challenges in automated driving is ensuring safety of automated vehicles despite the unknown behavior of the other vehicles. Although motion prediction modules are able to generate a probability distribution associated…

Systems and Control · Electrical Eng. & Systems 2024-03-28 Luyao Zhang , George Pantazis , Shaohang Han , Sergio Grammatico

Many control problems in environments that can be modeled as Markov decision processes (MDPs) concern infinite-time horizon specifications. The classical aim in this context is to compute a control policy that maximizes the probability of…

Systems and Control · Computer Science 2017-05-03 Ruediger Ehlers , Salar Moarref , Ufuk Topcu

Reinforcement Learning is a powerful framework for training agents to navigate different situations, but it is susceptible to changes in environmental dynamics. However, solving Markov Decision Processes that are robust to changes is…

Machine Learning · Computer Science 2024-06-21 Etash Kumar Guha