English
Related papers

Related papers: Cost Sensitive Reachability Heuristics for Handlin…

200 papers

For high level path planning, environments are usually modeled as distance graphs, and path planning problems are reduced to computing the shortest path in distance graphs. One major drawback of this modeling is the inability to model…

Artificial Intelligence · Computer Science 2013-03-26 Runping Qi , David L. Poole

Directed graphs provide more subtle and precise modelling tools for optimization in road networks than simple graphs. In particular, they are more suitable in the context of alternative fuel vehicles and new automotive technologies, like…

Discrete Mathematics · Computer Science 2024-09-09 Lukas Dijkstra , Andrei Gagarin , Padraig Corcoran , Rhyd Lewis

Asymptotically optimal sampling-based planners require an intelligent exploration strategy to accelerate convergence. After an initial solution is found, a necessary condition for improvement is to generate new samples in the so-called…

Robotics · Computer Science 2021-03-22 Sagar Suhas Joshi , Panagiotis Tsiotras

Gradient-based solvers risk convergence to local optima, leading to incorrect researcher inference. Heuristic-based algorithms are able to ``break free" of these local optima to eventually converge to the true global optimum. However, given…

Econometrics · Economics 2024-01-17 Zachary Porreca

Trajectory planning under uncertainty is an active research topic. Previous works predict state and state estimation uncertainties along trajectories to check for collision safety. They assume either stochastic or bounded sensing…

Robotics · Computer Science 2020-12-18 Akshay Shetty , Grace Xingxin Gao

We consider partially observable Markov decision processes (POMDPs) with a set of target states and positive integer costs associated with every transition. The traditional optimization objective (stochastic shortest path) asks to minimize…

Artificial Intelligence · Computer Science 2016-05-12 Tomáš Brázdil , Krishnendu Chatterjee , Martin Chmelík , Anchit Gupta , Petr Novotný

Traversing environments with arbitrary obstacles poses significant challenges for bipedal robots. In some cases, whole body motions may be necessary to maneuver around an obstacle, but most existing footstep planners can only select from a…

Robotics · Computer Science 2017-03-22 Michael X. Grey , Aaron D. Ames , C. Karen Liu

Sampling-based motion planners (SBMPs) are widely used to compute dynamically feasible robot paths. However, their reliance on uniform sampling often leads to poor efficiency and slow planning in complex environments. We introduce a novel…

Robotics · Computer Science 2025-11-10 Shubham Natraj , Bruno Sinopoli , Yiannis Kantaros

We consider qualitative strategy synthesis for the formalism called consumption Markov decision processes. This formalism can model dynamics of an agents that operates under resource constraints in a stochastic environment. The presented…

Artificial Intelligence · Computer Science 2021-05-06 František Blahoudek , Petr Novotný , Melkior Ornik , Pranay Thangeda , Ufuk Topcu

Graph games are fundamental in strategic reasoning of multi-agent systems and their environments. We study a new family of graph games which combine stochastic environmental uncertainties and auction-based interactions among the agents,…

Computer Science and Game Theory · Computer Science 2024-12-30 Guy Avni , Martin Kurečka , Kaushik Mallik , Petr Novotný , Suman Sadhukhan

Health-related data is noisy and stochastic in implying the true physiological states of patients, limiting information contained in single-moment observations for sequential clinical decision making. We model patient-clinician interactions…

Artificial Intelligence · Computer Science 2019-05-21 Luchen Li , Matthieu Komorowski , Aldo A. Faisal

An optimal randomized strategy for design of balanced, normalized mass transport plans is developed. It replaces -- but specializes to -- the deterministic, regularized optimal transport (OT) strategy, which yields only a…

Systems and Control · Electrical Eng. & Systems 2025-05-08 Sarah Boufelja Y. , Anthony Quinn , Robert Shorten

In mechanical design, there is often unavoidable uncertainty in estimates of design performance. Evaluation of design alternatives requires consideration of the impact of this uncertainty. Expert heuristics embody assumptions regarding the…

Artificial Intelligence · Computer Science 2013-03-26 Deborah L. Thurston , Yun Qi Tian

We investigate a data-driven approach to constructing uncertainty sets for robust optimization problems, where the uncertain problem parameters are modeled as random variables whose joint probability distribution is not known. Relying only…

Optimization and Control · Mathematics 2020-09-22 Polina Alexeenko , Eilyan Bitar

Generating optimal plans in highly dynamic environments is challenging. Plans are predicated on an assumed initial state, but this state can change unexpectedly during plan generation, potentially invalidating the planning effort. In this…

Artificial Intelligence · Computer Science 2012-05-14 Christian Fritz , Sheila McIlraith

Partial observability and uncertainty are common problems in sequential decision-making that particularly impede the use of formal models such as Markov decision processes (MDPs). However, in practice, agents may be able to employ costly…

Machine Learning · Computer Science 2023-12-19 Merlijn Krale , Thiago D. Simão , Jana Tumova , Nils Jansen

Mixed observable Markov decision processes (MOMDPs) are a modeling framework for autonomous systems described by both fully and partially observable states. In this work, we study the problem of synthesizing a control policy for MOMDPs that…

Systems and Control · Electrical Eng. & Systems 2021-03-03 Ugo Rosolia , Mohamadreza Ahmadi , Richard M. Murray , Aaron D. Ames

In this paper we present a hierarchical multi-rate control architecture for nonlinear autonomous systems operating in partially observable environments. Control objectives are expressed using syntactically co-safe Linear Temporal Logic…

Systems and Control · Electrical Eng. & Systems 2022-07-04 Ugo Rosolia , Andrew Singletary , Aaron D. Ames

We consider a class of partially observable Markov decision processes (POMDPs) with uncertain transition and/or observation probabilities. The uncertainty takes the form of probability intervals. Such uncertain POMDPs can be used, for…

Systems and Control · Computer Science 2018-07-12 Mohamadreza Ahmadi , Murat Cubuktepe , Nils Jansen , Ufuk Topcu

In this paper, we consider the problem of optimizing the worst-case behavior of a partially observed system. All uncontrolled disturbances are modeled as finite-valued uncertain variables. Using the theory of cost distributions, we present…

Optimization and Control · Mathematics 2023-02-21 Aditya Dave , Nishanth Venkatesh , Andreas A. Malikopoulos