English
Related papers

Related papers: Belief State Planning for Autonomously Navigating …

200 papers

Cooperative coordination at unsignalized road intersections, which aims to improve the driving safety and traffic throughput for connected and automated vehicles, has attracted increasing interests in recent years. However, most existing…

Systems and Control · Electrical Eng. & Systems 2023-03-23 Jiping Luo , Tingting Zhang , Rui Hao , Donglin Li , Chunsheng Chen , Zhenyu Na , Qinyu Zhang

Hidden Markov models (HMMs) and partially observable Markov decision processes (POMDPs) form a useful tool for modeling dynamical systems. They are particularly useful for representing environments such as road networks and office…

Artificial Intelligence · Computer Science 2013-01-30 Hagit Shatkay

Noisy sensing, imperfect control, and environment changes are defining characteristics of many real-world robot tasks. The partially observable Markov decision process (POMDP) provides a principled mathematical framework for modeling and…

Robotics · Computer Science 2022-09-22 Mikko Lauri , David Hsu , Joni Pajarinen

We study planning problems where autonomous agents operate inside environments that are subject to uncertainties and not fully observable. Partially observable Markov decision processes (POMDPs) are a natural formal model to capture such…

Artificial Intelligence · Computer Science 2018-02-28 Steven Carr , Nils Jansen , Ralf Wimmer , Jie Fu , Ufuk Topcu

Signalized intersections, arguably the most complicated type of traffic scenario, are essential to urban mobility systems. With recent advancements in intelligent transportation technologies, signalized intersections have great prospects…

Physics and Society · Physics 2024-05-24 Ao Qu , Anirudh Valiveru , Catherine Tang , Vindula Jayawardana , Baptiste Freydt , Cathy Wu

National Highway Traffic Safety Administration reported 7,345 pedestrian fatalities in the United States in 2022, making pedestrian safety a pressing issue in urban mobility. This study presents a novel probabilistic simulation framework…

Applications · Statistics 2025-03-12 Alben Rome Bagabaldo , Jürgen Hackl

Planning under uncertainty is critical to robotics. The Partially Observable Markov Decision Process (POMDP) is a mathematical framework for such planning problems. It is powerful due to its careful quantification of the non-deterministic…

Robotics · Computer Science 2021-07-19 Hanna Kurniawati

Partially observable Markov decision processes (POMDPs) are a natural model for planning problems where effects of actions are nondeterministic and the state of the world is not completely observable. It is difficult to solve POMDPs…

Artificial Intelligence · Computer Science 2009-09-25 N. L. Zhang , W. Liu

Uncertainty on human behaviors poses a significant challenge to autonomous driving in crowded urban environments. The partially observable Markov decision processes (POMDPs) offer a principled framework for planning under uncertainty, often…

Machine Learning · Computer Science 2022-11-01 Mohamad H. Danesh , Panpan Cai , David Hsu

This paper presents a hierarchical decision-making framework for autonomous systems operating under uncertainty, demonstrated through autonomous driving as a representative application. Surrounding agents are modeled using Hybrid Markov…

Systems and Control · Electrical Eng. & Systems 2026-03-19 Siyuan Li , Chengyuan Liu , Wen-Hua Chen

We present an algorithm that, given a representation of a road network in lane-level detail, computes a route that minimizes the expected cost to reach a given destination. In doing so, our algorithm allows us to solve for the complex…

Robotics · Computer Science 2023-07-14 Mitchell Jones , Maximilian Haas-Heger , Jur van den Berg

Principled accountability for autonomous decision-making in uncertain environments requires distinguishing intentional outcomes from negligent designs from actual accidents. We propose analyzing the behavior of autonomous agents through a…

Path Planning for stochastic hybrid systems presents a unique challenge of predicting distributions of future states subject to a state-dependent dynamics switching function. In this work, we propose a variant of Model Predictive Path…

Simultaneous Localization and Planning (SLAP) under process and measurement uncertainties is a challenge. It involves solving a stochastic control problem modeled as a Partially Observed Markov Decision Process (POMDP) in a general…

Robotics · Computer Science 2016-08-12 Mohammadhussein Rafieisakhaei , Suman Chakravorty , P. R. Kumar

Density of the reachable states can help understand the risk of safety-critical systems, especially in situations when worst-case reachability is too conservative. Recent work provides a data-driven approach to compute the density…

Robotics · Computer Science 2022-09-19 Yue Meng , Zeng Qiu , Md Tawhid Bin Waez , Chuchu Fan

Lane-change maneuver has always been a challenging task for both manual and autonomous driving, especially in an urban setting. In particular, the uncertainty in predicting the behavior of other vehicles on the road leads to indecisive…

Systems and Control · Electrical Eng. & Systems 2022-12-26 Avinash Prabu , Niranjan Ravi , Lingxi Li

This research introduces two efficient methods to estimate the collision risk of planned trajectories in autonomous driving under uncertain driving conditions. Deterministic collision checks of planned trajectories are often inaccurate or…

Robotics · Computer Science 2025-10-08 Marc Kaufeld , Johannes Betz

Real-world autonomous systems operate under uncertainty about both their pose and dynamics. Autonomous control systems must simultaneously perform estimation and control tasks to maintain robustness to changing dynamics or modeling errors.…

Systems and Control · Computer Science 2018-08-03 Patrick Slade , Zachary N. Sunberg , Mykel J. Kochenderfer

Decision-making under uncertainty is a crucial ability for autonomous systems. In its most general form, this problem can be formulated as a Partially Observable Markov Decision Process (POMDP). The solution policy of a POMDP can be…

Robotics · Computer Science 2019-04-09 Sung-Kyun Kim , Rohan Thakker , Ali-akbar Agha-mohammadi

Trajectory planning in dense, interactive traffic scenarios presents significant challenges for autonomous vehicles, primarily due to the uncertainty of human driver behavior and the non-convex nature of collision avoidance constraints.…

Systems and Control · Electrical Eng. & Systems 2025-10-30 Erik Börve , Nikolce Murgovski , Leo Laine