English
Related papers

Related papers: Online Risk-Bounded Motion Planning for Autonomous…

200 papers

Constraint-aware estimation of human intent is essential for robots to physically collaborate and interact with humans. Further, to achieve fluid collaboration in dynamic tasks intent estimation should be achieved in real-time. In this…

Robotics · Computer Science 2024-09-04 Yifei Simon Shao , Tianyu Li , Shafagh Keyvanian , Pratik Chaudhari , Vijay Kumar , Nadia Figueroa

Partially observable Markov decision processes (POMDPs) are standard models for dynamic systems with probabilistic and nondeterministic behaviour in uncertain environments. We prove that in POMDPs with long-run average objective, the…

Computer Science and Game Theory · Computer Science 2022-09-29 Krishnendu Chatterjee , Raimundo Saona , Bruno Ziliotto

Planning in environments with other agents whose future actions are uncertain often requires compromise between safety and performance. Here our goal is to design efficient planning algorithms with guaranteed bounds on the probability of…

Robotics · Computer Science 2021-06-18 Hung-Jui Huang , Kai-Chi Huang , Michal Čáp , Yibiao Zhao , Ying Nian Wu , Chris L. Baker

The increasing use of autonomous robot systems in hazardous environments underscores the need for efficient search and rescue operations. Despite significant advancements, existing literature on object search often falls short in overcoming…

Robotics · Computer Science 2024-04-08 Matthew Collins , Jared J. Beard , Nicholas Ohi , Yu Gu

We introduce a Transformer-based Reinforcement Learning framework for autonomous orbital collision avoidance that explicitly models the effects of partial observability and imperfect monitoring in space operations. The framework combines a…

Machine Learning · Computer Science 2026-03-26 Thomas Georges , Adam Abdin

Using a novel toy nautical navigation environment, we show that dynamic programming can be used when only incomplete information about a partially observed Markov decision process (POMDP) is known. By incorporating uncertainty into our…

Optimization and Control · Mathematics 2022-07-20 Chris Beeler , Xinkai Li , Colin Bellinger , Mark Crowley , Maia Fraser , Isaac Tamblyn

Autonomous driving in a crowded environment, e.g., a busy traffic intersection, is an unsolved challenge for robotics. The robot vehicle must contend with a dynamic and partially observable environment, noisy sensors, and many agents. A…

Robotics · Computer Science 2019-05-30 Panpan Cai , Yuanfu Luo , Aseem Saxena , David Hsu , Wee Sun Lee

One of the critical challenges in automated driving is ensuring safety of automated vehicles despite the unknown behavior of the other vehicles. Although motion prediction modules are able to generate a probability distribution associated…

Systems and Control · Electrical Eng. & Systems 2024-03-28 Luyao Zhang , George Pantazis , Shaohang Han , Sergio Grammatico

This paper addresses the online motion planning problem of mobile robots under complex high-level tasks. The robot motion is modeled as an uncertain Markov Decision Process (MDP) due to limited initial knowledge, while the task is specified…

Robotics · Computer Science 2023-02-13 Yuyang Zhang , Meng Guo

Hidden Markov models (HMMs) and partially observable Markov decision processes (POMDPs) form a useful tool for modeling dynamical systems. They are particularly useful for representing environments such as road networks and office…

Artificial Intelligence · Computer Science 2013-01-30 Hagit Shatkay

In this paper we consider infinite horizon discounted dynamic programming problems with finite state and control spaces, partial state observations, and a multiagent structure. We discuss and compare algorithms that simultaneously or…

Robotics · Computer Science 2020-11-10 Sushmita Bhattacharya , Siva Kailas , Sahil Badyal , Stephanie Gil , Dimitri Bertsekas

Real-world decision-making problems are often partially observable, and many can be formulated as a Partially Observable Markov Decision Process (POMDP). When we apply reinforcement learning (RL) algorithms to the POMDP, reasonable…

Artificial Intelligence · Computer Science 2023-04-20 Soichiro Nishimori , Sotetsu Koyamada , Shin Ishii

We consider planning problems, that often arise in autonomous driving applications, in which an agent should decide on immediate actions so as to optimize a long term objective. For example, when a car tries to merge in a roundabout it…

Machine Learning · Computer Science 2016-02-05 Shai Shalev-Shwartz , Nir Ben-Zrihem , Aviad Cohen , Amnon Shashua

Large language model (LLM)-based agents are increasingly used to perform complex, multi-step workflows in regulated settings such as compliance and due diligence. However, many agentic architectures rely primarily on prompt engineering of a…

Artificial Intelligence · Computer Science 2026-02-03 Ananya Joshi , Michael Rudow

The interactive decision-making in multi-agent autonomous racing offers insights valuable beyond the domain of self-driving cars. Mapless online path planning is particularly of practical appeal but poses a challenge for safely overtaking…

Robotics · Computer Science 2024-09-17 Raphael Trumpp , Ehsan Javanmardi , Jin Nakazato , Manabu Tsukada , Marco Caccamo

Autonomous vehicles (AVs) must share the driving space with other drivers and often employ conservative motion planning strategies to ensure safety. These conservative strategies can negatively impact AV's performance and significantly slow…

Robotics · Computer Science 2023-07-27 Piyush Gupta , David Isele , Donggun Lee , Sangjae Bae

This paper presents a framework for fast and robust motion planning designed to facilitate automated driving. The framework allows for real-time computation even for horizons of several hundred meters and thus enabling automated driving in…

Robotics · Computer Science 2019-02-26 Zlatan Ajanovic , Bakir Lacevic , Barys Shyrokau , Michael Stolz , Martin Horn

This paper extends the framework of partially observable Markov decision processes (POMDPs) to multi-agent settings by incorporating the notion of agent models into the state space. Agents maintain beliefs over physical states of the…

Artificial Intelligence · Computer Science 2011-09-13 P. Doshi , P. J. Gmytrasiewicz

Motion planning is a crucial component of autonomous robot driving. While various trajectory datasets exist, effectively utilizing them for a target domain remains challenging due to differences in agent interactions and environmental…

Robotics · Computer Science 2025-07-28 Giwon Lee , Wooseong Jeong , Daehee Park , Jaewoo Jeong , Kuk-Jin Yoon

In mixed-traffic environments, autonomous vehicles (AVs) must interact with heterogeneous human-driven vehicles (HVs) whose intentions and driving styles vary across individuals and scenarios. Such variability introduces uncertainty into…

Robotics · Computer Science 2026-03-18 Xiaoyun Qiu , Haichao Liu , Yue Pan , Jun Ma , Xinhu Zheng