English
Related papers

Related papers: Learning Online Belief Prediction for Efficient PO…

200 papers

Online planning for partially observable Markov decision processes (POMDPs) provides efficient techniques for robot decision-making under uncertainty. However, existing methods fall short of preventing safety violations in dynamic…

Robotics · Computer Science 2024-09-10 Shili Sheng , Pian Yu , David Parker , Marta Kwiatkowska , Lu Feng

Robots operating in real-world environments must reason about possible outcomes of stochastic actions and make decisions based on partial observations of the true world state. A major challenge for making accurate and robust action…

Robotics · Computer Science 2023-07-28 Ricardo Cannizzaro , Lars Kunze

Autonomous vehicles (AVs) need to interact with other traffic participants who can be either cooperative or aggressive, attentive or inattentive. Such different characteristics can lead to quite different interactive behaviors. Hence, to…

Robotics · Computer Science 2021-01-18 Jinning Li , Liting Sun , Wei Zhan , Masayoshi Tomizuka

Planning safe trajectories for autonomous vehicles is essential for operational safety but remains extremely challenging due to the complex interactions among traffic participants. Recent autonomous driving frameworks have focused on…

Robotics · Computer Science 2026-04-22 Tian Niu , Kaizhao Zhang , Zhongxue Gan , Wenchao Ding

Efficiently locating target objects in complex indoor environments with diverse furniture, such as shelves, tables, and beds, is a significant challenge for mobile robots. This difficulty arises from factors like localization errors,…

Robotics · Computer Science 2026-04-17 Yongbo Chen , Hesheng Wang , Shoudong Huang , Hanna Kurniawati

In this paper, we consider online planning in partially observable domains. Solving the corresponding POMDP problem is a very challenging task, particularly in an online setting. Our key contribution is a novel algorithmic approach,…

Artificial Intelligence · Computer Science 2021-05-13 Ori Sztyglic , Vadim Indelman

This work examines the hypothesis that partially observable Markov decision process (POMDP) planning with human driver internal states can significantly improve both safety and efficiency in autonomous freeway driving. We evaluate this…

Artificial Intelligence · Computer Science 2022-06-13 Zachary Sunberg , Mykel Kochenderfer

Real-world problems often require reasoning about hybrid beliefs, over both discrete and continuous random variables. Yet, such a setting has hardly been investigated in the context of planning. Moreover, existing online Partially…

Artificial Intelligence · Computer Science 2023-05-04 Moran Barenboim , Moshe Shienman , Vadim Indelman

This paper presents a hybrid online Partially Observable Markov Decision Process (POMDP) planning system that addresses the problem of autonomous navigation in the presence of multi-modal uncertainty introduced by other agents in the…

Robotics · Computer Science 2022-06-22 Himanshu Gupta , Bradley Hayes , Zachary Sunberg

Partially Observable Markov Decision Process (POMDP) provides a principled and generic framework to model real world sequential decision making processes but yet remains unsolved, especially for high dimensional continuous space and unknown…

Machine Learning · Computer Science 2022-05-24 Xiaoyu Chen , Yao Mu , Ping Luo , Shengbo Li , Jianyu Chen

Predicting driver intentions is a difficult and crucial task for advanced driver assistance systems. Traditional confidence measures on predictions often ignore the way predicted trajectories affect downstream decisions for safe driving. In…

Motion planning is challenging when it comes to the case of imperfect state information. Decision should be made based on belief state which evolves according to the noise from the system dynamics and sensor measurement. In this paper, we…

Robotics · Computer Science 2018-10-02 Ke Sun , Vijay Kumar

This work introduces a novel deep learning-based architecture, termed the Deep Belief Markov Model (DBMM), which provides efficient, model-formulation agnostic inference in Partially Observable Markov Decision Process (POMDP) problems. The…

Machine Learning · Computer Science 2025-03-18 Giacomo Arcieri , Konstantinos G. Papakonstantinou , Daniel Straub , Eleni Chatzi

Autonomous vehicles have to navigate the surrounding environment with partial observability of other objects sharing the road. Sources of uncertainty in autonomous vehicle measurements include sensor fusion errors, limited sensor range due…

Artificial Intelligence · Computer Science 2018-12-05 Mohammad Naghshvar , Ahmed K. Sadek , Auke J. Wiggers

Partially Observable Markov Decision Processes (POMDPs) provide a robust framework for decision-making under uncertainty in applications such as autonomous driving and robotic exploration. Their extension, $\rho$POMDPs, introduces…

Artificial Intelligence · Computer Science 2025-02-05 Ron Benchetrit , Idan Lev-Yehudi , Andrey Zhitnikov , Vadim Indelman

Lane-free traffic environments allow vehicles to better harness the lateral capacity of the road without being restricted to lane-keeping, thereby increasing the traffic flow rates. As such, we have a distinct and more challenging setting…

Uncertainty on human behaviors poses a significant challenge to autonomous driving in crowded urban environments. The partially observable Markov decision processes (POMDPs) offer a principled framework for planning under uncertainty, often…

Machine Learning · Computer Science 2022-11-01 Mohamad H. Danesh , Panpan Cai , David Hsu

Decentralized online planning can be an attractive paradigm for cooperative multi-agent systems, due to improved scalability and robustness. A key difficulty of such approach lies in making accurate predictions about the decisions of other…

Artificial Intelligence · Computer Science 2020-11-11 Aleksander Czechowski , Frans A. Oliehoek

Partially Observable Monte-Carlo Planning (POMCP) is a powerful online algorithm able to generate approximate policies for large Partially Observable Markov Decision Processes. The online nature of this method supports scalability by…

Artificial Intelligence · Computer Science 2021-04-29 Giulio Mazzi , Alberto Castellini , Alessandro Farinelli

Partially Observable Markov Decision Processes (POMDPs) provide a rich framework for sequential decision-making under uncertainty in stochastic domains. However, solving a POMDP is often intractable except for small problems due to their…

Artificial Intelligence · Computer Science 2014-01-16 Stéphane Ross , Joelle Pineau , Sébastien Paquet , Brahim Chaib-draa