English
Related papers

Related papers: Stochastic 2-D Motion Planning with a POMDP Framew…

200 papers

Robots often need to solve path planning problems where essential and discrete aspects of the environment are partially observable. This introduces a multi-modality, where the robot must be able to observe and infer the state of its…

Robotics · Computer Science 2022-08-02 Camille Phiquepal , Andreas Orthey , Nicolas Viennot , Marc Toussaint

This paper presents a hybrid online Partially Observable Markov Decision Process (POMDP) planning system that addresses the problem of autonomous navigation in the presence of multi-modal uncertainty introduced by other agents in the…

Robotics · Computer Science 2022-06-22 Himanshu Gupta , Bradley Hayes , Zachary Sunberg

Optimal decision-making presents a significant challenge for autonomous systems operating in uncertain, stochastic and time-varying environments. Environmental variability over time can significantly impact the system's optimal decision…

Robotics · Computer Science 2024-03-11 Gokul Puthumanaillam , Xiangyu Liu , Negar Mehr , Melkior Ornik

Online solvers for partially observable Markov decision processes have difficulty scaling to problems with large action spaces. This paper proposes a method called PA-POMCPOW to sample a subset of the action space that provides varying…

Machine Learning · Computer Science 2021-11-04 John Mern , Anil Yildiz , Larry Bush , Tapan Mukerji , Mykel J. Kochenderfer

Autonomous vehicles (AVs) need to interact with other traffic participants who can be either cooperative or aggressive, attentive or inattentive. Such different characteristics can lead to quite different interactive behaviors. Hence, to…

Robotics · Computer Science 2021-01-18 Jinning Li , Liting Sun , Wei Zhan , Masayoshi Tomizuka

Adaptive sampling and planning in robotic environmental monitoring are challenging when the target environmental process varies over space and time. The underlying environmental dynamics require the planning module to integrate future…

Robotics · Computer Science 2023-06-19 Weizhe Chen , Lantao Liu

Planning in stochastic and partially observable environments is a central issue in artificial intelligence. One commonly used technique for solving such a problem is by constructing an accurate model firstly. Although some recent approaches…

Artificial Intelligence · Computer Science 2019-04-08 Yunlong Liu , Jianyang Zheng

This paper addresses the trajectory planning problem for automated vehicle on-ramp highway merging. To tackle this challenge, we extend our previous work on trajectory planning at unsignalized intersections using Partially Observable Markov…

Robotics · Computer Science 2024-12-11 Adam Kollarčík , Zdeněk Hanzálek

Our goal is to enable robots to plan sequences of tabletop actions to push a block with unknown physical properties to a desired goal pose. We approach this problem by learning the constituent models of a Partially-Observable Markov…

Robotics · Computer Science 2025-07-02 Atharv Jain , Seiji Shaw , Nicholas Roy

Autonomous agents are limited in their ability to observe the world state. Partially observable Markov decision processes (POMDPs) formally model the problem of planning under world state uncertainty, but POMDPs with continuous actions and…

Robotics · Computer Science 2020-07-08 Dicong Qiu , Yibiao Zhao , Chris L. Baker

Partially observable Markov decision processes (POMDP) are a useful model for decision-making under partial observability and stochastic actions. Partially Observable Monte-Carlo Planning is an online algorithm for deciding on the next…

Artificial Intelligence · Computer Science 2023-10-05 Oded Blumenthal , Guy Shani

Currently, large partially observable Markov decision processes (POMDPs) are often solved by sampling-based online methods which interleave planning and execution phases. However, a pre-computed offline policy is more desirable in POMDP…

Artificial Intelligence · Computer Science 2025-07-29 Yang You , Vincent Thomas , Alex Schutz , Robert Skilton , Nick Hawes , Olivier Buffet

Partially observable Markov decision processes (POMDPs) are a natural model for planning problems where effects of actions are nondeterministic and the state of the world is not completely observable. It is difficult to solve POMDPs…

Artificial Intelligence · Computer Science 2009-09-25 N. L. Zhang , W. Liu

In this paper we present the PUMP (Parallel Uncertainty-aware Multiobjective Planning) algorithm for addressing the stochastic kinodynamic motion planning problem, whereby one seeks a low-cost, dynamically-feasible motion plan subject to a…

Robotics · Computer Science 2017-02-27 Brian Ichter , Edward Schmerling , Ali-akbar Agha-mohammadi , Marco Pavone

To assist humans in open-world environments, robots must interpret ambiguous instructions to locate desired objects. Foundation model-based approaches excel at multimodal grounding, but they lack a principled mechanism for modeling…

Robotics · Computer Science 2026-03-06 Ivy Xiao He , Stefanie Tellex , Jason Xinyu Liu

Decision tree (and its extensions such as Gradient Boosting Decision Trees and Random Forest) is a widely used machine learning algorithm, due to its practical effectiveness and model interpretability. With the emergence of big data, there…

Machine Learning · Computer Science 2016-11-07 Qi Meng , Guolin Ke , Taifeng Wang , Wei Chen , Qiwei Ye , Zhi-Ming Ma , Tie-Yan Liu

In this paper, we present a novel formulation of traditional sampling-based motion planners as database-oracle structures that can be solved via quantum search algorithms. We consider two complementary scenarios: for simpler sparse…

Quantum Physics · Physics 2023-10-25 Paul Lathrop , Beth Boardman , Sonia Martínez

Path planning is a crucial algorithmic approach for designing robot behaviors. Sampling-based approaches, like rapidly exploring random trees (RRTs) or probabilistic roadmaps, are prominent algorithmic solutions for path planning problems.…

Robotics · Computer Science 2022-08-05 T. Dam , G. Chalvatzaki , J. Peters , J. Pajarinen

The POMDP is a powerful framework for reasoning under outcome and information uncertainty, but constructing an accurate POMDP model is difficult. Bayes-Adaptive Partially Observable Markov Decision Processes (BA-POMDPs) extend POMDPs to…

Artificial Intelligence · Computer Science 2018-06-15 Sammie Katt , Frans A. Oliehoek , Christopher Amato

Optimal motion planning involves obstacles avoidance where path planning is the key to success in optimal motion planning. Due to the computational demands, most of the path planning algorithms can not be employed for real-time based…

Robotics · Computer Science 2022-02-15 Geesara Kulathunga