English
Related papers

Related papers: Improving Automated Driving through POMDP Planning…

200 papers

Planning robust executions under uncertainty is a fundamental challenge for building autonomous robots. Partially Observable Markov Decision Processes (POMDPs) provide a standard framework for modeling uncertainty in many applications. In…

Robotics · Computer Science 2018-05-10 Yue Wang , Swarat Chaudhuri , Lydia E. Kavraki

Partially Observable Markov Decision Process (POMDP) is a mathematical framework for modeling decision-making under uncertainty, where the agent's observations are incomplete and the underlying system dynamics are probabilistic. Solving the…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Yide Yu , Yue Liu , Xiaochen Yuan , Dennis Wong , Huijie Li , Yan Ma

This article addresses obstacle avoidance motion planning for autonomous vehicles, specifically focusing on highway overtaking maneuvers. The control design challenge is handled by considering a mathematical vehicle model that captures both…

Systems and Control · Electrical Eng. & Systems 2026-04-03 Gianni Cario , Valentino Carriuolo , Alessandro Casavola , Gianfranco Gagliardi , Marco Lupia , Franco Angelo Torchiaro

Path planning for autonomous driving with dynamic obstacles poses a challenge because it needs to perform a higher-dimensional search (with time-dimension) while still meeting real-time constraints. This paper proposes an algorithm-hardware…

Robotics · Computer Science 2022-05-30 Mulong Luo , G. Edward Suh

In the theory of Partially Observed Markov Decision Processes (POMDPs), existence of optimal policies have in general been established via converting the original partially observed stochastic control problem to a fully observed one on the…

Optimization and Control · Mathematics 2022-01-11 Ali Devran Kara , Serdar Yuksel

Partially Observable Markov Decision Processes (POMDPs) are the standard framework for decision-making under uncertainty. While sampling-based methods scale well, they lack formal correctness guarantees, making them unsuitable for…

Artificial Intelligence · Computer Science 2026-05-15 Debraj Chakraborty , Anirban Majumdar , Prince Mathew , Sayan Mukherjee , Jean-François Raskin

This paper marries two state-of-the-art controller synthesis methods for partially observable Markov decision processes (POMDPs), a prominent model in sequential decision making under uncertainty. A central issue is to find a POMDP…

Logic in Computer Science · Computer Science 2023-05-30 Roman Andriushchenko , Alexander Bork , Milan Češka , Sebastian Junges , Joost-Pieter Katoen , Filip Macák

Interactive partially observable Markov decision processes (I-POMDP) provide a formal framework for planning for a self-interested agent in multiagent settings. An agent operating in a multiagent environment must deliberate about the…

Multiagent Systems · Computer Science 2015-04-06 Ekhlas Sonu , Yingke Chen , Prashant Doshi

The integration of autonomous vehicles (AVs) into the existing transportation infrastructure offers a promising solution to alleviate congestion and enhance mobility. This research explores a novel approach to traffic optimization by…

Multiagent Systems · Computer Science 2025-05-13 Lu Liu , Maonan Wang , Man-On Pun , Xi Xiong

We present a novel hybrid learning-assisted planning method, named HyPlan, for solving the collision-free navigation problem for self-driving cars in partially observable traffic environments. HyPlan combines methods for multi-agent…

Robotics · Computer Science 2026-02-09 Donald Pfaffmann , Matthias Klusch , Marcel Steinmetz

This work evaluates and analyzes the combination of imitation learning (IL) and differentiable model predictive control (MPC) for the application of human-like autonomous driving. We combine MPC with a hierarchical learning-based policy,…

Robotics · Computer Science 2023-06-27 Flavia Sofia Acerbo , Jan Swevers , Tinne Tuytelaars , Tong Duy Son

In this article, we propose an optimization-based integrated behavior planning and motion control scheme, which is an interpretable and adaptable urban autonomous driving solution that complies with complex traffic rules while ensuring…

Robotics · Computer Science 2023-12-01 Haichao Liu , Kai Chen , Yulin Li , Zhenmin Huang , Jianghua Duan , Jun Ma

We study synthesis problems with constraints in partially observable Markov decision processes (POMDPs), where the objective is to compute a strategy for an agent that is guaranteed to satisfy certain safety and performance specifications.…

This article provides an introductory tutorial on structural results in partially observed Markov decision processes (POMDPs). Typically, computing the optimal policy of a POMDP is computationally intractable. We use lattice program- ming…

Optimization and Control · Mathematics 2015-12-15 Vikram Krishnamurthy

Our goal is to enable robots to plan sequences of tabletop actions to push a block with unknown physical properties to a desired goal pose. We approach this problem by learning the constituent models of a Partially-Observable Markov…

Robotics · Computer Science 2025-07-02 Atharv Jain , Seiji Shaw , Nicholas Roy

We study an approximation method for partially observed Markov decision processes (POMDPs) with continuous spaces. Belief MDP reduction, which has been the standard approach to study POMDPs requires rigorous approximation methods for…

Optimization and Control · Mathematics 2025-01-20 Ali Devran Kara , Erhan Bayraktar , Serdar Yuksel

In this work, we study dynamic programming (DP) algorithms for partially observable Markov decision processes with jointly continuous and discrete state-spaces. We consider a class of stochastic systems which have coupled discrete and…

Optimization and Control · Mathematics 2019-03-07 Donghwan Lee , Niao He , Jianghai Hu

Small uninhabited aerial vehicles (sUAVs) commonly rely on active propulsion to stay airborne, which limits flight time and range. To address this, autonomous soaring seeks to utilize free atmospheric energy in the form of updrafts…

Robotics · Computer Science 2018-05-28 Iain Guilliard , Richard Rogahn , Jim Piavis , Andrey Kolobov

In robotic insertion tasks where the uncertainty exceeds the allowable tolerance, a good search strategy is essential for successful insertion and significantly influences efficiency. The commonly used blind search method is time-consuming…

Robotics · Computer Science 2024-04-08 Chen Wang , Haoxiang Luo , Kun Zhang , Hua Chen , Jia Pan , Wei Zhang

In this paper, we consider the problem of controlling a partially observed Markov decision process (POMDP) in order to actively estimate its state trajectory over a fixed horizon with minimal uncertainty. We pose a novel active smoothing…

Systems and Control · Electrical Eng. & Systems 2021-04-06 Timothy L. Molloy , Girish N. Nair
‹ Prev 1 8 9 10 Next ›