English
Related papers

Related papers: POMDP-Based Trajectory Planning for On-Ramp Highwa…

200 papers

Noisy observations coupled with nonlinear dynamics pose one of the biggest challenges in robot motion planning. By decomposing nonlinear dynamics into a discrete set of local dynamics models, hybrid dynamics provide a natural way to model…

Robotics · Computer Science 2018-10-10 Ajinkya Jain , Scott Niekum

Modeling dynamics is often the first step to making a vehicle autonomous. While on-road autonomous vehicles have been extensively studied, off-road vehicles pose many challenging modeling problems. An off-road vehicle encounters highly…

We consider a class of partially observable Markov decision processes (POMDPs) with uncertain transition and/or observation probabilities. The uncertainty takes the form of probability intervals. Such uncertain POMDPs can be used, for…

Systems and Control · Computer Science 2018-07-12 Mohamadreza Ahmadi , Murat Cubuktepe , Nils Jansen , Ufuk Topcu

We consider a finite-state partially observable Markov decision problem (POMDP) with an infinite horizon and a discounted cost, and we propose a new method for computing a cost function approximation that is based on features and…

Systems and Control · Electrical Eng. & Systems 2025-07-08 Yuchao Li , Kim Hammar , Dimitri Bertsekas

Solving partially observable Markov decision processes (POMDPs) with high dimensional and continuous observations, such as camera images, is required for many real life robotics and planning problems. Recent researches suggested machine…

Artificial Intelligence · Computer Science 2025-05-27 Idan Lev-Yehudi , Moran Barenboim , Vadim Indelman

Scientists often search for phenomena of interest while exploring new environments. Autonomous vehicles are deployed to explore such areas where human-operated vehicles would be costly or dangerous. Online control of autonomous vehicles for…

Multiagent Systems · Computer Science 2025-09-12 Jake Olkin , Viraj Parimi , Brian Williams

A state space representation of an environment is a classic and yet powerful tool used by many autonomous robotic systems for efficient and often optimal solution planning. However, designing these representations with high performance is…

Machine Learning · Computer Science 2020-12-23 Andrew Wilhelm , Aaron Wilhelm , Garrett Fosdick

Autonomous agents such as self-driving cars or parcel robots need to recognize and avoid possible collisions with obstacles in order to move successfully in their environment. Humans, however, have learned to predict movements intuitively…

Machine Learning · Computer Science 2020-11-30 Carsten Hahn , Sebastian Feld , Hannes Schroter

Human-robot collaboration (HRC) has emerged as a hot research area at the intersection of control, robotics, and psychology in recent years. It is of critical importance to obtain an expressive but meanwhile tractable model for human beings…

Robotics · Computer Science 2019-05-16 Wei Zheng , Hai Lin

Merging at highway on-ramps while interacting with other human-driven vehicles is challenging for autonomous vehicles (AVs). An efficient route to this challenge requires exploring and exploiting knowledge of the interaction process from…

Robotics · Computer Science 2021-08-04 Huanjie Wang , Wenshuo Wang , Shihua Yuan , Xueyuan Li , Lijun Sun

Partially observable Markov decision processes (POMDPs) are a powerful abstraction for tasks that require decision making under uncertainty, and capture a wide range of real world tasks. Today, effective planning approaches exist that…

Machine Learning · Statistics 2018-05-24 Sebastian Tschiatschek , Kai Arulkumaran , Jan Stühmer , Katja Hofmann

Recent work has considered trust-aware decision making for human-robot collaboration (HRC) with a focus on model learning. In this paper, we are interested in enabling the HRC system to complete complex tasks specified using temporal logic…

Robotics · Computer Science 2023-10-03 Pian Yu , Shuyang Dong , Shili Sheng , Lu Feng , Marta Kwiatkowska

Searching for objects in cluttered environments requires selecting efficient viewpoints and manipulation actions to remove occlusions and reduce uncertainty in object locations, shapes, and categories. In this work, we address the problem…

Mapping is essential in robotics and autonomous systems because it provides the spatial foundation for path planning. Efficient mapping enables planning algorithms to generate reliable paths while ensuring safety and adapting in real time…

Robotics · Computer Science 2026-05-22 Yihui Mao , Tian Tan , Xuehui Shen , Warren E. Dixon , Rushikesh Kamalapurkar

Partially Observable Markov Decision Processes (POMDPs) are a general and principled framework for motion planning under uncertainty. Despite tremendous improvement in the scalability of POMDP solvers, long-horizon POMDPs (e.g., $\geq15$…

Robotics · Computer Science 2024-11-12 Yuanchu Liang , Edward Kim , Wil Thomason , Zachary Kingston , Hanna Kurniawati , Lydia E. Kavraki

This paper presents an automatic merging algorithm for autonomous driving vehicles, which decouples the specific motion planning problem into a Dual-Layer Automatic Merge Planning (DL_AMP) and a Descent-Based Trajectory Optimization (DBTO).…

Robotics · Computer Science 2021-08-02 Yuncheng Jiang , Qi Lin , Jiwei Zhang , Jun Wang , Danjian Qian , Yuxi Cai

Planning under partial observability is an essential capability of autonomous robots. The Partially Observable Markov Decision Process (POMDP) provides a powerful framework for planning under partial observability problems, capturing the…

Robotics · Computer Science 2026-03-11 Marcus Hoerger , Muhammad Sudrajat , Hanna Kurniawati

As artificial intelligence (AI) algorithms are increasingly used in mission-critical applications, promoting user-trust of these systems will be essential to their success. Ensuring users understand the models over which algorithms reason…

Artificial Intelligence · Computer Science 2026-04-27 Benjamin D. Kraske , Anshu Saksena , Anna L. Buczak , Zachary N. Sunberg

This work introduces a novel deep learning-based architecture, termed the Deep Belief Markov Model (DBMM), which provides efficient, model-formulation agnostic inference in Partially Observable Markov Decision Process (POMDP) problems. The…

Machine Learning · Computer Science 2025-03-18 Giacomo Arcieri , Konstantinos G. Papakonstantinou , Daniel Straub , Eleni Chatzi

Navigating automated driving systems (ADSs) through complex driving environments is difficult. Predicting the driving behavior of surrounding human-driven vehicles (HDVs) is a critical component of an ADS. This paper proposes an enhanced…

Robotics · Computer Science 2023-08-04 Ni Dong , Shuming Chen , Yina Wu , Yiheng Feng , Xiaobo Liu