English
Related papers

Related papers: POMDP-Based Trajectory Planning for On-Ramp Highwa…

200 papers

Partially Observable Markov Decision Processes (POMDPs) model decision making under uncertainty. While there are many approaches to approximately solving POMDPs, we aim to address the problem of learning such models. In particular, we are…

Artificial Intelligence · Computer Science 2025-05-13 Aidan Curtis , Hao Tang , Thiago Veloso , Kevin Ellis , Joshua Tenenbaum , Tomás Lozano-Pérez , Leslie Pack Kaelbling

Robots operating in complex and unknown environments frequently require geometric-semantic representations of the environment to safely perform their tasks. While inferring the environment, they must account for many possible scenarios when…

Robotics · Computer Science 2025-10-09 Tuvy Lemberg , Vadim Indelman

Partially observable Markov decision processes (POMDPs) have recently become popular among many AI researchers because they serve as a natural model for planning under uncertainty. Value iteration is a well-known algorithm for finding…

Artificial Intelligence · Computer Science 2011-06-02 N. L. Zhang , W. Zhang

This study presents a robust optimization algorithm for automated highway merge. The merging scenario is one of the challenging scenes in automated driving, because it requires adjusting ego vehicle's speed to match other vehicles before…

Robotics · Computer Science 2025-03-20 Takeru Goto , Kosuke Toda , Takayasu Kumano

The main goal in task planning is to build a sequence of actions that takes an agent from an initial state to a goal state. In robotics, this is particularly difficult because actions usually have several possible results, and sensors are…

Artificial Intelligence · Computer Science 2021-04-12 Sergio A. Serrano , Elizabeth Santiago , Jose Martinez-Carranza , Eduardo Morales , L. Enrique Sucar

Robots often face challenges in domestic environments where visual feedback is ineffective, such as retrieving objects obstructed by occlusions or finding a light switch in the dark. In these cases, utilizing contacts to localize the target…

Robotics · Computer Science 2024-09-30 Muhammad Suhail Saleem , Rishi Veerapaneni , Maxim Likhachev

Robots operating in real-world environments must reason about possible outcomes of stochastic actions and make decisions based on partial observations of the true world state. A major challenge for making accurate and robust action…

Robotics · Computer Science 2023-07-28 Ricardo Cannizzaro , Lars Kunze

Safe autonomous driving in urban areas requires robust algorithms to avoid collisions with other traffic participants with limited perception ability. Current deployed approaches relying on Autonomous Emergency Braking (AEB) systems are…

Robotics · Computer Science 2019-04-29 Markus Schratter , Maxime Bouton , Mykel J. Kochenderfer , Daniel Watzenig

Partially Observable Markov Decision Processes (POMDPs) provide a principled mathematical framework for decision-making under uncertainty. However, the exact solution to POMDPs is computationally intractable. In this paper, we address the…

Robotics · Computer Science 2026-04-03 Da Kong , Vadim Indelman

Partially Observable Markov Decision Process (POMDP) is a mathematical framework for modeling decision-making under uncertainty, where the agent's observations are incomplete and the underlying system dynamics are probabilistic. Solving the…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Yide Yu , Yue Liu , Xiaochen Yuan , Dennis Wong , Huijie Li , Yan Ma

Trajectory optimization is a fundamental problem in robotics. While optimization of continuous control trajectories is well developed, many applications require both discrete and continuous, i.e., hybrid, controls. Finding an optimal…

Robotics · Computer Science 2017-03-03 Joni Pajarinen , Ville Kyrki , Michael Koval , Siddhartha Srinivasa , Jan Peters , Gerhard Neumann

Properly calibrated human trust is essential for successful interaction between humans and automation. However, while human trust calibration can be improved by increased automation transparency, too much transparency can overwhelm human…

Human-Computer Interaction · Computer Science 2023-04-17 Kumar Akash , Neera Jain , Teruhisa Misu

Partially observable Markov decision processes (POMDPs) are a general mathematical model for sequential decision-making in stochastic environments under state uncertainty. POMDPs are often solved \textit{online}, which enables the algorithm…

Artificial Intelligence · Computer Science 2025-03-26 Yunuo Zhang , Baiting Luo , Ayan Mukhopadhyay , Abhishek Dubey

This article addresses obstacle avoidance motion planning for autonomous vehicles, specifically focusing on highway overtaking maneuvers. The control design challenge is handled by considering a mathematical vehicle model that captures both…

Systems and Control · Electrical Eng. & Systems 2026-04-03 Gianni Cario , Valentino Carriuolo , Alessandro Casavola , Gianfranco Gagliardi , Marco Lupia , Franco Angelo Torchiaro

Autonomous robot navigation systems often rely on hierarchical planning, where global planners compute collision-free paths without considering dynamics, and local planners enforce dynamics constraints to produce executable commands. This…

Robotics · Computer Science 2025-10-14 Yuanjie Lu , Mingyang Mao , Tong Xu , Linji Wang , Xiaomin Lin , Xuesu Xiao

Partially Observable Markov Decision Processes (POMDPs) offer a promising world representation for autonomous agents, as they can model both transitional and perceptual uncertainties. Calculating the optimal solution to POMDP problems can…

Artificial Intelligence · Computer Science 2022-10-25 Sigurdur Orn Adalgeirsson , Cynthia Breazeal

We consider partially observable Markov decision processes (POMDPs) with a set of target states and positive integer costs associated with every transition. The traditional optimization objective (stochastic shortest path) asks to minimize…

Artificial Intelligence · Computer Science 2016-05-12 Tomáš Brázdil , Krishnendu Chatterjee , Martin Chmelík , Anchit Gupta , Petr Novotný

When mobile robots maneuver near people, they run the risk of rudely blocking their paths; but not all people behave the same around robots. People that have not noticed the robot are the most difficult to predict. This paper investigates…

Robotics · Computer Science 2018-09-25 Minkyu Kim , Jaemin Lee , Steven Jens Jorgensen , Luis Sentis

Highway merging scenarios featuring mixed traffic conditions pose significant modeling and control challenges for connected and automated vehicles (CAVs) interacting with incoming on-ramp human-driven vehicles (HDVs). In this paper, we…

Machine Learning · Computer Science 2023-04-04 Nishanth Venkatesh , Viet-Anh Le , Aditya Dave , Andreas A. Malikopoulos

In this paper we present a model predictive control (MPC) approach to optimize vehicle scheduling and routing in an autonomous mobility-on-demand (AMoD) system. In AMoD systems, robotic, self-driving vehicles transport customers within an…

Systems and Control · Computer Science 2017-08-15 Rick Zhang , Federico Rossi , Marco Pavone