English
Related papers

Related papers: Intention-Aware Navigation in Crowds with Extended…

200 papers

This paper presents a modeling and optimization framework to study congestion-aware ride-pooling Autonomous Mobility-on-Demand (AMoD) systems, whereby self-driving robotaxis are providing on-demand mobility, and users headed in the same…

Systems and Control · Electrical Eng. & Systems 2023-11-07 Fabio Paparella , Leonardo Pedroso , Theo Hofman , Mauro Salazar

Safe and reliable autonomy solutions are a critical component of next-generation intelligent transportation systems. Autonomous vehicles in such systems must reason about complex and dynamic driving scenes in real time and anticipate the…

Robotics · Computer Science 2022-07-13 Liam A. Kruse , Esen Yel , Ransalu Senanayake , Mykel J. Kochenderfer

Autonomous agents that operate in the real world must often deal with partial observability, which is commonly modeled as partially observable Markov decision processes (POMDPs). However, traditional POMDP models rely on the assumption of…

Artificial Intelligence · Computer Science 2023-08-03 Moran Barenboim , Idan Lev-Yehudi , Vadim Indelman

We propose a neural network architecture, called TransNet, that combines planning and model learning for solving Partially Observable Markov Decision Processes (POMDPs) with non-uniform system dynamics. The past decade has seen a…

Robotics · Computer Science 2019-07-11 Nicholas Collins , Hanna Kurniawati

We propose to control handoffs (HOs) in user-centric cell-free massive MIMO networks through a partially observable Markov decision process (POMDP) with the state space representing the discrete versions of the large-scale fading (LSF) and…

Information Theory · Computer Science 2022-08-09 Hussein A. Ammar , Raviraj Adve , Shahram Shahbazpanahi , Gary Boudreau , Kothapalli Venkata Srinivas

In this paper, we consider the problem of controlling a partially observed Markov decision process (POMDP) in order to actively estimate its state trajectory over a fixed horizon with minimal uncertainty. We pose a novel active smoothing…

Systems and Control · Electrical Eng. & Systems 2021-04-06 Timothy L. Molloy , Girish N. Nair

Motion planning of autonomous agents in partially known environments with incomplete information is a challenging problem, particularly for complex tasks. This paper proposes a model-free reinforcement learning approach to address this…

Artificial Intelligence · Computer Science 2023-05-02 Junchao Li , Mingyu Cai , Zhen Kan , Shaoping Xiao

Solving partially observable Markov decision processes (POMDPs) with high dimensional and continuous observations, such as camera images, is required for many real life robotics and planning problems. Recent researches suggested machine…

Artificial Intelligence · Computer Science 2025-05-27 Idan Lev-Yehudi , Moran Barenboim , Vadim Indelman

In this article we propose a qualitative (ordinal) counterpart for the Partially Observable Markov Decision Processes model (POMDP) in which the uncertainty, as well as the preferences of the agent, are modeled by possibility distributions.…

Artificial Intelligence · Computer Science 2013-01-30 Regis Sabbadin

Monotonic Partially Observable Markov Decision Processes (POMDPs), where the system state progressively decreases until a restorative action is performed, can be used to model sequential repair problems effectively. This paper considers the…

Machine Learning · Computer Science 2025-09-17 Manav Vora , Jonas Liang , Michael N. Grussing , Melkior Ornik

Autonomous motion planning is challenging in multi-obstacle environments due to nonconvex collision avoidance constraints. Directly applying numerical solvers to these nonconvex formulations fails to exploit the constraint structures,…

Robotics · Computer Science 2023-04-06 Ruihua Han , Shuai Wang , Shuaijun Wang , Zeqing Zhang , Qianru Zhang , Yonina C. Eldar , Qi Hao , Jia Pan

Collision-free navigation in cluttered environments with static and dynamic obstacles is essential for many multi-robot tasks. Dynamic obstacles may also be interactive, i.e., their behavior varies based on the behavior of other entities.…

Robotics · Computer Science 2024-05-21 Baskın Şenbaşlar , Gaurav S. Sukhatme

Autonomous robots operating in large knowledgeintensive domains require planning in the discrete (task) space and the continuous (motion) space. In knowledge-intensive domains, on the one hand, robots have to reason at the highestlevel, for…

Robotics · Computer Science 2020-10-05 Antony Thomas , Fulvio Mastrogiovanni , Marco Baglietto

Autonomous navigation in unfamiliar environments requires robots to simultaneously explore, localise, and plan under uncertainty, without relying on predefined maps or extensive training. We present Active Inference MAPping and Planning…

Robotics · Computer Science 2026-04-23 Daria de tinguy , Tim Verbelen , Emilio Gamba , Bart Dhoedt

This paper is concerned with planning in stochastic domains by means of partially observable Markov decision processes (POMDPs). POMDPs are difficult to solve. This paper identifies a subclass of POMDPs called region observable POMDPs,…

Artificial Intelligence · Computer Science 2013-02-08 Nevin Lianwen Zhang , Wenju Liu

Searching for objects in cluttered environments requires selecting efficient viewpoints and manipulation actions to remove occlusions and reduce uncertainty in object locations, shapes, and categories. In this work, we address the problem…

Critical for the coexistence of humans and robots in dynamic environments is the capability for agents to understand each other's actions, and anticipate their movements. This paper presents Stochastic Process Anticipatory Navigation…

Robotics · Computer Science 2020-11-13 Weiming Zhi , Tin Lai , Lionel Ott , Fabio Ramos

Our goal is to enable robots to plan sequences of tabletop actions to push a block with unknown physical properties to a desired goal pose. We approach this problem by learning the constituent models of a Partially-Observable Markov…

Robotics · Computer Science 2025-07-02 Atharv Jain , Seiji Shaw , Nicholas Roy

Hidden Markov models (HMMs) and partially observable Markov decision processes (POMDPs) provide useful tools for modeling dynamical systems. They are particularly useful for representing the topology of environments such as road networks…

Artificial Intelligence · Computer Science 2011-06-06 L. P. Kaelbling , H. Shatkay

We present a novel approach for efficient and reliable goal-directed long-horizon navigation for a multi-robot team in a structured, unknown environment by predicting statistics of unknown space. Building on recent work in…

Robotics · Computer Science 2023-03-30 Abhish Khanal , Gregory J. Stein