English
Related papers

Related papers: POMP: Pomcp-based Online Motion Planning for activ…

200 papers

Optimal decision-making presents a significant challenge for autonomous systems operating in uncertain, stochastic and time-varying environments. Environmental variability over time can significantly impact the system's optimal decision…

Robotics · Computer Science 2024-03-11 Gokul Puthumanaillam , Xiangyu Liu , Negar Mehr , Melkior Ornik

Exploring the most task-friendly camera setting -- optimal camera placement (OCP) problem -- in tasks that use multiple cameras is of great importance. However, few existing OCP solutions specialize in depth observation of indoor scenes,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Yichuan Chen , Manabu Tsukada , Hiroshi Esaki

Decentralized multi-agent path finding (MAPF) routes a team of agents on a shared grid, each acting from its own local view. The standard solution trains one shared neural policy with Proximal Policy Optimization (PPO), a popular on-policy…

Machine Learning · Computer Science 2026-05-13 Riad Ahmed

We investigate improving Monte Carlo Tree Search based solvers for Partially Observable Markov Decision Processes (POMDPs), when applied to adaptive sampling problems. We propose improvements in rollout allocation, the action exploration…

Robotics · Computer Science 2021-09-27 Gautam Salhotra , Christopher E. Denniston , David A. Caron , Gaurav S. Sukhatme

When mobile robots maneuver near people, they run the risk of rudely blocking their paths; but not all people behave the same around robots. People that have not noticed the robot are the most difficult to predict. This paper investigates…

Robotics · Computer Science 2018-09-25 Minkyu Kim , Jaemin Lee , Steven Jens Jorgensen , Luis Sentis

Viewpoint planning is an important task in any application where objects or scenes need to be viewed from different angles to achieve sufficient coverage. The mapping of confined spaces such as shelves is an especially challenging task…

Robotics · Computer Science 2023-07-25 Nils Dengler , Sicong Pan , Vamsi Kalagaturu , Rohit Menon , Murad Dawood , Maren Bennewitz

The design of autonomous agents that can interact effectively with other agents without prior coordination is a core problem in multi-agent systems. Type-based reasoning methods achieve this by maintaining a belief over a set of potential…

Artificial Intelligence · Computer Science 2023-06-12 Jonathon Schwartz , Hanna Kurniawati , Marcus Hutter

Decision-making for automated driving remains a challenging task. For their integration into real platforms, these algorithms must guarantee passenger safety and comfort while ensuring interpretability and an appropriate computational time.…

Robotics · Computer Science 2024-10-28 Karim Essalmi , Fernando Garrido , Fawzi Nashashibi

Currently, large partially observable Markov decision processes (POMDPs) are often solved by sampling-based online methods which interleave planning and execution phases. However, a pre-computed offline policy is more desirable in POMDP…

Artificial Intelligence · Computer Science 2025-07-29 Yang You , Vincent Thomas , Alex Schutz , Robert Skilton , Nick Hawes , Olivier Buffet

Today, mobile robots are expected to carry out increasingly complex tasks in multifarious, real-world environments. Often, the tasks require a certain semantic understanding of the workspace. Consider, for example, spoken instructions from…

Robotics · Computer Science 2014-01-21 Javier Velez , Garrett Hemann , Albert S. Huang , Ingmar Posner , Nicholas Roy

We present PLUMES, a planner to localizing and collecting samples at the global maximum of an a priori unknown and partially observable continuous environment. The "maximum-seek-and-sample" (MSS) problem is pervasive in the environmental…

Robotics · Computer Science 2019-09-27 Genevieve Flaspohler , Victoria Preston , Anna P. M. Michel , Yogesh Girdhar , Nicholas Roy

Robots deployed in settings such as warehouses and parking lots must cope with frequent and substantial changes when localizing in their environments. While many previous localization and mapping algorithms have explored methods of…

Robotics · Computer Science 2022-08-02 Amanda Adkins , Taijing Chen , Joydeep Biswas

In this paper, we develop an online active mapping system to enable a quadruped robot to autonomously survey large physical structures. We describe the perception, planning and control modules needed to scan and reconstruct an object of…

Robotics · Computer Science 2020-02-25 Yiduo Wang , Milad Ramezani , Maurice Fallon

Search and rescue missions and surveillance require finding targets in a large area. These tasks often use unmanned aerial vehicles (UAVs) with cameras to detect and move towards a target. However, common UAV approaches make two simplifying…

Artificial Intelligence · Computer Science 2018-01-08 Aayush Gupta , Daniel Bessonov , Patrick Li

Maneuver decision-making can be regarded as a Markov decision process and can be address by reinforcement learning. However, original reinforcement learning algorithms can hardly solve the maneuvering decision-making problem. One reason is…

Artificial Intelligence · Computer Science 2023-09-19 Zhang Hong-Peng

Multi-agent navigation in dynamic environments is of great industrial value when deploying a large scale fleet of robot to real-world applications. This paper proposes a decentralized partially observable multi-agent path planning with…

Robotics · Computer Science 2020-08-03 Zuxin Liu , Baiming Chen , Hongyi Zhou , Guru Koushik , Martial Hebert , Ding Zhao

We present an integrated Task-Motion Planning (TMP) framework for navigation in large-scale environments. Of late, TMP for manipulation has attracted significant interest resulting in a proliferation of different approaches. In contrast,…

Robotics · Computer Science 2021-11-05 Antony Thomas , Fulvio Mastrogiovanni , Marco Baglietto

This paper proposes Partially Observable Reference Policy Programming, a novel anytime online approximate POMDP solver which samples meaningful future histories very deeply while simultaneously forcing a gradual policy update. We provide…

Artificial Intelligence · Computer Science 2025-07-17 Edward Kim , Hanna Kurniawati

Planning under partial observability is an essential capability of autonomous robots. The Partially Observable Markov Decision Process (POMDP) provides a powerful framework for planning under partial observability problems, capturing the…

Robotics · Computer Science 2026-03-11 Marcus Hoerger , Muhammad Sudrajat , Hanna Kurniawati

Knowledge of terrain's physical properties inferred from color images can aid in making efficient robotic locomotion plans. However, unlike image classification, it is unintuitive for humans to label image patches with physical properties.…

Robotics · Computer Science 2023-11-03 Gabriel B. Margolis , Xiang Fu , Yandong Ji , Pulkit Agrawal