English
Related papers

Related papers: Shrinking POMCP: A Framework for Real-Time UAV Sea…

200 papers

We address the problem of controlling a mobile robot to explore a partially known environment. The robot's objective is the maximization of the amount of information collected about the environment. We formulate the problem as a partially…

Robotics · Computer Science 2017-03-08 Mikko Lauri , Risto Ritala

Planning problems are hard, motion planning, for example, isPSPACE-hard. Such problems are even more difficult in the presence of uncertainty. Although, Markov Decision Processes (MDPs) provide a formal framework for such problems, finding…

Artificial Intelligence · Computer Science 2013-01-14 Carlos E. Guestrin , Dirk Ormoneit

Aerial scans with unmanned aerial vehicles (UAVs) are becoming more widely adopted across industries, from smart farming to urban mapping. An application area that can leverage the strength of such systems is search and rescue (SAR)…

Robotics · Computer Science 2023-04-12 Phuoc Nguyen Thuan , Jorge Peña Queralta , Tomi Westerlund

This paper addresses path planning of an unmanned aerial vehicle (UAV) with remote sensing capabilities (or wireless communication capabilities). The goal of the path planning is to find a minimum-flight-time closed tour of the UAV visiting…

Robotics · Computer Science 2016-12-20 Dae-Sung Jang , Hyeok-Joo Chae , Han-Lim Choi

This paper proposes Partially Observable Reference Policy Programming, a novel anytime online approximate POMDP solver which samples meaningful future histories very deeply while simultaneously forcing a gradual policy update. We provide…

Artificial Intelligence · Computer Science 2025-07-17 Edward Kim , Hanna Kurniawati

Simultaneous localization and Planning (SLAP) is a crucial ability for an autonomous robot operating under uncertainty. In its most general form, SLAP induces a continuous POMDP (partially-observable Markov decision process), which needs to…

Online planning for partially observable Markov decision processes (POMDPs) provides efficient techniques for robot decision-making under uncertainty. However, existing methods fall short of preventing safety violations in dynamic…

Robotics · Computer Science 2024-09-10 Shili Sheng , Pian Yu , David Parker , Marta Kwiatkowska , Lu Feng

The most crucial challenges for UAVs are planning paths and avoiding obstacles in their way. In recent years, a wide variety of path-planning algorithms have been developed. These algorithms have successfully solved path-planning problems;…

Robotics · Computer Science 2025-08-27 Hichem Cheriet , Khellat Kihel Badra , Chouraqui Samira

Most applications in autonomous navigation using mounted cameras rely on the construction and processing of geometric 3D point clouds, which is an expensive process. However, there is another simpler way to make a space navigable quickly:…

Robotics · Computer Science 2025-04-04 Khizar Anjum , Parul Pandey , Vidyasagar Sadhu , Roberto Tron , Dario Pompili

We consider partially observable Markov decision processes (POMDPs) with a set of target states and positive integer costs associated with every transition. The traditional optimization objective (stochastic shortest path) asks to minimize…

Artificial Intelligence · Computer Science 2016-05-12 Tomáš Brázdil , Krishnendu Chatterjee , Martin Chmelík , Anchit Gupta , Petr Novotný

Efficiently locating target objects in complex indoor environments with diverse furniture, such as shelves, tables, and beds, is a significant challenge for mobile robots. This difficulty arises from factors like localization errors,…

Robotics · Computer Science 2026-04-17 Yongbo Chen , Hesheng Wang , Shoudong Huang , Hanna Kurniawati

This work presents a cognitive radar (CR) framework to enhance remote sensing performance, specifically focusing on tracking multiple targets under unknown disturbances using massive multiple-input multiple-output (MMIMO) systems. Since…

Signal Processing · Electrical Eng. & Systems 2026-04-15 Imad Bouhou , Stefano Fortunati , Leila Gharsalli , Alexandre Renaux

In this paper, we present a motion planning strategy for UAVs that generates a time-optimal trajectory to survey a given target area. There are several situations where completing an aerial survey is time sensitive, such as gaining…

Robotics · Computer Science 2022-03-08 Tankasala Srinath , Pehlivanturk Can , Pryor Mitch

This paper addresses a UAV path planning task that seeks to observe a set of objects while satisfying the observation quality constraint. A dynamic programming algorithm is proposed that enables the UAV to observe the target objects with…

Robotics · Computer Science 2024-11-12 Jiawei Wang , Weiwei Wu , Yijing Wang , Yan Lyu , Vincent Chau

This paper presents a hybrid online Partially Observable Markov Decision Process (POMDP) planning system that addresses the problem of autonomous navigation in the presence of multi-modal uncertainty introduced by other agents in the…

Robotics · Computer Science 2022-06-22 Himanshu Gupta , Bradley Hayes , Zachary Sunberg

Partially Observable Markov Decision Processes (POMDPs) offer a promising world representation for autonomous agents, as they can model both transitional and perceptual uncertainties. Calculating the optimal solution to POMDP problems can…

Artificial Intelligence · Computer Science 2022-10-25 Sigurdur Orn Adalgeirsson , Cynthia Breazeal

In this paper we focus on the problem of learning online an optimal policy for Active Visual Search (AVS) of objects in unknown indoor environments. We propose POMP++, a planning strategy that introduces a novel formulation on top of the…

To plan safely in uncertain environments, agents must balance utility with safety constraints. Safe planning problems can be modeled as a chance-constrained partially observable Markov decision process (CC-POMDP) and solutions often use…

Artificial Intelligence · Computer Science 2024-05-02 Robert J. Moss , Arec Jamgochian , Johannes Fischer , Anthony Corso , Mykel J. Kochenderfer

How can we plan efficiently in a large and complex environment when the time budget is limited? Given the original simulator of the environment, which may be computationally very demanding, we propose to learn online an approximate but much…

Artificial Intelligence · Computer Science 2022-12-14 Jinke He , Miguel Suau , Hendrik Baier , Michael Kaisers , Frans A. Oliehoek

Noisy observations coupled with nonlinear dynamics pose one of the biggest challenges in robot motion planning. By decomposing nonlinear dynamics into a discrete set of local dynamics models, hybrid dynamics provide a natural way to model…

Robotics · Computer Science 2018-10-10 Ajinkya Jain , Scott Niekum