English
Related papers

Related papers: Planning for robotic exploration based on forward …

200 papers

In many real-world applications (e.g., planetary exploration, robot navigation), an autonomous agent must be able to explore a space with guaranteed safety. Most safe exploration algorithms in the field of reinforcement learning and…

Artificial Intelligence · Computer Science 2018-09-13 Akifumi Wachi , Hiroshi Kajino , Asim Munawar

Path planning for robotic coverage is the task of determining a collision-free robot trajectory that observes all points of interest in an environment. Robots employed for such tasks are often capable of exercising active control over…

Robotics · Computer Science 2020-11-17 Tushar Kusnur , Dhruv Mauria Saxena , Maxim Likhachev

Uncertainties in dynamic road environments pose significant challenges for behavior and trajectory planning in autonomous driving. This paper introduces Hi-Drive, a hierarchical planning algorithm addressing uncertainties at both behavior…

Robotics · Computer Science 2025-10-16 Xuanjin Jin , Chendong Zeng , Shengfa Zhu , Chunxiao Liu , Panpan Cai

We present a method for solving the coverage problem with the objective of autonomously exploring an unknown environment under mission time constraints. Here, the robot is tasked with planning a path over a horizon such that the accumulated…

We study the problem of dynamic spectrum sensing and access in cognitive radio systems as a partially observed Markov decision process (POMDP). A group of cognitive users cooperatively tries to exploit vacancies in primary (licensed)…

Networking and Internet Architecture · Computer Science 2010-02-06 Jayakrishnan Unnikrishnan , Venugopal Veeravalli

In this study I proposed a filtering beliefs method for improving performance of Partially Observable Markov Decision Processes(POMDPs), which is a method wildly used in autonomous robot and many other domains concerning control policy. My…

Artificial Intelligence · Computer Science 2021-01-07 Oscar LiJen Hsu

The partially observable Markov decision process (POMDP) provides a principled general model for planning under uncertainty. However, solving a general POMDP is computationally intractable in the worst case. This paper introduces…

Artificial Intelligence · Computer Science 2016-02-24 Min Chen , Emilio Frazzoli , David Hsu , Wee Sun Lee

As artificial intelligence (AI) algorithms are increasingly used in mission-critical applications, promoting user-trust of these systems will be essential to their success. Ensuring users understand the models over which algorithms reason…

Artificial Intelligence · Computer Science 2026-04-27 Benjamin D. Kraske , Anshu Saksena , Anna L. Buczak , Zachary N. Sunberg

Exploration and collision-free navigation through an unknown environment is a fundamental task for autonomous robots. In this paper, a novel exploration strategy for Micro Aerial Vehicles (MAVs) is presented. The goal of the exploration…

Robotics · Computer Science 2020-12-09 Anna Dai , Sotiris Papatheodorou , Nils Funk , Dimos Tzoumanikas , Stefan Leutenegger

In realistic applications of object search, robots will need to locate target objects in complex environments while coping with unreliable sensors, especially for small or hard-to-detect objects. In such settings, correlational information…

Robotics · Computer Science 2022-04-04 Kaiyu Zheng , Rohan Chitnis , Yoonchang Sung , George Konidaris , Stefanie Tellex

Autonomous robots can benefit greatly from human-provided semantic characterizations of uncertain task environments and states. However, the development of integrated strategies which let robots model, communicate, and act on such 'soft…

Robotics · Computer Science 2023-09-01 Luke Burks , Hunter M. Ray , Jamison McGinley , Sousheel Vunnam , Nisar Ahmed

In shared autonomy, user input and robot autonomy are combined to control a robot to achieve a goal. Often, the robot does not know a priori which goal the user wants to achieve, and must both predict the user's intended goal, and assist in…

Robotics · Computer Science 2015-04-21 Shervin Javdani , Siddhartha S. Srinivasa , J. Andrew Bagnell

Future collaborative robots must be capable of finding objects. As such a fundamental skill, we expect object search to eventually become an off-the-shelf capability for any robot, similar to e.g., object detection, SLAM, and motion…

Robotics · Computer Science 2023-05-05 Kaiyu Zheng

The agent learns to organize decision behavior to achieve a behavioral goal, such as reward maximization, and reinforcement learning is often used for this optimization. Learning an optimal behavioral strategy is difficult under the…

Machine Learning · Computer Science 2023-05-09 Kazuki Takahashi , Tomoki Fukai , Yutaka Sakai , Takashi Takekawa

Last-mile delivery systems commonly propose the use of autonomous robotic vehicles to increase scalability and efficiency. The economic inefficiency of collecting accurate prior maps for navigation motivates the use of planning algorithms…

Robotics · Computer Science 2020-06-03 Michael Everett , Justin Miller , Jonathan P. How

This paper presents a comprehensive overview of exploration strategies utilized in both 2D and 3D environments, focusing on autonomous multi-robot systems designed for building exploration and fire detection. We explore the limitations of…

Robotics · Computer Science 2024-11-26 Ankit Shaw

Partially observable Markov decision processes (POMDPs) are a powerful abstraction for tasks that require decision making under uncertainty, and capture a wide range of real world tasks. Today, effective planning approaches exist that…

Machine Learning · Statistics 2018-05-24 Sebastian Tschiatschek , Kai Arulkumaran , Jan Stühmer , Katja Hofmann

Autonomous robots are widely utilized for mapping and exploration tasks due to their cost-effectiveness. Multi-robot systems offer scalability and efficiency, especially in terms of the number of robots deployed in more complex…

Robotics · Computer Science 2025-06-04 Apoorva Vashisth , Manav Kulshrestha , Damon Conover , Aniket Bera

We propose a new reinforcement learning algorithm for partially observable Markov decision processes (POMDP) based on spectral decomposition methods. While spectral methods have been previously employed for consistent learning of (passive)…

Artificial Intelligence · Computer Science 2017-06-20 Kamyar Azizzadenesheli , Alessandro Lazaric , Animashree Anandkumar

Autonomous exploration is a widely studied problem where a robot incrementally builds a map of a previously unknown environment. The robot selects the next locations to reach using an exploration strategy. To do so, the robot has to balance…

Robotics · Computer Science 2025-08-15 Matteo Luperto , Valerii Stakanov , Giacomo Boracchi , Nicola Basilico , Francesco Amigoni