English
Related papers

Related papers: HEADER: Hierarchical Robot Exploration via Attenti…

200 papers

Ideally, we would place a robot in a real-world environment and leave it there improving on its own by gathering more experience autonomously. However, algorithms for autonomous robotic learning have been challenging to realize in the real…

Machine Learning · Computer Science 2023-11-01 Max Balsells , Marcel Torne , Zihan Wang , Samedh Desai , Pulkit Agrawal , Abhishek Gupta

This paper considers the path planning problem for autonomous exploration of an unknown environment using multiple heterogeneous robots such as drones, wheeled, and legged robots, which have different capabilities to traverse complex…

Robotics · Computer Science 2025-10-07 Longrui Yang , Yiyu Wang , Jingfan Tang , Yunpeng Lv , Shizhe Zhao , Chao Cao , Zhongqiang Ren

Sensor-based human activity recognition (HAR) requires to predict the action of a person based on sensor-generated time series data. HAR has attracted major interest in the past few years, thanks to the large number of applications enabled…

Machine Learning · Computer Science 2021-03-30 Davide Buffelli , Fabio Vandin

Exploration in an unknown environment is the core functionality for mobile robots. Learning-based exploration methods, including convolutional neural networks, provide excellent strategies without human-designed logic for the feature…

Robotics · Computer Science 2016-10-10 Lei Tai , Ming Liu

In this work, we introduce PIPER: Primitive-Informed Preference-based Hierarchical reinforcement learning via Hindsight Relabeling, a novel approach that leverages preference-based learning to learn a reward model, and subsequently uses…

Machine Learning · Computer Science 2024-06-18 Utsav Singh , Wesley A. Suttle , Brian M. Sadler , Vinay P. Namboodiri , Amrit Singh Bedi

Exploration systems are critical for enhancing the autonomy of robots. Due to the unpredictability of the future planning space, existing methods either adopt an inefficient greedy strategy or require a lot of resources to obtain a global…

Robotics · Computer Science 2023-07-07 Xuyang Zhao , Chengpu Yu , Erpei Xu , Yixuan Liu

Representations are crucial for a robot to learn effective navigation policies. Recent work has shown that mid-level perceptual abstractions, such as depth estimates or 2D semantic segmentation, lead to more effective policies when provided…

Robotics · Computer Science 2022-05-09 Zachary Ravichandran , Lisa Peng , Nathan Hughes , J. Daniel Griffith , Luca Carlone

Rapid sampling from the environment to acquire available frontier points and timely incorporating them into subsequent planning to reduce fragmented regions are critical to improve the efficiency of autonomous exploration. We propose HPHS,…

Robotics · Computer Science 2024-07-22 Shijun Long , Ying Li , Chenming Wu , Bin Xu , Wei Fan

Autonomous robot exploration (ARE) is the process of a robot autonomously navigating and mapping an unknown environment. Recent Reinforcement Learning (RL)-based approaches typically formulate ARE as a sequential decision-making problem…

Robotics · Computer Science 2025-09-17 Haozhan Ni , Jingsong Liang , Chenyu He , Yuhong Cao , Guillaume Sartoretti

Space exploration missions have seen use of increasingly sophisticated robotic systems with ever more autonomy. Deep learning promises to take this even a step further, and has applications for high-level tasks, like path planning, as well…

Machine Learning · Computer Science 2019-09-16 Tamir Blum , William Jones , Kazuya Yoshida

We present an autonomous exploration system for efficient coverage of unknown environments. First, a rapid environment preprocessing method is introduced to provide environmental information for subsequent exploration planning. Then, the…

Robotics · Computer Science 2025-04-04 Shijun Long , Ying Li , Chenming Wu , Bin Xu , Wei Fan

We present Sadcher, a real-time task assignment framework for heterogeneous multi-robot teams that incorporates dynamic coalition formation and task precedence constraints. Sadcher is trained through Imitation Learning and combines graph…

Robotics · Computer Science 2025-10-17 Jakob Bichler , Andreu Matoses Gimenez , Javier Alonso-Mora

3D spatial perception is the problem of building and maintaining an actionable and persistent representation of the environment in real-time using sensor data and prior knowledge. Despite the fast-paced progress in robot perception, most…

Robotics · Computer Science 2023-05-15 Nathan Hughes , Yun Chang , Siyi Hu , Rajat Talak , Rumaisa Abdulhai , Jared Strader , Luca Carlone

In this paper, we propose SEA, a novel approach for active robot exploration through semantic map prediction and a reinforcement learning-based hierarchical exploration policy. Unlike existing learning-based methods that rely on one-step…

Robotics · Computer Science 2025-12-12 Hongyu Ding , Xinyue Liang , Yudong Fang , You Wu , Jieqi Shi , Jing Huo , Wenbin Li , Jing Wu , Yu-Kun Lai , Yang Gao

This paper presents CONTHER, a novel reinforcement learning algorithm designed to efficiently and rapidly train robotic agents for goal-oriented manipulation tasks and obstacle avoidance. The algorithm uses a modified replay buffer inspired…

Robotics · Computer Science 2025-03-21 Maria Makarova , Qian Liu , Dzmitry Tsetserukou

Hierarchical Reinforcement Learning (HRL) agents often struggle with long-horizon visual planning due to their reliance on error-prone distance metrics. We propose Discrete Hierarchical Planning (DHP), a method that replaces continuous…

Robotics · Computer Science 2025-12-22 Shashank Sharma , Janina Hoffmann , Vinay Namboodiri

To be capable of lifelong learning in a real-life environment, robots have to tackle multiple challenges. Being able to relate physical properties they may observe in their environment to possible interactions they may have is one of them.…

Artificial Intelligence · Computer Science 2020-09-24 Alexandre Manoury , Sao Mai Nguyen , Cédric Buche

Currently, deep reinforcement learning (RL) shows impressive results in complex gaming and robotic environments. Often these results are achieved at the expense of huge computational costs and require an incredible number of episodes of…

Machine Learning · Computer Science 2020-06-18 Alexey Skrynnik , Aleksey Staroverov , Ermek Aitygulov , Kirill Aksenov , Vasilii Davydov , Aleksandr I. Panov

In recent years, robots and autonomous systems have become increasingly integral to our daily lives, offering solutions to complex problems across various domains. Their application in search and rescue (SAR) operations, however, presents…

Robotics · Computer Science 2024-09-23 Dimitrios Panagopoulos , Adolfo Perrusquia , Weisi Guo

Intelligent agents need to select long sequences of actions to solve complex tasks. While humans easily break down tasks into subgoals and reach them through millions of muscle commands, current artificial intelligence is limited to tasks…

Artificial Intelligence · Computer Science 2022-06-10 Danijar Hafner , Kuang-Huei Lee , Ian Fischer , Pieter Abbeel