English
Related papers

Related papers: FH-DRL: Exponential-Hyperbolic Frontier Heuristics…

200 papers

Reinforcement learning-based mapless navigation holds significant potential. However, it faces challenges in indoor environments with local minima area. This paper introduces a safe mapless navigation framework utilizing hierarchical…

Robotics · Computer Science 2025-03-18 Jianqi Gao , Xizheng Pang , Qi Liu , Yanjie Li

The framework of deep reinforcement learning (DRL) provides a powerful and widely applicable mathematical formalization for sequential decision-making. This paper present a novel DRL framework, termed \emph{$f$-Divergence Reinforcement…

Machine Learning · Computer Science 2021-12-15 Chen Gong , Qiang He , Yunpeng Bai , Zhou Yang , Xiaoyu Chen , Xinwen Hou , Xianjie Zhang , Yu Liu , Guoliang Fan

Conventional algorithms in autonomous exploration face challenges due to their inability to accurately and efficiently identify the spatial distribution of convex regions in the real-time map. These methods often prioritize navigation…

Robotics · Computer Science 2025-03-18 Qiming Wang , Yulong Gao , Yang Wang , Xiongwei Zhao , Yijiao Sun , Xiangyan Kong

Hierarchical multi-robot exploration commonly decouples frontier allocation from local navigation, which can make the system brittle in dense and dynamic environments. Because the allocator lacks direct awareness of execution difficulty,…

Robotics · Computer Science 2026-03-10 Ning Liu , Sen Shen , Zheng Li , Sheng Liu , Dongkun Han , Shangke Lyu , Thomas Braunl

Exploration is process of selecting target points that yield the biggest contribution to a specific gain function at an initially unknown environment. Frontier-based exploration is the most common approach to exploration, wherein frontiers…

Robotics · Computer Science 2018-06-12 Anirudh Topiwala , Pranav Inani , Abhishek Kathpal

Deep reinforcement learning (DRL) finds extensive application in autonomous drone navigation within complex, high-risk environments. However, its practical deployment faces a safety-exploration dilemma: soft penalty mechanisms encourage…

Robotics · Computer Science 2026-05-04 Wentao Chen , Jingtang Chen , Mingjian Fu , Tiantian Li , Youfeng Su , Wenxi Liu , Yuanlong Yu

The increasing demand for autonomous systems in complex and dynamic environments has driven significant research into intelligent path planning methodologies. For decades, graph-based search algorithms, linear programming techniques, and…

End-to-end deep reinforcement learning (DRL) for quadrotor control promises many benefits -- easy deployment, task generalization and real-time execution capability. Prior end-to-end DRL-based methods have showcased the ability to deploy…

An exciting and promising frontier for Deep Reinforcement Learning (DRL) is its application to real-world robotic systems. While modern DRL approaches achieved remarkable successes in many robotic scenarios (including mobile robotics,…

Machine Learning · Computer Science 2024-06-03 Davide Corsi , Davide Camponogara , Alessandro Farinelli

This paper proposes a momentum-constrained hybrid heuristic trajectory optimization framework (MHHTOF) tailored for assistive navigation in visually impaired scenarios, integrating trajectory sampling generation, optimization and evaluation…

Robotics · Computer Science 2025-12-08 Yuting Zeng , Zhiwen Zheng , You Zhou , JiaLing Xiao , Yongbin Yu , Manping Fan , Bo Gong , Liyong Ren

Lane change decision-making for autonomous vehicles is a complex but high-reward behavior. In this paper, we propose a hybrid input based deep reinforcement learning (DRL) algorithm, which realizes abstract lane change decisions and lane…

Robotics · Computer Science 2025-09-03 Ziteng Gao , Jiaqi Qu , Chaoyu Chen

We present a novel approach to improve the performance of deep reinforcement learning (DRL) based outdoor robot navigation systems. Most, existing DRL methods are based on carefully designed dense reward functions that learn the efficient…

Developing an automated driving system capable of navigating complex traffic environments remains a formidable challenge. Unlike rule-based or supervised learning-based methods, Deep Reinforcement Learning (DRL) based controllers eliminate…

Machine Learning · Computer Science 2025-01-28 Zhihao Zhang , Ekim Yurtsever , Keith A. Redmill

The classical method of autonomous racing uses real-time localisation to follow a precalculated optimal trajectory. In contrast, end-to-end deep reinforcement learning (DRL) can train agents to race using only raw LiDAR scans. While…

Robotics · Computer Science 2023-06-13 Benjamin David Evans , Herman Arnold Engelbrecht , Hendrik Willem Jordaan

Robot navigation using deep reinforcement learning (DRL) has shown great potential in improving the performance of mobile robots. Nevertheless, most existing DRL-based navigation methods primarily focus on training a policy that directly…

Robotics · Computer Science 2023-10-23 Wenhao Yu , Jie Peng , Quecheng Qiu , Hanyu Wang , Lu Zhang , Jianmin Ji

We present a hybrid ML-heuristic approach that we name "Heuristically Assisted Deep Reinforcement Learning (HA-DRL)" to solve the problem of Network Slice Placement Optimization. The proposed approach leverages recent works on Deep…

Machine Learning · Computer Science 2021-08-04 Jose Jurandir Alves Esteves , Amina Boubendir , Fabrice Guillemin , Pierre Sens

This work focuses on the problem of visual target navigation, which is very important for autonomous robots as it is closely related to high-level tasks. To find a special object in unknown environments, classical and learning-based…

Robotics · Computer Science 2023-12-27 Bangguo Yu , Hamidreza Kasaei , Ming Cao

In this paper, a novel deep reinforcement learning (DRL)-based method is proposed to navigate the robot team through unknown complex environments, where the geometric centroid of the robot team aims to reach the goal position while avoiding…

Robotics · Computer Science 2019-07-04 Juntong Lin , Xuyun Yang , Peiwei Zheng , Hui Cheng

The path planning problem for autonomous exploration of an unknown region by a robotic agent typically employs frontier-based or information-theoretic heuristics. Frontier-based heuristics typically evaluate the information gain of a…

Robotics · Computer Science 2020-11-11 Di Deng , Zhefan Xu , Wenbo Zhao , Kenji Shimada

With the increasing need for multi-robot for exploring the unknown region in a challenging environment, efficient collaborative exploration strategies are needed for achieving such feat. A frontier-based Rapidly-Exploring Random Tree (RRT)…