English
Related papers

Related papers: Learning Obstacle Avoidance using Double DQN for Q…

200 papers

We first define appropriate state representation and action space, and then design an adjustment mechanism based on the actions selected by the intelligent agent. The adjustment mechanism outputs the next state and reward value of the…

Robotics · Computer Science 2023-07-27 Longcheng Guo

Unmanned aerial vehicles (UAVs) technique has been recognized as a promising solution in future wireless connectivity from the sky, and UAV navigation is one of the most significant open research problems, which has attracted wide interest…

Signal Processing · Electrical Eng. & Systems 2019-11-28 Hongji Huang , Yuchun Yang , Hong Wang , Zhiguo Ding , Hikmet Sari , Fumiyuki Adachi

This paper focuses on the continuous control of the unmanned aerial vehicle (UAV) based on a deep reinforcement learning method for a large-scale 3D complex environment. The purpose is to make the UAV reach any target point from a certain…

Robotics · Computer Science 2023-04-13 Xuyang Li , Jianwu Fang , Kai Du , Kuizhi Mei , Jianru Xue

In unseen and complex outdoor environments, collision avoidance navigation for unmanned aerial vehicle (UAV) swarms presents a challenging problem. It requires UAVs to navigate through various obstacles and complex backgrounds. Existing…

Robotics · Computer Science 2024-07-16 Jiafan Zhuang , Gaofei Han , Zihao Xia , Boxi Wang , Wenji Li , Dongliang Wang , Zhifeng Hao , Ruichu Cai , Zhun Fan

Deep reinforcement learning (RL) has made it possible to solve complex robotics problems using neural networks as function approximators. However, the policies trained on stationary environments suffer in terms of generalization when…

Robotics · Computer Science 2021-11-09 Aditya M. Deshpande , Ali A. Minai , Manish Kumar

Autonomous navigation is a long-standing field of robotics research, which provides an essential capability for mobile robots to execute a series of tasks on the same environments performed by human everyday. In this chapter, we present a…

Robotics · Computer Science 2020-12-08 Anh Nguyen , Quang Tran

Safe UAV navigation is challenging due to the complex environment structures, dynamic obstacles, and uncertainties from measurement noises and unpredictable moving obstacle behaviors. Although plenty of recent works achieve safe navigation…

Robotics · Computer Science 2022-03-15 Zhefan Xu , Di Deng , Yiping Dong , Kenji Shimada

Unmanned Aerial Vehicles (UAVs) are increasingly populating urban areas for delivery and surveillance purposes. In this work, we develop an optimal navigation strategy based on Deep Reinforcement Learning. The environment is represented by…

Artificial Intelligence · Computer Science 2025-10-30 Federica Tonti , Ricardo Vinuesa

Robotic systems are nowadays capable of solving complex navigation tasks. However, their capabilities are limited to the knowledge of the designer and consequently lack generalizability to initially unconsidered situations. This makes deep…

Robotics · Computer Science 2022-05-24 Christopher Gebauer , Nils Dengler , Maren Bennewitz

Using Unmanned Aerial Vehicles (UAVs) in Search and rescue operations (SAR) to navigate challenging terrain while maintaining reliable communication with the cellular network is a promising approach. This paper suggests a novel technique…

Visual navigation is essential for many applications in robotics, from manipulation, through mobile robotics to automated driving. Deep reinforcement learning (DRL) provides an elegant map-free approach integrating image processing,…

Robotics · Computer Science 2020-10-22 Jonáš Kulhánek , Erik Derner , Robert Babuška

Accurate perception of dynamic obstacles is essential for autonomous robot navigation in indoor environments. Although sophisticated 3D object detection and tracking methods have been investigated and developed thoroughly in the fields of…

Robotics · Computer Science 2025-03-03 Zhefan Xu , Haoyu Shen , Xinming Han , Hanyu Jin , Kanlong Ye , Kenji Shimada

Monitoring and patrolling large water resources is a major challenge for conservation. The problem of acquiring data of an underlying environment that usually changes within time involves a proper formulation of the information. The use of…

Robotics · Computer Science 2022-10-18 Samuel Yanes Luis , Daniel Gutiérrez Reina , Sergio Toral Marín

This paper introduces an advanced AI-driven perception system for autonomous quadcopter navigation in GPS-denied indoor environments. The proposed framework leverages cloud computing to offload computationally intensive tasks and…

Robotics · Computer Science 2025-08-12 Shoaib Ahmmad , Zubayer Ahmed Aditto , Md Mehrab Hossain , Noushin Yeasmin , Shorower Hossain

This paper proposes an Improved Noisy Deep Q-Network (Noisy DQN) to enhance the exploration and stability of Unmanned Aerial Vehicle (UAV) when applying deep reinforcement learning in simulated environments. This method enhances the…

Systems and Control · Electrical Eng. & Systems 2026-02-06 Zhang Hengyu , Maryam Cheraghy , Liu Wei , Armin Farhadi , Meysam Soltanpour , Zhong Zhuoqing

This paper investigates the automatic exploration problem under the unknown environment, which is the key point of applying the robotic system to some social tasks. The solution to this problem via stacking decision rules is impossible to…

Robotics · Computer Science 2020-07-24 Haoran Li , Qichao Zhang , Dongbin Zhao

In autonomous navigation of mobile robots, sensors suffer from massive occlusion in cluttered environments, leaving significant amount of space unknown during planning. In practice, treating the unknown space in optimistic or pessimistic…

Robotics · Computer Science 2021-03-30 Lizi Wang , Hongkai Ye , Qianhao Wang , Yuman Gao , Chao Xu , Fei Gao

Providing an efficient strategy to navigate safely through unsignaled intersections is a difficult task that requires determining the intent of other drivers. We explore the effectiveness of Deep Reinforcement Learning to handle…

Artificial Intelligence · Computer Science 2018-02-28 David Isele , Reza Rahimi , Akansel Cosgun , Kaushik Subramanian , Kikuo Fujimura

Mobile robots in unstructured, mapless environments must rely on an obstacle avoidance module to navigate safely. The standard avoidance techniques estimate the locations of obstacles with respect to the robot but are unaware of the…

Robotics · Computer Science 2021-07-15 Jungseok Hong , Karin de Langis , Cole Wyeth , Christopher Walaszek , Junaed Sattar

The growing use of mobile robots in sectors such as automotive, agriculture, and rescue operations reflects progress in robotics and autonomy. In unmanned aerial vehicles (UAVs), most research emphasizes visual SLAM, sensor fusion, and path…

Robotics · Computer Science 2025-06-26 Jingwen Wei