English
Related papers

Related papers: DTPPO: Dual-Transformer Encoder-based Proximal Pol…

200 papers

The Autonomy of Unmanned Aerial Vehicles (UAVs) in indoor environments poses significant challenges due to the lack of reliable GPS signals in enclosed spaces such as warehouses, factories, and indoor facilities. Micro Aerial Vehicles…

Robotics · Computer Science 2025-04-09 Amit Kumar Singh , Prasanth Kumar Duba , P. Rajalakshmi

Unmanned Aerial Vehicles (UAVs) are increasingly populating urban areas for delivery and surveillance purposes. In this work, we develop an optimal navigation strategy based on Deep Reinforcement Learning. The environment is represented by…

Artificial Intelligence · Computer Science 2025-10-30 Federica Tonti , Ricardo Vinuesa

In this paper, a deep reinforcement learning (DRL) method is proposed to address the problem of UAV navigation in an unknown environment. However, DRL algorithms are limited by the data efficiency problem as they typically require a huge…

Robotics · Computer Science 2020-08-07 Lei He , Nabil Aouf , James F. Whidborne , Bifeng Song

Multi-Agent Proximal Policy Optimization (MAPPO) is a variant of the Proximal Policy Optimization (PPO) algorithm, specifically tailored for multi-agent reinforcement learning (MARL). MAPPO optimizes cooperative multi-agent settings by…

Machine Learning · Computer Science 2026-05-14 Changha Lee , Gyusang Cho

In this paper, we investigate an unmanned aerial vehicle (UAV)-assistant air-to-ground communication system, where multiple UAVs form a UAV-enabled virtual antenna array (UVAA) to communicate with remote base stations by utilizing…

Networking and Internet Architecture · Computer Science 2024-04-12 Saichao Liu , Geng Sun , Jiahui Li , Shuang Liang , Qingqing Wu , Pengfei Wang , Dusit Niyato

Safe flight in dynamic environments requires unmanned aerial vehicles (UAVs) to make effective decisions when navigating cluttered spaces with moving obstacles. Traditional approaches often decompose decision-making into hierarchical…

Robotics · Computer Science 2025-02-25 Zhefan Xu , Xinming Han , Haoyu Shen , Hanyu Jin , Kenji Shimada

Autonomous navigation in underwater environments remains a major challenge due to the absence of GPS, degraded visibility, and the presence of submerged obstacles. This article investigates these issues through the case of the BlueROV2, an…

Machine Learning · Computer Science 2025-12-12 Zamirddine Mari , Mohamad Motasem Nawaf , Pierre Drap

Instability and slowness are two main problems in deep reinforcement learning. Even if proximal policy optimization (PPO) is the state of the art, it still suffers from these two problems. We introduce an improved algorithm based on…

Machine Learning · Computer Science 2019-10-01 Zhenyu Zhang , Xiangfeng Luo , Tong Liu , Shaorong Xie , Jianshu Wang , Wei Wang , Yang Li , Yan Peng

Autonomous indoor navigation of UAVs presents numerous challenges, primarily due to the limited precision of GPS in enclosed environments. Additionally, UAVs' limited capacity to carry heavy or power-intensive sensors, such as overheight…

Robotics · Computer Science 2024-12-25 Kangtong Mo , Linyue Chu , Xingyu Zhang , Xiran Su , Yang Qian , Yining Ou , Wian Pretorius

This paper presents a novel reinforcement learning framework for trajectory tracking of unmanned aerial vehicles in cluttered environments using a dual-agent architecture. Traditional optimization methods for trajectory tracking face…

Robotics · Computer Science 2024-11-01 Shaswat Garg , Houman Masnavi , Baris Fidan , Farrokh Janabi-Sharifi

The increasing number of unmanned aerial vehicles (UAVs) in urban environments requires a strategy to minimize their environmental impact, both in terms of energy efficiency and noise reduction. In order to reduce these concerns, novel…

Artificial Intelligence · Computer Science 2024-09-27 Federica Tonti , Jean Rabault , Ricardo Vinuesa

The capability of UAVs for efficient autonomous navigation and obstacle avoidance in complex and unknown environments is critical for applications in agricultural irrigation, disaster relief and logistics. In this paper, we propose the DPRL…

Robotics · Computer Science 2024-12-10 Junqiao Wang , Zhongliang Yu , Dong Zhou , Jiaqi Shi , Runran Deng

Unmanned aerial vehicle (UAV)-based base stations offer a promising solution in emergencies where the rapid deployment of cutting-edge networks is crucial for maximizing life-saving potential. Optimizing the strategic positioning of these…

Artificial Intelligence · Computer Science 2025-04-08 Mario Rico Ibanez , Azim Akhtarshenas , David Lopez-Perez , Giovanni Geraci

Unmanned aerial vehicles (UAVs)-assisted mobile crowdsensing (MCS) has emerged as a promising paradigm for data collection. However, challenges such as spectrum scarcity, device heterogeneity, and user mobility hinder efficient coordination…

Machine Learning · Computer Science 2025-10-01 Xianyang Deng , Wenshuai Liu , Yaru FuB , Qi Zhu

This paper presents a novel deep reinforcement learning-based system for 3D mapless navigation for Unmanned Aerial Vehicles (UAVs). Instead of using a image-based sensing approach, we propose a simple learning system that uses only a few…

Swarm trajectory optimization problems are a well-recognized class of multi-agent optimal control problems with strong nonlinearity. However, the heuristic nature of needing to set the final time for agents beforehand and the time-consuming…

Robotics · Computer Science 2026-02-10 Xiaobo Zheng , Pan Tang , Defu Lin , Shaoming He

Efficient aerial data collection is important in many remote sensing applications. In large-scale monitoring scenarios, deploying a team of unmanned aerial vehicles (UAVs) offers improved spatial coverage and robustness against individual…

Robotics · Computer Science 2023-03-03 Jonas Westheider , Julius Rückin , Marija Popović

Safe UAV navigation is challenging due to the complex environment structures, dynamic obstacles, and uncertainties from measurement noises and unpredictable moving obstacle behaviors. Although plenty of recent works achieve safe navigation…

Robotics · Computer Science 2022-03-15 Zhefan Xu , Di Deng , Yiping Dong , Kenji Shimada

Unmanned aerial vehicles (UAVs) are seen as a promising technology to perform a wide range of tasks in wireless communication networks. In this work, we consider the deployment of a group of UAVs to collect the data generated by IoT…

Optimization and Control · Mathematics 2023-03-16 Mouhamed Naby Ndiaye , El Houcine Bergou , Hajar El Hammouti

In this paper, we propose an autonomous UAV path planning framework using deep reinforcement learning approach. The objective is to employ a self-trained UAV as a flying mobile unit to reach spatially distributed moving or static targets in…

Robotics · Computer Science 2020-03-25 Omar Bouhamed , Hakim Ghazzai , Hichem Besbes , Yehia Massoud
‹ Prev 1 2 3 10 Next ›