English
Related papers

Related papers: Maximizing UAV Cellular Connectivity with Reinforc…

200 papers

This paper tackles the challenging task of maintaining formation among multiple unmanned aerial vehicles (UAVs) while avoiding both static and dynamic obstacles during directed flight. The complexity of the task arises from its…

Robotics · Computer Science 2025-03-04 Yuqing Xie , Chao Yu , Hongzhi Zang , Feng Gao , Wenhao Tang , Jingyi Huang , Jiayu Chen , Botian Xu , Yi Wu , Yu Wang

Autonomous underwater vehicle (AUV) plays an increasingly important role in ocean exploration. Existing AUVs are usually not fully autonomous and generally limited to pre-planning or pre-programming tasks. Reinforcement learning (RL) and…

Artificial Intelligence · Computer Science 2020-01-13 Qilei Zhang , Jinying Lin , Qixin Sha , Bo He , Guangliang Li

UAVs are becoming popular in agriculture, however, they usually use time-consuming row-by-row flight paths. This paper presents a deep-reinforcement-learning-based approach for path planning to efficiently localize weeds in agricultural…

Robotics · Computer Science 2025-06-30 Rick van Essen , Eldert van Henten , Gert Kootstra

Due to their adaptability and mobility, Unmanned Aerial Vehicles (UAVs) are becoming increasingly essential for wireless network services, particularly for data harvesting tasks. In this context, Artificial Intelligence (AI)-based…

Machine Learning · Computer Science 2026-01-21 Babacar Toure , Dimitrios Tsilimantos , Omid Esrafilian , Marios Kountouris

This paper presents a hybrid approach that integrates trajectory optimization (TO) and reinforcement learning (RL) for motion planning and control of free-flying multi-arm robots in on-orbit servicing scenarios. The proposed system…

Active target sensing is the task of discovering and classifying an unknown number of targets in an environment and is critical in search-and-rescue missions. This paper develops a deep reinforcement learning approach to plan informative…

Robotics · Computer Science 2022-12-19 Harsh Goel , Laura Jarin Lipschitz , Saurav Agarwal , Sandeep Manjanna , Vijay Kumar

In this paper, the problem of trajectory design of unmanned aerial vehicles (UAVs) for maximizing the number of satisfied users is studied in a UAV based cellular network where the UAV works as a flying base station that serves users, and…

Information Theory · Computer Science 2019-02-21 Xuanlin Liu , Mingzhe Chen , Changchuan Yin

This paper presents a novel reinforcement learning framework for trajectory tracking of unmanned aerial vehicles in cluttered environments using a dual-agent architecture. Traditional optimization methods for trajectory tracking face…

Robotics · Computer Science 2024-11-01 Shaswat Garg , Houman Masnavi , Baris Fidan , Farrokh Janabi-Sharifi

This paper focuses on the continuous control of the unmanned aerial vehicle (UAV) based on a deep reinforcement learning method for a large-scale 3D complex environment. The purpose is to make the UAV reach any target point from a certain…

Robotics · Computer Science 2023-04-13 Xuyang Li , Jianwu Fang , Kai Du , Kuizhi Mei , Jianru Xue

Unmanned aerial vehicles (UAVs) are envisioned to complement the 5G communication infrastructure in future smart cities. Hot spots easily appear in road intersections, where effective communication among vehicles is challenging. UAVs may…

Machine Learning · Computer Science 2023-02-22 Ming Zhu , Xiao-Yang Liu , Anwar Walid

Deep reinforcement learning (RL) has been successfully applied to a variety of game-like environments. However, the application of deep RL to visual navigation with realistic environments is a challenging task. We propose a novel learning…

Robotics · Computer Science 2019-11-12 Jonáš Kulhánek , Erik Derner , Tim de Bruin , Robert Babuška

Unmanned Aerial Vehicles (UAVs), autonomously-guided aircraft, are widely used for tasks involving surveillance and reconnaissance. A version of the pursuit-evasion problems centered around UAVs and its variants has been extensively studied…

Robotics · Computer Science 2019-11-06 Loren Anderson , Sahitya Senapathy

Coverage path planning (CPP) is a critical problem in robotics, where the goal is to find an efficient path that covers every point in an area of interest. This work addresses the power-constrained CPP problem with recharge for…

Robotics · Computer Science 2024-10-28 Mirco Theile , Harald Bayerlein , Marco Caccamo , Alberto L. Sangiovanni-Vincentelli

Drones have become increasingly popular in a variety of fields, including agriculture, emergency response, and package delivery. However, most drone operations are currently limited to within Visual Line of Sight (vlos) due to safety…

In this paper, we employ multiple UAVs coordinated by a base station (BS) to help the ground users (GUs) to offload their sensing data. Different UAVs can adapt their trajectories and network formation to expedite data transmissions via…

Systems and Control · Electrical Eng. & Systems 2022-12-29 Shimin Gong , Meng Wang , Bo Gu , Wenjie Zhang , Dinh Thai Hoang , Dusit Niyato

Creating safe paths in unknown and uncertain environments is a challenging aspect of leader-follower formation control. In this architecture, the leader moves toward the target by taking optimal actions, and followers should also avoid…

Robotics · Computer Science 2024-02-28 Behnaz Hadi , Alireza Khosravi , Pouria Sarhadi

Vehicle-to-vehicle (V2V) communications have distinct challenges that need to be taken into account when scheduling the radio resources. Although centralized schedulers (e.g., located on base stations) could be utilized to deliver high…

Networking and Internet Architecture · Computer Science 2019-07-23 Taylan Şahin , Ramin Khalili , Mate Boban , Adam Wolisz

Ultrasound (US) is one of the most common medical imaging modalities since it is radiation-free, low-cost, and real-time. In freehand US examinations, sonographers often navigate a US probe to visualize standard examination planes with rich…

Image and Video Processing · Electrical Eng. & Systems 2022-05-16 Yuan Bi , Zhongliang Jiang , Yuan Gao , Thomas Wendler , Angelos Karlas , Nassir Navab

The aim of this work is to develop an approach that enables Unmanned Aerial System (UAS) to efficiently learn to navigate in large-scale urban environments and transfer their acquired expertise to novel environments. To achieve this, we…

Robotics · Computer Science 2025-03-21 Yuci Han , Charles Toth , Alper Yilmaz

While deep reinforcement learning (RL) methods have achieved unprecedented successes in a range of challenging problems, their applicability has been mainly limited to simulation or game domains due to the high sample complexity of the…

Artificial Intelligence · Computer Science 2017-09-26 Siyi Li , Tianbo Liu , Chi Zhang , Dit-Yan Yeung , Shaojie Shen