English
Related papers

Related papers: Make Your AUV Adaptive: An Environment-Aware Reinf…

200 papers

Real-world autonomous decision-making systems, from robots to recommendation engines, must operate in environments that change over time. While deep reinforcement learning (RL) has shown an impressive ability to learn optimal policies in…

Machine Learning · Computer Science 2025-05-16 Jonathan Clifford Balloch

Autonomous navigation of Unmanned Surface Vehicles (USV) in marine environments with current flows is challenging, and few prior works have addressed the sensorbased navigation problem in such environments under no prior knowledge of the…

Robotics · Computer Science 2023-08-01 Xi Lin , John McConnell , Brendan Englot

Autonomous robots must navigate and operate in diverse environments, from terrestrial and aquatic settings to aerial and space domains. While Reinforcement Learning (RL) has shown promise in training policies for specific autonomous robots,…

Unmanned Aerial Vehicles (UAVs) are increasingly used in automated inspection, delivery, and navigation tasks that require reliable autonomy. This project develops a reinforcement learning (RL) approach to enable a single UAV to…

Robotics · Computer Science 2025-09-18 Salim Oyinlola , Nitesh Subedi , Soumik Sarkar

Autonomous underwater vehicles (AUVs) are valuable for ocean exploration due to their flexibility and ability to carry communication and detection units. Nevertheless, AUVs alone often face challenges in harsh and extreme sea conditions.…

Robotics · Computer Science 2025-01-14 Jingzehua Xu , Guanwen Xie , Xinqi Wang , Yimian Ding , Shuai Zhang

In recent years, unmanned aerial vehicle (UAV) related technology has expanded knowledge in the area, bringing to light new problems and challenges that require solutions. Furthermore, because the technology allows processes usually carried…

Artificial Intelligence · Computer Science 2022-12-08 Cristian Millán-Arias , Ruben Contreras , Francisco Cruz , Bruno Fernandes

Despite the increasing adoption of Deep Reinforcement Learning (DRL) for Autonomous Surface Vehicles (ASVs), there still remain challenges limiting real-world deployment. In this paper, we first integrate buoyancy and hydrodynamics models…

Efficient load balancing is crucial in cloud computing environments to ensure optimal resource utilization, minimize response times, and prevent server overload. Traditional load balancing algorithms, such as round-robin or least…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-10 Kavish Chawla

Sustainability is becoming increasingly critical in the maritime transport, encompassing both environmental and social impacts, such as Greenhouse Gas (GHG) emissions and navigational safety. Traditional vessel navigation heavily relies on…

Machine Learning · Computer Science 2026-01-19 Zhang Xiaocai , Xiao Zhe , Liang Maohan , Liu Tao , Li Haijiang , Zhang Wenbin

Deep Reinforcement Learning (DRL) offers a robust alternative to traditional control methods for autonomous underwater docking, particularly in adapting to unpredictable environmental conditions. However, bridging the "sim-to-real" gap and…

Robotics · Computer Science 2026-03-13 Alaaeddine Chaarani , Narcis Palomeras , Pere Ridao

Unmanned Aerial Vehicle (UAV) based communication networks (UCNs) are a key component in future mobile networking. To handle the dynamic environments in UCNs, reinforcement learning (RL) has been a promising solution attributed to its…

Systems and Control · Electrical Eng. & Systems 2024-09-26 Ran Zhang , Bowei Li , Liyuan Zhang , Jiang , Xie , Miao Wang

Unmanned Aerial Vehicles (UAVs) increasingly enhance the Quality of Service (QoS) in wireless networks due to their flexibility and cost-effectiveness. However, optimizing UAV placement in dynamic, obstacle-prone environments remains a…

Networking and Internet Architecture · Computer Science 2026-01-30 Kamran Shafafi , Manuel Ricardo , Rui Campos

High-speed cruising scenarios with mixed traffic greatly challenge the road safety of autonomous vehicles (AVs). Unlike existing works that only look at fundamental modules in isolation, this work enhances AV safety in mixed-traffic…

Systems and Control · Electrical Eng. & Systems 2024-04-24 Jinhao Liang , Kaidi Yang , Chaopeng Tan , Jinxiang Wang , Guodong Yin

Integrating Unmanned Aerial Vehicles (UAVs) with Unmanned Ground Vehicles (UGVs) provides an effective solution for persistent surveillance in disaster management. UAVs excel at covering large areas rapidly, but their range is limited by…

Robotics · Computer Science 2025-02-06 Md Safwan Mondal , Subramanian Ramasamy , Pranav Bhounsule

Previous works showed that Deep-RL can be applied to perform mapless navigation, including the medium transition of Hybrid Unmanned Aerial Underwater Vehicles (HUAUVs). This paper presents new approaches based on the state-of-the-art…

There is an increasing demand for using Unmanned Aerial Vehicle (UAV), known as drones, in different applications such as packages delivery, traffic monitoring, search and rescue operations, and military combat engagements. In all of these…

Robotics · Computer Science 2022-08-29 Fadi AlMahamid , Katarina Grolinger

Autonomous deployment of unmanned aerial vehicles (UAVs) supporting next-generation communication networks requires efficient trajectory planning methods. We propose a new end-to-end reinforcement learning (RL) approach to UAV-enabled data…

Machine Learning · Computer Science 2021-01-28 Harald Bayerlein , Mirco Theile , Marco Caccamo , David Gesbert

Due to climate change the frequency and intensity of extreme rainfall events, which contribute to urban flooding, are expected to increase in many places. These floods can damage transport infrastructure and disrupt mobility, highlighting…

Machine Learning · Computer Science 2024-12-02 Miguel Costa , Morten W. Petersen , Arthur Vandervoort , Martin Drews , Karyn Morrissey , Francisco C. Pereira

The integration of Unmanned Aerial Vehicles (UAVs) into Open Radio Access Networks (O-RAN) enhances communication in disaster management and Search and Rescue (SAR) operations by ensuring connectivity when infrastructure fails. However, SAR…

Cryptography and Security · Computer Science 2025-10-22 Zaineh Abughazzah , Emna Baccour , Loay Ismail , Amr Mohamed , Mounir Hamdi

From out-competing grandmasters in chess to informing high-stakes healthcare decisions, emerging methods from artificial intelligence are increasingly capable of making complex and strategic decisions in diverse, high-dimensional, and…

Computers and Society · Computer Science 2024-03-05 Melissa Chapman , Lily Xu , Marcus Lapeyrolerie , Carl Boettiger