English
Related papers

Related papers: Depth-Constrained ASV Navigation with Deep RL and …

200 papers

Safe and efficient autonomous driving maneuvers in an interactive and complex environment can be considerably challenging due to the unpredictable actions of other surrounding agents that may be cooperative or adversarial in their…

Robotics · Computer Science 2019-01-28 Pin Wang , Ching-Yao Chan , Hanhan Li

Previous works showed that Deep-RL can be applied to perform mapless navigation, including the medium transition of Hybrid Unmanned Aerial Underwater Vehicles (HUAUVs). This paper presents new approaches based on the state-of-the-art…

Autonomous aerial navigation in dense natural environments remains challenging due to limited visibility, thin and irregular obstacles, GNSS-denied operation, and frequent perceptual degradation. This work presents an improved deep…

Robotics · Computer Science 2025-12-22 Guglielmo Del Col , Väinö Karjalainen , Teemu Hakala , Yibo Zhang , Eija Honkavaara

Deep Reinforcement Learning (DRL) offers a robust alternative to traditional control methods for autonomous underwater docking, particularly in adapting to unpredictable environmental conditions. However, bridging the "sim-to-real" gap and…

Robotics · Computer Science 2026-03-13 Alaaeddine Chaarani , Narcis Palomeras , Pere Ridao

This paper proposes a novel Reinforcement Learning (RL) approach for sim-to-real policy transfer of Vertical Take-Off and Landing Unmanned Aerial Vehicle (VTOL-UAV). The proposed approach is designed for VTOL-UAV landing on offshore docking…

Robotics · Computer Science 2024-08-01 Ali M. Ali , Aryaman Gupta , Hashim A. Hashim

The increasing number of unmanned aerial vehicles (UAVs) in urban environments requires a strategy to minimize their environmental impact, both in terms of energy efficiency and noise reduction. In order to reduce these concerns, novel…

Artificial Intelligence · Computer Science 2024-09-27 Federica Tonti , Jean Rabault , Ricardo Vinuesa

This paper proposes a realistic modularized framework for controlling autonomous surface vehicles (ASVs) on inland waterways (IWs) based on deep reinforcement learning (DRL). The framework improves operational safety and comprises two…

Systems and Control · Electrical Eng. & Systems 2024-08-22 Martin Waltz , Niklas Paulig , Ostap Okhrin

Autonomous vehicles (AV) offer a cost-effective solution for scientific missions such as underwater tracking. Recently, reinforcement learning (RL) has emerged as a powerful method for controlling AVs in complex marine environments.…

Robotics · Computer Science 2025-10-20 Matteo Gallici , Ivan Masmitja , Mario Martín

Reinforcement learning (RL) has been widely used in decision-making and control tasks, but the risk is very high for the agent in the training process due to the requirements of interaction with the environment, which seriously limits its…

Machine Learning · Computer Science 2024-09-13 Xuemin Hu , Pan Chen , Yijun Wen , Bo Tang , Long Chen

This paper enhances the obstacle avoidance of Autonomous Surface Vehicles (ASVs) for safe navigation in high-traffic waters with an active state estimation of obstacle's passing intention and reducing its uncertainty. We introduce a…

Robotics · Computer Science 2024-11-05 Mingi Jeong , Arihant Chadda , Alberto Quattrini Li

In this study, we conduct a comprehensive benchmark of the Safe Reinforcement Learning (Safe RL) algorithms for the task of vision-driven river following of Unmanned Aerial Vehicle (UAV) in a Unity-based photo-realistic simulation…

Robotics · Computer Science 2025-08-14 Zihan Wang , Nina Mahmoudian

Research on coastal regions traditionally involves methods like manual sampling, monitoring buoys, and remote sensing, but these methods face challenges in spatially and temporally diverse regions of interest. Autonomous surface vehicles…

Robotics · Computer Science 2024-05-29 Mingi Jeong

The operational space of an autonomous vehicle (AV) can be diverse and vary significantly. This may lead to a scenario that was not postulated in the design phase. Due to this, formulating a rule based decision maker for selecting maneuvers…

Robotics · Computer Science 2019-04-02 Subramanya Nageshrao , Eric Tseng , Dimitar Filev

Navigating autonomous underwater vehicles (AUVs) in unknown environments is significantly challenging due to poor visibility, weak signal transmission, and dynamic water currents. These factors pose challenges in accurate global…

Control theory provides engineers with a multitude of tools to design controllers that manipulate the closed-loop behavior and stability of dynamical systems. These methods rely heavily on insights about the mathematical model governing the…

Robotics · Computer Science 2020-06-18 Simen Theie Havenstrøm , Adil Rasheed , Omer San

The transport industry has recently shown significant interest in unmanned surface vehicles (USVs), specifically for port and inland waterway transport. These systems can improve operational efficiency and safety, which is especially…

Robotics · Computer Science 2026-04-22 Bavo Lesy , Siemen Herremans , Robin Kerstens , Jan Steckel , Walter Daems , Siegfried Mercelis , Ali Anwar

Autonomous navigation of Unmanned Surface Vehicles (USVs) that is safe and compliant with the International Regulations for Preventing Collisions at Sea (COLREGs) remains a formidable challenge in dynamic maritime environments, particularly…

Robotics · Computer Science 2026-05-29 Yuhang Zhang , Shuqi Chai , Yukang Zhang , Liusha Yang , Mingchuan Zhang , Wei Wang , Qingjiang Shi , Quanbo Ge

This paper addresses the challenge of active perception within autonomous navigation in complex, unknown environments. Revisiting the foundational principles of active perception, we introduce an end-to-end reinforcement learning framework…

Robotics · Computer Science 2026-02-03 Grzegorz Malczyk , Mihir Kulkarni , Kostas Alexis

There is an increasing demand for using Unmanned Aerial Vehicle (UAV), known as drones, in different applications such as packages delivery, traffic monitoring, search and rescue operations, and military combat engagements. In all of these…

Robotics · Computer Science 2022-08-29 Fadi AlMahamid , Katarina Grolinger

Recently, there has been growing interest in autonomous shipping due to its potential to improve maritime efficiency and safety. The use of advanced technologies, such as artificial intelligence, can address the current navigational and…

Machine Learning · Computer Science 2024-11-08 Bavo Lesy , Ali Anwar , Siegfried Mercelis