English
Related papers

Related papers: Depth-Constrained ASV Navigation with Deep RL and …

200 papers

Autonomous surface vehicles (ASV) allow the investigation of coastal areas, ports and harbors as well as harsh and dangerous environments such as the arctic regions. Despite receiving increasing attention, the hydrodynamic analysis of ASV…

In this paper, we study a joint detection, mapping and navigation problem for a single unmanned aerial vehicle (UAV) equipped with a low complexity radar and flying in an unknown environment. The goal is to optimize its trajectory with the…

Robotics · Computer Science 2020-07-23 Anna Guerra , Francesco Guidi , Davide Dardari , Petar M. Djuric

Deep Reinforcement Learning is quickly becoming a popular method for training autonomous Unmanned Aerial Vehicles (UAVs). Our work analyzes the effects of measurement uncertainty on the performance of Deep Reinforcement Learning (DRL) based…

Robotics · Computer Science 2023-03-14 Bhaskar Joshi , Dhruv Kapur , Harikumar Kandath

Automated vehicle control using reinforcement learning (RL) has attracted significant attention due to its potential to learn driving policies through environment interaction. However, RL agents often face training challenges in sample…

Robotics · Computer Science 2025-09-08 Zhihao Zhang , Chengyang Peng , Ekim Yurtsever , Keith A. Redmill

Many autonomous systems face safety challenges, requiring robust closed-loop control to handle physical limitations and safety constraints. Real-world systems, like autonomous ships, encounter nonlinear dynamics and environmental…

Robotics · Computer Science 2024-04-03 Aksel Vaaler , Svein Jostein Husa , Daniel Menges , Thomas Nakken Larsen , Adil Rasheed

The kind of closed-loop verification likely to be required for autonomous vehicle (AV) safety testing is beyond the reach of traditional test methodologies and discrete verification. Validation puts the autonomous vehicle system to the test…

Machine Learning · Computer Science 2020-05-29 Hyun Jae Cho , Madhur Behl

In this work, we propose a Model Predictive Control (MPC)-based Reinforcement Learning (RL) method for Autonomous Surface Vehicles (ASVs). The objective is to find an optimal policy that minimizes the closed-loop performance of a simplified…

Systems and Control · Electrical Eng. & Systems 2021-08-06 Wenqi Cai , Arash B. Kordabad , Hossein N. Esfahani , Anastasios M. Lekkas , Sebastien Gros

Navigating fluently around pedestrians is a necessary capability for mobile robots deployed in human environments, such as buildings and homes. While research on social navigation has focused mainly on the scalability with the number of…

Autonomous underwater vehicles are required to perform multiple tasks adaptively and in an explainable manner under dynamic, uncertain conditions and limited sensing, challenges that classical controllers struggle to address. This demands…

Machine Learning · Computer Science 2026-04-24 Yi-Ling Liu , Melvin Laux , Mariela De Lucas Alvarez , Frank Kirchner , Rebecca Adam

The application of reinforcement learning algorithms onto real life problems always bears the challenge of filtering the environmental state out of raw sensor readings. While most approaches use heuristics, biology suggests that there must…

Artificial Intelligence · Computer Science 2012-05-07 Wendelin Böhmer

Reinforcement learning-based mapless navigation holds significant potential. However, it faces challenges in indoor environments with local minima area. This paper introduces a safe mapless navigation framework utilizing hierarchical…

Robotics · Computer Science 2025-03-18 Jianqi Gao , Xizheng Pang , Qi Liu , Yanjie Li

A resilient and robust positioning, navigation, and timing (PNT) system is a necessity for the navigation of autonomous vehicles (AVs). Global Navigation Satelite System (GNSS) provides satellite-based PNT services. However, a spoofer can…

Signal Processing · Electrical Eng. & Systems 2022-08-30 Sagar Dasgupta , Tonmoy Ghosh , Mizanur Rahman

Reinforcement Learning (RL) is a promising solution, allowing Unmanned Underwater Vehicles (UUVs) to learn optimal behaviors through trial and error. However, existing simulators lack efficient integration with RL methods, limiting training…

Robotics · Computer Science 2024-10-21 Shuguang Chu , Zebin Huang , Mingwei Lin , Dejun Li , Ignacio Carlucho

Environmental monitoring of marine environments presents several challenges: the harshness of the environment, the often remote location, and most importantly, the vast area it covers. Manual operations are time consuming, often dangerous,…

The ability to navigate, search, and monitor dynamic marine environments such as ports, deltas, tributaries, and rivers presents several challenges to both human operated and autonomously operated surface vehicles. Human data collection and…

Autonomous navigation is an essential capability of smart mobility for mobile robots. Traditional methods must have the environment map to plan a collision-free path in workspace. Deep reinforcement learning (DRL) is a promising technique…

Robotics · Computer Science 2019-04-23 Liulong Ma , Yanjie Liu , Jiao Chen , Dong Jin

Docking control of an autonomous underwater vehicle (AUV) is a task that is integral to achieving persistent long term autonomy. This work explores the application of state-of-the-art model-free deep reinforcement learning (DRL) approaches…

Robotics · Computer Science 2021-08-06 Mihir Patil , Bilal Wehbe , Matias Valdenegro-Toro

Off-road navigation on vertically challenging terrain, involving steep slopes and rugged boulders, presents significant challenges for wheeled robots both at the planning level to achieve smooth collision-free trajectories and at the…

Robotics · Computer Science 2024-10-29 Tong Xu , Chenhui Pan , Xuesu Xiao

Intelligent navigation among social crowds is an essential aspect of mobile robotics for applications such as delivery, health care, or assistance. Deep Reinforcement Learning emerged as an alternative planning method to conservative…

Robotics · Computer Science 2021-09-24 Linh Kästner , Junhui Li , Zhengcheng Shen , Jens Lambrecht

Autonomous systems are becoming ubiquitous and gaining momentum within the marine sector. Since the electrification of transport is happening simultaneously, autonomous marine vessels can reduce environmental impact, lower costs, and…

Robotics · Computer Science 2021-12-02 Thomas Nakken Larsen , Amalie Heiberg , Eivind Meyer , Adil Rasheeda , Omer San , Damiano Varagnolo