English
Related papers

Related papers: AI on the Water: Applying DRL to Autonomous Vessel…

200 papers

Off-road navigation on vertically challenging terrain, involving steep slopes and rugged boulders, presents significant challenges for wheeled robots both at the planning level to achieve smooth collision-free trajectories and at the…

Robotics · Computer Science 2024-10-29 Tong Xu , Chenhui Pan , Xuesu Xiao

This paper investigates the problem of assigning shipping requests to ad hoc couriers in the context of crowdsourced urban delivery. The shipping requests are spatially distributed each with a limited time window between the earliest time…

Artificial Intelligence · Computer Science 2020-12-01 Tanvir Ahamed , Bo Zou , Nahid Parvez Farazi , Theja Tulabandhula

Deep reinforcement learning (DRL) provides a promising way for intelligent agents (e.g., autonomous vehicles) to learn to navigate complex scenarios. However, DRL with neural networks as function approximators is typically considered a…

Robotics · Computer Science 2023-11-28 Jiachen Li , David Isele , Kanghoon Lee , Jinkyoo Park , Kikuo Fujimura , Mykel J. Kochenderfer

Controlling autonomous vehicles at their handling limits is a significant challenge, particularly for electric vehicles with active four wheel drive (A4WD) systems offering independent wheel torque control. While traditional Vehicle…

Robotics · Computer Science 2025-06-09 Gergely Bari , Laszlo Palkovics

Legged robots often use separate control policiesthat are highly engineered for traversing difficult terrain suchas stairs, gaps, and steps, where switching between policies isonly possible when the robot is in a region that is commonto…

Robotics · Computer Science 2021-09-30 Brendan Tidd , Nicolas Hudson , Akansel Cosgun , Jurgen Leitner

Vehicle platooning, one of the advanced services supported by 5G NR-V2X, improves traffic efficiency in the connected intelligent transportation systems (C-ITSs). However, the packet delivery ratio of platoon communication, especially in…

Networking and Internet Architecture · Computer Science 2021-05-04 Liu Cao , Hao Yin

This paper presents a deep reinforcement learning (DRL) framework for active flow control (AFC) to reduce drag in aerodynamic bodies. Tested on a 3D cylinder at Re = 100, the DRL approach achieved a 9.32% drag reduction and a 78.4% decrease…

Machine Learning · Computer Science 2024-11-11 Ricard Montalà , Bernat Font , Pol Suárez , Jean Rabault , Oriol Lehmkuhl , Ivette Rodriguez

Deep reinforcement learning (DRL) allows a system to interact with its environment and take actions by training an efficient policy that maximizes self-defined rewards. In autonomous driving, it can be used as a strategy for high-level…

Robotics · Computer Science 2024-07-02 Xibo Li , Shruti Patel , Christof Büskens

This paper proposes an end-to-end deep reinforcement learning approach for mobile robot navigation with dynamic obstacles avoidance. Using experience collected in a simulation environment, a convolutional neural network (CNN) is trained to…

Robotics · Computer Science 2020-02-12 Guangda Chen , Lifan Pan , Yu'an Chen , Pei Xu , Zhiqiang Wang , Peichen Wu , Jianmin Ji , Xiaoping Chen

This paper proposes a realistic modularized framework for controlling autonomous surface vehicles (ASVs) on inland waterways (IWs) based on deep reinforcement learning (DRL). The framework improves operational safety and comprises two…

Systems and Control · Electrical Eng. & Systems 2024-08-22 Martin Waltz , Niklas Paulig , Ostap Okhrin

Collision avoidance algorithms for Autonomous Surface Vehicles (ASV) that follow the Convention on the International Regulations for Preventing Collisions at Sea (COLREGs) have been proposed in recent years. However, it may be difficult and…

Robotics · Computer Science 2024-03-08 Xi Lin , Yewei Huang , Fanfei Chen , Brendan Englot

Despite significant advancements in Deep Reinforcement Learning (DRL) for Autonomous Surface Vehicles (ASVs), their robustness in real-world conditions, particularly under external disturbances, remains insufficiently explored. In this…

Robotics · Computer Science 2025-06-06 Luis F. W. Batista , Stéphanie Aravecchia , Seth Hutchinson , Cédric Pradalier

The potential of artificial upwelling (AU) as a means of lifting nutrient-rich bottom water to the surface, stimulating seaweed growth, and consequently enhancing ocean carbon sequestration, has been gaining increasing attention in recent…

Machine Learning · Computer Science 2024-05-01 Yiyuan Zhang , Wei Fan

In order to solve the problem of frequent deceleration of unmanned vehicles when approaching obstacles, this article uses a Deep Q-Network (DQN) and its extension, the Double Deep Q-Network (DDQN), to develop a local navigation system that…

Robotics · Computer Science 2024-04-29 Hao Liu , Yi Shen , Wenjing Zhou , Yuelin Zou , Chang Zhou , Shuyao He

Autonomous visual navigation is an essential element in robot autonomy. Reinforcement learning (RL) offers a promising policy training paradigm. However existing RL methods suffer from high sample complexity, poor sim-to-real transfer, and…

Robotics · Computer Science 2025-07-31 Qianzhong Chen , Jiankai Sun , Naixiang Gao , JunEn Low , Timothy Chen , Mac Schwager

Deep Reinforcement Learning is quickly becoming a popular method for training autonomous Unmanned Aerial Vehicles (UAVs). Our work analyzes the effects of measurement uncertainty on the performance of Deep Reinforcement Learning (DRL) based…

Robotics · Computer Science 2023-03-14 Bhaskar Joshi , Dhruv Kapur , Harikumar Kandath

Monitoring and patrolling large water resources is a major challenge for conservation. The problem of acquiring data of an underlying environment that usually changes within time involves a proper formulation of the information. The use of…

Robotics · Computer Science 2022-10-18 Samuel Yanes Luis , Daniel Gutiérrez Reina , Sergio Toral Marín

Machine learning techniques have outperformed numerous rule-based methods for decision-making in autonomous vehicles. Despite recent efforts, lane changing remains a major challenge, due to the complex driving scenarios and changeable…

Robotics · Computer Science 2024-02-20 Kunpeng Xu , Lifei Chen , Shengrui Wang

This study focuses on optimizing path planning for unmanned ground vehicles (UGVs) in precision agriculture using deep reinforcement learning (DRL) techniques in continuous action spaces. The research begins with a review of traditional…

Robotics · Computer Science 2026-01-09 Laukik Patade , Rohan Rane , Sandeep Pillai

Deep reinforcement learning (DRL) provides a promising way for learning navigation in complex autonomous driving scenarios. However, identifying the subtle cues that can indicate drastically different outcomes remains an open problem with…

Machine Learning · Computer Science 2021-03-25 Xiaobai Ma , Jiachen Li , Mykel J. Kochenderfer , David Isele , Kikuo Fujimura