English
Related papers

Related papers: Is FISHER All You Need in The Multi-AUV Underwater…

200 papers

Autonomous underwater vehicle (AUV) plays an increasingly important role in ocean exploration. Existing AUVs are usually not fully autonomous and generally limited to pre-planning or pre-programming tasks. Reinforcement learning (RL) and…

Artificial Intelligence · Computer Science 2020-01-13 Qilei Zhang , Jinying Lin , Qixin Sha , Bo He , Guangliang Li

While imitation learning provides us with an efficient toolkit to train robots, learning skills that are robust to environment variations remains a significant challenge. Current approaches address this challenge by relying either on large…

Robotics · Computer Science 2023-03-03 Siddhant Haldar , Jyothish Pari , Anant Rai , Lerrel Pinto

This study investigates a method to guide and control fish schools using virtual fish trained with reinforcement learning. We utilize 2D virtual fish displayed on a screen to overcome technical challenges such as durability and movement…

Robotics · Computer Science 2026-03-18 Yusuke Nishii , Hiroaki Kawashima

Autonomous vehicles (AV) offer a cost-effective solution for scientific missions such as underwater tracking. Recently, reinforcement learning (RL) has emerged as a powerful method for controlling AVs in complex marine environments.…

Robotics · Computer Science 2025-10-20 Matteo Gallici , Ivan Masmitja , Mario Martín

Autonomous Underwater Vehicles (AUVs) are essential for marine exploration, yet their control remains highly challenging due to nonlinear dynamics and uncertain environmental disturbances. This paper presents a diffusion-augmented…

Robotics · Computer Science 2025-10-01 Jingzehua Xu , Guanwen Xie , Weiyi Liu , Jiwei Tang , Ziteng Yang , Tianxiang Xing , Yiyuan Yang , Shuai Zhang , Xiaofan Li

This study presents a novel environment-aware reinforcement learning (RL) framework designed to augment the operational capabilities of autonomous underwater vehicles (AUVs) in underwater environments. Departing from traditional RL…

Systems and Control · Electrical Eng. & Systems 2025-12-02 Yimian Ding , Jingzehua Xu , Guanwen Xie , Shuai Zhang , Yi Li

Recently, reinforcement learning (RL) has been extensively studied and achieved promising results in a wide range of control tasks. Meanwhile, autonomous underwater vehicle (AUV) is an important tool for executing complex and challenging…

Robotics · Computer Science 2019-11-28 Yachu Hsu , Hui Wu , Keyou You , Shiji Song

Vision-driven autonomous flight and obstacle avoidance of Unmanned Aerial Vehicles (UAVs) along complex riverine environments for tasks like rescue and surveillance requires a robust control policy, which is yet difficult to obtain due to…

Robotics · Computer Science 2025-08-14 Zihan Wang , Jianwen Li , Nina Mahmoudian

Multi-UAV pursuit-evasion, where pursuers aim to capture evaders, poses a key challenge for UAV swarm intelligence. Multi-agent reinforcement learning (MARL) has demonstrated potential in modeling cooperative behaviors, but most RL-based…

Robotics · Computer Science 2025-07-09 Jiayu Chen , Chao Yu , Guosheng Li , Wenhao Tang , Shilong Ji , Xinyi Yang , Botian Xu , Huazhong Yang , Yu Wang

Controlling AUVs can be challenging because of the effect of complex non-linear hydrodynamic forces acting on the robot, which are significant in water and cannot be ignored. The problem is exacerbated for small AUVs for which the dynamics…

Robotics · Computer Science 2025-03-11 Levi Cai , Kevin Chang , Yogesh Girdhar

Autonomous Underwater Vehicles (AUVs) require reliable six-degree-of-freedom (6-DOF) position control to operate effectively in complex and dynamic marine environments. Traditional controllers are effective under nominal conditions but…

Robotics · Computer Science 2026-02-03 Sümer Tunçay , Alain Andres , Ignacio Carlucho

With the rapid deployment of SCADA systems, how to effectively analyze industrial signals and detect abnormal states is an urgent need for the industry. Due to the significant heterogeneity of these signals, which we summarize as the M5…

Reinforcement Learning (RL) is a promising solution, allowing Unmanned Underwater Vehicles (UUVs) to learn optimal behaviors through trial and error. However, existing simulators lack efficient integration with RL methods, limiting training…

Robotics · Computer Science 2024-10-21 Shuguang Chu , Zebin Huang , Mingwei Lin , Dejun Li , Ignacio Carlucho

Compliance with maritime traffic rules is essential for the safe operation of autonomous vessels, yet training reinforcement learning (RL) agents to adhere to them is challenging. The behavior of RL agents is shaped by the training…

Systems and Control · Electrical Eng. & Systems 2026-05-28 Marlon Müller , Florian Finkeldei , Hanna Krasowski , Murat Arcak , Matthias Althoff

Learning from demonstrations has made great progress over the past few years. However, it is generally data hungry and task specific. In other words, it requires a large amount of data to train a decent model on a particular task, and the…

Machine Learning · Computer Science 2021-03-29 Pin Wang , Hanhan Li , Ching-Yao Chan

Deep reinforcement learning (RL) has been successfully applied to a variety of game-like environments. However, the application of deep RL to visual navigation with realistic environments is a challenging task. We propose a novel learning…

Robotics · Computer Science 2019-11-12 Jonáš Kulhánek , Erik Derner , Tim de Bruin , Robert Babuška

While deep reinforcement learning (RL) has been increasingly applied in designing car-following models in the last years, this study aims at investigating the feasibility of RL-based vehicle-following for complex vehicle dynamics and strong…

Computational Engineering, Finance, and Science · Computer Science 2022-07-08 Fabian Hart , Ostap Okhrin , Martin Treiber

In marine operations underwater manipulators play a primordial role. However, due to uncertainties in the dynamic model and disturbances caused by the environment, low-level control methods require great capabilities to adapt to change.…

Robotics · Computer Science 2021-08-06 Ignacio Carlucho , Mariano De Paula , Gerardo G. Acosta , Corina Barbalata

Learning from Demonstration (LfD) approaches empower end-users to teach robots novel tasks via demonstrations of the desired behaviors, democratizing access to robotics. However, current LfD frameworks are not capable of fast adaptation to…

Machine Learning · Computer Science 2025-05-29 Letian Chen , Sravan Jayanthi , Rohan Paleja , Daniel Martin , Viacheslav Zakharov , Matthew Gombolay

Learning-based adaptive control methods hold the premise of enabling autonomous agents to reduce the effect of process variations with minimal human intervention. However, its application to autonomous underwater vehicles (AUVs) has so far…

‹ Prev 1 2 3 10 Next ›