English
Related papers

Related papers: Learning swimming via deep reinforcement learning

200 papers

Guiding collective motion in biological groups is a fundamental challenge in understanding social interaction rules and developing automated systems for animal management. In this study, we propose a deep reinforcement learning (RL)…

Robotics · Computer Science 2026-03-31 Takato Shibayama , Hiroaki Kawashima

Fish fin rays constitute a sophisticated control system for ray-finned fish, facilitating versatile locomotion within complex fluid environments. Despite extensive research on the kinematics and hydrodynamics of fish locomotion, the…

Fluid Dynamics · Physics 2024-01-23 Xin-Yang Liu , Dariush Bodaghi , Qian Xue , Xudong Zheng , Jian-Xun Wang

Temporal information is essential to learning effective policies with Reinforcement Learning (RL). However, current state-of-the-art RL algorithms either assume that such information is given as part of the state space or, when learning…

Machine Learning · Computer Science 2021-01-07 Wenling Shang , Xiaofei Wang , Aravind Srinivas , Aravind Rajeswaran , Yang Gao , Pieter Abbeel , Michael Laskin

Bio-inspired aquatic propulsion offers high thrust and maneuverability but is prone to destabilizing forces such as lift fluctuations, which are further amplified by six-degree-of-freedom (6-DoF) fluid coupling. We formulate quadrupedal…

Reinforcement Learning (RL) is a promising solution, allowing Unmanned Underwater Vehicles (UUVs) to learn optimal behaviors through trial and error. However, existing simulators lack efficient integration with RL methods, limiting training…

Robotics · Computer Science 2024-10-21 Shuguang Chu , Zebin Huang , Mingwei Lin , Dejun Li , Ignacio Carlucho

Deep reinforcement learning (RL) has emerged as a promising approach for autonomously acquiring complex behaviors from low level sensor observations. Although a large portion of deep RL research has focused on applications in video games…

Robotics · Computer Science 2021-02-08 Julian Ibarz , Jie Tan , Chelsea Finn , Mrinal Kalakrishnan , Peter Pastor , Sergey Levine

We develop a deep reinforcement learning framework for controlling a bio-inspired jellyfish swimmer to navigate complex fluid environments with obstacles. While existing methods often rely on kinematic and geometric states, a key challenge…

Fluid Dynamics · Physics 2025-11-07 Yihao Chen , Yue Yang

This study explores the application of deep reinforcement learning (RL) to design an airfoil pitch controller capable of minimizing lift variations in randomly disturbed flows. The controller, treated as an agent in a partially observable…

Fluid Dynamics · Physics 2024-04-03 Diederik Beckers , Jeff D. Eldredge

Reinforcement Learning (RL) of robotic manipulation skills, despite its impressive successes, stands to benefit from incorporating domain knowledge from control theory. One of the most important properties that is of interest is control…

Robotics · Computer Science 2021-03-03 Shahbaz Abdul Khader , Hang Yin , Pietro Falco , Danica Kragic

This study presents a novel environment-aware reinforcement learning (RL) framework designed to augment the operational capabilities of autonomous underwater vehicles (AUVs) in underwater environments. Departing from traditional RL…

Systems and Control · Electrical Eng. & Systems 2025-12-02 Yimian Ding , Jingzehua Xu , Guanwen Xie , Shuai Zhang , Yi Li

Deep reinforcement learning (DRL) has been applied to a variety of problems during the past decade, and has provided effective control strategies in high-dimensional and non-linear situations that are challenging to traditional methods.…

Fluid Dynamics · Physics 2023-04-07 Colin Vignon , Jean Rabault , Ricardo Vinuesa

Controlled gliding is one of the most energetically efficient modes of transportation for natural and human powered fliers. Here we demonstrate that gliding and landing strategies with different optimality criteria can be identified through…

Robotics · Computer Science 2018-07-11 Guido Novati , Lakshminarayanan Mahadevan , Petros Koumoutsakos

The increasing number of unmanned aerial vehicles (UAVs) in urban environments requires a strategy to minimize their environmental impact, both in terms of energy efficiency and noise reduction. In order to reduce these concerns, novel…

Artificial Intelligence · Computer Science 2024-09-27 Federica Tonti , Jean Rabault , Ricardo Vinuesa

Machine learning has recently become a promising technique in fluid mechanics, especially for active flow control (AFC) applications. A recent work [J. Fluid Mech. (2019), vol. 865, pp. 281-302] has demonstrated the feasibility and…

Fluid Dynamics · Physics 2021-03-22 Feng Ren , Jean Rabault , Hui Tang

In percutaneous intervention for treatment of coronary plaques, guidewire navigation is a primary procedure for stent delivery. Steering a flexible guidewire within coronary arteries requires considerable training, and the non-linearity…

Deep reinforcement learning (deep RL) has been successful in learning sophisticated behaviors automatically; however, the learning process requires a huge number of trials. In contrast, animals can learn new tasks in just a few trials,…

Artificial Intelligence · Computer Science 2016-11-11 Yan Duan , John Schulman , Xi Chen , Peter L. Bartlett , Ilya Sutskever , Pieter Abbeel

Navigating efficiently across vortical flow fields presents a significant challenge in various robotic applications. The dynamic and unsteady nature of vortical flows often disturbs the control of underwater robots, complicating their…

Robotics · Computer Science 2024-10-01 Haodong Feng , Dehan Yuan , Jiale Miao , Jie You , Yue Wang , Yi Zhu , Dixia Fan

Marine microorganisms must cope with complex flow patterns and even turbulence as they navigate the ocean. To survive they must avoid predation and find efficient energy sources. A major difficulty in analysing possible survival strategies…

Fluid Dynamics · Physics 2022-11-29 J. Qiu , N. Mousavi , K. Gustavsson , C. Xu , B. Mehlig , L. Zhao

Motion retargeting holds a premise of offering a larger set of motion data for characters and robots with different morphologies. Many prior works have approached this problem via either handcrafted constraints or paired motion datasets,…

Graphics · Computer Science 2025-10-21 Wontaek Kim , Tianyu Li , Sehoon Ha

This work aims at finding optimal navigation policies for thin, deformable microswimmers that progress in a viscous fluid by propagating a sinusoidal undulation along their slender body. These active filaments are embedded in a prescribed,…

Fluid Dynamics · Physics 2023-02-13 Zakarya El Khiyati , Raphael Chesneaux , Laetitia Giraldi , Jeremie Bec