English
Related papers

Related papers: Robust active flow control over a range of Reynold…

200 papers

Flow control is key to maximize energy efficiency in a wide range of applications. However, traditional flow-control methods face significant challenges in addressing non-linear systems and high-dimensional data, limiting their application…

Machine Learning · Computer Science 2024-10-28 Joongoo Jeon , Jean Rabault , Joel Vasanth , Francisco Alcántara-Ávila , Shilaj Baral , Ricardo Vinuesa

Deep reinforcement learning (DRL) has emerged as a powerful framework for solving sequential decision-making problems, achieving remarkable success in a wide range of applications, including game AI, autonomous driving, biomedicine, and…

Machine Learning · Computer Science 2025-05-14 Yinghan Sun , Hongxi Wang , Hua Chen , Wei Zhang

We conduct an active flow control (AFC) study on the mass flow rate of synthetic jets on the upper and lower surfaces of a square cylinder using a deep reinforcement learning (DRL) algorithm, with a focus on investigating the influence of…

Fluid Dynamics · Physics 2024-10-01 Wang Jia , Hang Xu

We propose ReinFlow, a simple yet effective online reinforcement learning (RL) framework that fine-tunes a family of flow matching policies for continuous robotic control. Derived from rigorous RL theory, ReinFlow injects learnable noise…

Robotics · Computer Science 2026-01-09 Tonghe Zhang , Chao Yu , Sichang Su , Yu Wang

This study presents the first experimental implementation of deep reinforcement learning (DRL) for the active real-time suppression of flow-induced vibrations in simultaneously vibrating tandem cylinders using rotary actuation, considering…

Fluid Dynamics · Physics 2026-05-21 Hussam Sababha , Mohammed Daqaq

Deep reinforcement learning (DRL) has recently been adopted in a wide range of physics and engineering domains for its ability to solve decision-making problems that were previously out of reach due to a combination of non-linearity and…

Computational Physics · Physics 2024-06-19 Paul Garnier , Jonathan Viquerat , Jean Rabault , Aurélien Larcher , Alexander Kuhnle , Elie Hachem

This research gauges the ability of deep reinforcement learning (DRL) techniques to assist the control of conjugate heat transfer systems governed by the coupled Navier--Stokes and heat equations. It uses a novel, "degenerate" version of…

Fluid Dynamics · Physics 2021-03-25 Elie Hachem , Hassan Ghraieb , Jonathan Viquerat , Aurélien Larcher , Philippe Meliga

Unmanned Aerial Vehicles (UAVs) are increasingly populating urban areas for delivery and surveillance purposes. In this work, we develop an optimal navigation strategy based on Deep Reinforcement Learning. The environment is represented by…

Artificial Intelligence · Computer Science 2025-10-30 Federica Tonti , Ricardo Vinuesa

Active flow control for drag reduction with reinforcement learning (RL) is performed in the wake of a 2D square bluff body at laminar regimes with vortex shedding. Controllers parameterised by neural networks are trained to drive two…

Fluid Dynamics · Physics 2024-01-17 Chengwei Xia , Junjie Zhang , Eric C. Kerrigan , Georgios Rigas

Embedding the intrinsic symmetry of a flow system in training its machine learning algorithms has become a significant trend in the recent surge of their application in fluid mechanics. This paper leverages the geometric symmetry of a…

Fluid Dynamics · Physics 2025-06-04 Xuan Dai , Da Xu , Mengqi Zhang , Yantao Yang

Model-free deep reinforcement learning (DRL) methods suffer from poor sample efficiency. To overcome this limitation, this work introduces an adaptive reduced-order-model (ROM)-based reinforcement learning framework for active flow control.…

Machine Learning · Computer Science 2026-04-08 Zesheng Yao , Zhen-Hua Wan , Canjun Yang , Qingchao Xia , Mengqi Zhang

Deep Reinforcement Learning (DRL) for quadrotor flight control typically relies on Domain Randomization (DR) for sim-to-real transfer, resulting in overly conservative policies that struggle with dynamic disturbances. To overcome this, we…

Robotics · Computer Science 2026-05-19 Vishnu Saj , Sushil Vemuri , Dileep Kalathil , Moble Benedict

Previous studies on automatic berthing systems based on artificial neural network (ANN) showed great berthing performance by training the ANN with ship berthing data as training data. However, because the ANN requires a large amount of…

Machine Learning · Computer Science 2021-12-06 Daesoo Lee

Autonomous UAV inspection of confined industrial infrastructure, such as ventilation ducts, demands robust navigation policies where collisions are unacceptable. While Deep Reinforcement Learning (DRL) offers a powerful paradigm for…

Reinforcement learning is applied to the development of control strategies in order to reduce skin friction drag in a fully developed turbulent channel flow at a low Reynolds number. Motivated by the so-called opposition control (Choi et…

Fluid Dynamics · Physics 2023-04-26 Takahiro Sonoda , Zhuchen Liu , Toshitaka Itoh , Yosuke Hasegawa

Deep Reinforcement Learning (DRL) has experienced significant advancements in recent years and has been widely used in many fields. In DRL-based robotic policy learning, however, current de facto policy parameterization is still…

Robotics · Computer Science 2026-03-13 Diyuan Shi , Yiqi Tang , Zifeng Zhuang , Donglin Wang

A general control policy framework based on deep reinforcement learning (DRL) is introduced for closed-loop decision making in subsurface flow settings. Traditional closed-loop modeling workflows in this context involve the repeated…

Computational Physics · Physics 2023-02-15 Yusuf Nasir , Louis J. Durlofsky

Controlling autonomous vehicles at their handling limits is a significant challenge, particularly for electric vehicles with active four wheel drive (A4WD) systems offering independent wheel torque control. While traditional Vehicle…

Robotics · Computer Science 2025-06-09 Gergely Bari , Laszlo Palkovics

To optimize flapping foil performance, the application of deep reinforcement learning (DRL) on controlling foil non-parametric motion is conducted in the present study. Traditional control techniques and simplified motions cannot fully…

Fluid Dynamics · Physics 2023-05-26 Z. P. Wang , R. J. Lin , Z. Y. Zhao , P. M. Guo , N. Yang , D. X. Fan

Traffic scenarios in roundabouts pose substantial complexity for automated driving. Manually mapping all possible scenarios into a state space is labor-intensive and challenging. Deep reinforcement learning (DRL) with its ability to learn…

Robotics · Computer Science 2023-06-21 Henan Yuan , Penghui Li , Bart van Arem , Liujiang Kang , Yongqi Dong