English
Related papers

Related papers: A review on Deep Reinforcement Learning for Fluid …

200 papers

Controlling instabilities in complex dynamical systems is challenging in scientific and engineering applications. Deep reinforcement learning (DRL) has seen promising results for applications in different scientific applications. The…

Machine Learning · Computer Science 2025-04-09 Luning Sun , Xin-Yang Liu , Siyan Zhao , Aditya Grover , Jian-Xun Wang , Jayaraman J. Thiagarajan

Deep Reinforcement Learning (DRL) has shown a dramatic improvement in decision-making and automated control problems. Consequently, DRL represents a promising technique to efficiently solve many relevant optimization problems (e.g.,…

Networking and Internet Architecture · Computer Science 2022-10-10 Paul Almasan , José Suárez-Varela , Krzysztof Rusek , Pere Barlet-Ros , Albert Cabellos-Aparicio

Deep reinforcement learning (DRL) has been used to learn effective heuristics for solving complex combinatorial optimisation problem via policy networks and have demonstrated promising performance. Existing works have focused on solving…

Machine Learning · Computer Science 2020-12-25 Nasrin Sultana , Jeffrey Chan , A. K. Qin , Tabinda Sarwar

Many existing traffic signal controllers are either simple adaptive controllers based on sensors placed around traffic intersections, or optimized by traffic engineers on a fixed schedule. Optimizing traffic controllers is time consuming…

Systems and Control · Electrical Eng. & Systems 2019-11-15 Kai Liang Tan , Subhadipto Poddar , Anuj Sharma , Soumik Sarkar

Recently, reinforcement learning (RL) has been extensively studied and achieved promising results in a wide range of control tasks. Meanwhile, autonomous underwater vehicle (AUV) is an important tool for executing complex and challenging…

Robotics · Computer Science 2019-11-28 Yachu Hsu , Hui Wu , Keyou You , Shiji Song

This work reports the application of a model-free deep-reinforcement-learning-based (DRL) flow control strategy to suppress perturbations evolving in the 1-D linearised Kuramoto-Sivashinsky (KS) equation and 2-D boundary layer flows. The…

Fluid Dynamics · Physics 2023-01-18 Da Xu , Mengqi Zhang

We demonstrate that deep reinforcement learning (deep RL) provides a highly effective strategy for the control and self-tuning of optical systems. Deep RL integrates the two leading machine learning architectures of deep neural networks and…

Signal Processing · Electrical Eng. & Systems 2020-06-11 Chang Sun , Eurika Kaiser , Steven L. Brunton , J. Nathan Kutz

Aquatic organisms are known for their ability to generate efficient propulsion with low energy expenditure. While existing research has sought to leverage bio-inspired structures to reduce energy costs in underwater robotics, the crucial…

Robotics · Computer Science 2025-06-06 Xinyu Cui , Boai Sun , Yi Zhu , Ning Yang , Haifeng Zhang , Weicheng Cui , Dixia Fan , Jun Wang

This paper presents the first deep reinforcement learning (DRL) framework to estimate the optimal Dynamic Treatment Regimes from observational medical data. This framework is more flexible and adaptive for high dimensional action and state…

Artificial Intelligence · Computer Science 2018-01-30 Ning Liu , Ying Liu , Brent Logan , Zhiyuan Xu , Jian Tang , Yanzhi Wang

Existing methods for optimal control struggle to deal with the complexity commonly encountered in real-world systems, including dimensionality, process error, model bias and data heterogeneity. Instead of tackling these system complexities…

Machine Learning · Computer Science 2024-03-05 Felipe Montealegre-Mora , Marcus Lapeyrolerie , Melissa Chapman , Abigail G. Keller , Carl Boettiger

Unmanned aerial vehicles (UAVs) are playing an increasingly pivotal role in modern communication networks,offering flexibility and enhanced coverage for a variety of applica-tions. However, UAV networks pose significant challenges due to…

Networking and Internet Architecture · Computer Science 2025-02-19 Wei Zhao , Shaoxin Cui , Wen Qiu , Zhiqiang He , Zhi Liu , Xiao Zheng , Bomin Mao , Nei Kato

We propose a novel benchmark environment for Safe Reinforcement Learning focusing on aquatic navigation. Aquatic navigation is an extremely challenging task due to the non-stationary environment and the uncertainties of the robotic…

Machine Learning · Computer Science 2021-12-21 Enrico Marchesini , Davide Corsi , Alessandro Farinelli

Recent technology development brings the boom of numerous new Demand-Driven Services (DDS) into urban lives, including ridesharing, on-demand delivery, express systems and warehousing. In DDS, a service loop is an elemental structure,…

Machine Learning · Computer Science 2024-10-29 Zefang Zong , Jingwei Wang , Tao Feng , Tong Xia , Depeng Jin , Yong Li

The large-scale integration of intermittent renewable energy resources introduces increased uncertainty and volatility to the supply side of power systems, thereby complicating system operation and control. Recently, data-driven approaches,…

Systems and Control · Electrical Eng. & Systems 2024-07-02 Peipei Yu , Zhenyi Wang , Hongcai Zhang , Yonghua Song

Dams impact downstream river dynamics through flow regulation and disruption of upstream-downstream linkages. However, current dam operation is far from satisfactory due to the inability to respond the complicated and uncertain dynamics of…

Reinforcement Learning (RL), bolstered by the expressive capabilities of Deep Neural Networks (DNNs) for function approximation, has demonstrated considerable success in numerous applications. However, its practicality in addressing various…

Machine Learning · Computer Science 2024-04-26 Aditya Mohan , Amy Zhang , Marius Lindauer

This paper develops a Deep Reinforcement Learning (DRL)-agent for navigation and control of autonomous surface vessels (ASV) on inland waterways. Spatial restrictions due to waterway geometry and the resulting challenges, such as high flow…

Machine Learning · Computer Science 2023-04-04 Niklas Paulig , Ostap Okhrin

Fish fin rays constitute a sophisticated control system for ray-finned fish, facilitating versatile locomotion within complex fluid environments. Despite extensive research on the kinematics and hydrodynamics of fish locomotion, the…

Fluid Dynamics · Physics 2024-01-23 Xin-Yang Liu , Dariush Bodaghi , Qian Xue , Xudong Zheng , Jian-Xun Wang

Next Generation (NextG) networks are expected to support demanding tactile internet applications such as augmented reality and connected autonomous vehicles. Whereas recent innovations bring the promise of larger link capacity, their…

Machine Learning · Computer Science 2021-12-08 Peyman Tehrani , Francesco Restuccia , Marco Levorato

This research study explores the applicability of Deep Reinforcement Learning (DRL) for thermal control based on Computational Fluid Dynamics. To accomplish that, the forced convection on a hot plate prone to a pulsating cooling jet with…

Numerical Analysis · Mathematics 2024-02-19 Sajad Salavatidezfouli , Giovanni Stabile , Gianluigi Rozza