English
Related papers

Related papers: DRLinSPH: An open-source platform using deep reinf…

200 papers

AFSI is a novel, open-source fluid-structure interaction (FSI) solver that extends the capabilities of the FEniCS finite element library through an immersed boundary (IB) framework. Designed to simulate large deformations in hyperelastic…

Computational Physics · Physics 2025-09-03 Pengfei Ma , Li Cai , Xuan Wang , Hao Gao

This work reports the application of a model-free deep-reinforcement-learning-based (DRL) flow control strategy to suppress perturbations evolving in the 1-D linearised Kuramoto-Sivashinsky (KS) equation and 2-D boundary layer flows. The…

Fluid Dynamics · Physics 2023-01-18 Da Xu , Mengqi Zhang

In recent years significant progress has been made in dealing with challenging problems using reinforcement learning.Despite its great success, reinforcement learning still faces challenge in continuous control tasks. Conventional methods…

Machine Learning · Computer Science 2020-02-04 Longxiang Shi , Shijian Li , Longbing Cao , Long Yang , Gang Zheng , Gang Pan

This study proposes a self-learning algorithm for closed-loop cylinder wake control targeting lower drag and lower lift fluctuations with the additional challenge of sparse sensor information, taking deep reinforcement learning as the…

Machine Learning · Computer Science 2024-06-04 Qiulei Wang , Lei Yan , Gang Hu , Wenli Chen , Jean Rabault , Bernd R. Noack

Turbulent flows and fluid-structure interactions (FSI) are ubiquitous in scientific and engineering applications, but their accurate and efficient simulation remains a major challenge due to strong nonlinearities, multiscale interactions,…

Fluid Dynamics · Physics 2025-06-02 Xiantao Fan , Xinyang Liu , Meng Wang , Jian-Xun Wang

Dynamic state representation learning is an important task in robot learning. Latent space that can capture dynamics related information has wide application in areas such as accelerating model free reinforcement learning, closing the…

Robotics · Computer Science 2022-07-27 Sirui Chen , Yunhao Liu , Jialong Li , Shang Wen Yao , Tingxiang Fan , Jia Pan

We present a partitioned neural network-based framework for learning of fluid-structure interaction (FSI) problems. We decompose the simulation domain into two smaller sub-domains, i.e., fluid and solid domains, and incorporate an…

Computational Engineering, Finance, and Science · Computer Science 2021-05-17 Amin Totounferoush , Axel Schumacher , Miriam Schulte

Deep Reinforcement Learning (DRL) has achieved great success in solving complicated decision-making problems. Despite the successes, DRL is frequently criticized for many reasons, e.g., data inefficient, inflexible and intractable reward…

Machine Learning · Computer Science 2023-02-07 Weiqin Chen

We present diffSPH, a novel open-source differentiable Smoothed Particle Hydrodynamics (SPH) framework developed entirely in PyTorch with GPU acceleration. diffSPH is designed centrally around differentiation to facilitate optimization and…

Fluid Dynamics · Physics 2025-07-30 Rene Winchenbach , Nils Thuerey

Reinforcement Learning (RL) is a machine learning framework for artificially intelligent systems to solve a variety of complex problems. Recent years has seen a surge of successes solving challenging games and smaller domain problems,…

Robotics · Computer Science 2020-01-28 Florian Richter , Ryan K. Orosco , Michael C. Yip

This letter investigates the reconfigurable intelligent surface (RIS)-assisted multiple-input single-output (MISO) wireless system, where both half-duplex (HD) and full-duplex (FD) operating modes are considered together, for the first time…

Signal Processing · Electrical Eng. & Systems 2021-10-12 Alice Faisal , Ibrahim Al-Nahhal , Octavia A. Dobre , Telex M. N. Ngatched

Reinforcement learning has gained traction for active flow control tasks, with initial applications exploring drag mitigation via flow field augmentation around a two-dimensional cylinder. RL has since been extended to more complex…

Machine Learning · Computer Science 2025-04-01 Marius Kurz , Rohan Kaushik , Marcel Blind , Patrick Kopper , Anna Schwarz , Felix Rodach , Andrea Beck

The optimal dispatch of energy storage systems (ESSs) presents formidable challenges due to the uncertainty introduced by fluctuations in dynamic prices, demand consumption, and renewable-based energy generation. By exploiting the…

Systems and Control · Electrical Eng. & Systems 2023-07-27 Shengren Hou , Edgar Mauricio Salazar Duque , Peter Palensky , Pedro P. Vergara

The framework of deep reinforcement learning (DRL) provides a powerful and widely applicable mathematical formalization for sequential decision-making. This paper present a novel DRL framework, termed \emph{$f$-Divergence Reinforcement…

Machine Learning · Computer Science 2021-12-15 Chen Gong , Qiang He , Yunpeng Bai , Zhou Yang , Xiaoyu Chen , Xinwen Hou , Xianjie Zhang , Yu Liu , Guoliang Fan

A three-dimensional SPH computational framework is presented for modeling fluid-structure interactions with structural deformation and failure. We combine weakly compressible SPH with a pseudo-spring-based SPH solver to capture the fluid…

Computational Engineering, Finance, and Science · Computer Science 2025-07-16 Vishabjeet Singh , Chong Peng , Md Rushdie Ibne Islam

Swarm intelligence is being increasingly deployed in autonomous systems, such as drones and unmanned vehicles. Federated reinforcement learning (FRL), a key swarm intelligence paradigm where agents interact with their own environments and…

Machine Learning · Computer Science 2022-03-15 Zishen Wan , Aqeel Anwar , Abdulrahman Mahmoud , Tianyu Jia , Yu-Shun Hsiao , Vijay Janapa Reddi , Arijit Raychowdhury

We present a novel Deep Reinforcement Learning (DRL) based policy to compute dynamically feasible and spatially aware velocities for a robot navigating among mobile obstacles. Our approach combines the benefits of the Dynamic Window…

Robotics · Computer Science 2020-11-30 Utsav Patel , Nithish Kumar , Adarsh Jagan Sathyamoorthy , Dinesh Manocha

Instabilities arise in a number of flow configurations. One such manifestation is the development of interfacial waves in multiphase flows, such as those observed in the falling liquid film problem. Controlling the development of such…

Fluid Dynamics · Physics 2019-10-18 Vincent Belus , Jean Rabault , Jonathan Viquerat , Zhizhao Che , Elie Hachem , Ulysse Reglade

Deep Reinforcement Learning (DRL) is applied to control a nonlinear, chaotic system governed by the one-dimensional Kuramoto-Sivashinsky (KS) equation. DRL uses reinforcement learning principles for the determination of optimal control…

Deep reinforcement learning (DRL) is a promising outer-loop intelligence paradigm which can deploy problem solving strategies for complex tasks. Consequently, DRL has been utilized for several scientific applications, specifically in cases…

Machine Learning · Computer Science 2023-04-05 Sahil Bhola , Suraj Pawar , Prasanna Balaprakash , Romit Maulik