English
Related papers

Related papers: Plug-and-Play Benchmarking of Reinforcement Learni…

200 papers

This study presents novel drag reduction active-flow-control (AFC) strategies} for a three-dimensional cylinder immersed in a flow at a Reynolds number based on freestream velocity and cylinder diameter of $Re_D=3900$. The cylinder in this…

Fluid Dynamics · Physics 2025-02-20 P. Suárez , F. Álcantara-Ávila , A. Miró , J. Rabault , B. Font , O. Lehmkuhl , R. Vinuesa

We introduce a reinforcement learning (RL) environment to design and benchmark control strategies aimed at reducing drag in turbulent fluid flows enclosed in a channel. The environment provides a framework for computationally-efficient,…

Fluid Dynamics · Physics 2023-02-09 L. Guastoni , J. Rabault , P. Schlatter , H. Azizpour , R. Vinuesa

Effective visual representation learning is crucial for reinforcement learning (RL) agents to extract task-relevant information from raw sensory inputs and generalize across diverse environments. However, existing RL benchmarks lack the…

Improving system-level resiliency of networked microgrids is an important aspect with increased population of inverter-based resources (IBRs). This paper (1) presents resilient control design in presence of adversarial cyber-events, and…

Simulating fluid flow around arbitrary shapes is key to solving various engineering problems. However, simulating flow physics across complex geometries remains numerically challenging and computationally resource-intensive, particularly…

In recent years, \emph{Reinforcement Learning} (RL) has made remarkable progress, achieving superhuman performance in a wide range of simulated environments. As research moves toward deploying RL in real-world applications, the field faces…

Most existing safe reinforcement learning (RL) benchmarks focus on robotics and control tasks, offering limited relevance to high-stakes domains that involve structured constraints, mixed-integer decisions, and industrial complexity. This…

Active flow control for drag reduction with reinforcement learning (RL) is performed in the wake of a 2D square bluff body at laminar regimes with vortex shedding. Controllers parameterised by neural networks are trained to drive two…

Fluid Dynamics · Physics 2024-01-17 Chengwei Xia , Junjie Zhang , Eric C. Kerrigan , Georgios Rigas

Reinforcement learning (RL) can provide adaptive and scalable controllers essential for power grid decarbonization. However, RL methods struggle with power grids' complex dynamics, long-horizon goals, and hard physical constraints. For…

In recent years, deep reinforcement learning has emerged as a technique to solve closed-loop flow control problems. Employing simulation-based environments in reinforcement learning enables a priori end-to-end optimization of the control…

Fluid Dynamics · Physics 2024-04-11 Andre Weiner , Janis Geise

Teaching performance engineering in high-performance computing (HPC) requires example codes that demonstrate bottlenecks and enable hands-on optimization. However, existing HPC applications and proxy apps often lack the balance of…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-08 Peter Arzt , Sebastian Kreutzer , Tim Jammer , Christian Bischof

Active flow control remains a significant challenge due to the high-dimensional, nonlinear nature of fluid dynamics. Quantum machine learning may prove effective in addressing these issues, given that quantum computing possesses superiority…

Fluid Dynamics · Physics 2026-01-27 Hongfu Zhang , Hui Tang

The pursuit of agile and efficient underwater robots, especially bio-mimetic robotic fish, has been impeded by challenges in creating motion controllers that are able to fully exploit their hydrodynamic capabilities. This paper addresses…

Robotics · Computer Science 2025-01-13 Xiaozhu Lin , Xiaopei Liu , Yang Wang

Reinforcement learning (RL) in few-shot scenarios with limited sensor data is challenging due to insufficient training samples, particularly in applications like Dynamic Voltage and Frequency Scaling (DVFS) where sensor readings are…

Machine Learning · Computer Science 2026-01-13 Mohammad Pivezhandi , Abusayeed Saifullah

Due to the empirical success of reinforcement learning, an increasing number of students study the subject. However, from our practical teaching experience, we see students entering the field (bachelor, master and early PhD) often struggle.…

We present flow Q-learning (FQL), a simple and performant offline reinforcement learning (RL) method that leverages an expressive flow-matching policy to model arbitrarily complex action distributions in data. Training a flow policy with RL…

Machine Learning · Computer Science 2025-05-27 Seohong Park , Qiyang Li , Sergey Levine

We propose an open-source python platform for applications of Deep Reinforcement Learning (DRL) in fluid mechanics. DRL has been widely used in optimizing decision-making in nonlinear and high-dimensional problems. Here, an agent maximizes…

Fluid Dynamics · Physics 2024-06-19 Qiulei Wang , Lei Yan , Gang Hu , Chao Li , Yiqing Xiao , Hao Xiong , Jean Rabault , Bernd R. Noack

Traffic signal control is an emerging application scenario for reinforcement learning. Besides being as an important problem that affects people's daily life in commuting, traffic signal control poses its unique challenges for reinforcement…

Multiagent Systems · Computer Science 2019-05-15 Huichu Zhang , Siyuan Feng , Chang Liu , Yaoyao Ding , Yichen Zhu , Zihan Zhou , Weinan Zhang , Yong Yu , Haiming Jin , Zhenhui Li

Offline methods for reinforcement learning have a potential to help bridge the gap between reinforcement learning research and real-world applications. They make it possible to learn policies from offline datasets, thus overcoming concerns…

Large Language Models (LLMs) have demonstrated strong performance across general NLP tasks, but their utility in automating numerical experiments of complex physical system -- a critical and labor-intensive component -- remains…

Computation and Language · Computer Science 2026-04-28 Nithin Somasekharan , Ling Yue , Yadi Cao , Weichao Li , Patrick Emami , Pochinapeddi Sai Bhargav , Anurag Acharya , Xingyu Xie , Shaowu Pan