English
Related papers

Related papers: Deep Reinforcement Learning for Turbulence Modelin…

200 papers

In this work, we will present a physically consistent theory to derive the governing equations of the Large Eddy Simulation (LES) framework based on first principles rather than the motivation to conduct computationally affordable…

Fluid Dynamics · Physics 2021-10-13 Max Okraschevski , Sven Hoffmann , Katharina Stichling , Rainer Koch , Hans-Joerg Bauer

Data-efficient reinforcement learning (RL) in continuous state-action spaces using very high-dimensional observations remains a key challenge in developing fully autonomous systems. We consider a particularly important instance of this…

Artificial Intelligence · Computer Science 2015-10-12 John-Alexander M. Assael , Niklas Wahlström , Thomas B. Schön , Marc Peter Deisenroth

Classical eddy viscosity models add a viscosity term with turbulent viscosity coefficient whose specification varies from model to model. Turbulent viscosity coefficient approximations of unknown accuracy are typically constructed by…

Numerical Analysis · Mathematics 2019-11-07 William Layon , Michael Schneier

Predicting the large-scale dynamics of three-dimensional (3D) turbulence is challenging for machine learning approaches. This paper introduces a transformer-based neural operator (TNO) to achieve precise and efficient predictions in the…

Fluid Dynamics · Physics 2024-06-07 Zhijie Li , Tianyuan Liu , Wenhui Peng , Zelong Yuan , Jianchun Wang

A residual deep reinforcement learning (RDRL) approach is proposed by integrating DRL with model-based optimization for inverter-based volt-var control in active distribution networks when the accurate power flow model is unknown. RDRL…

Systems and Control · Electrical Eng. & Systems 2024-08-14 Qiong Liu , Ye Guo , Lirong Deng , Haotian Liu , Dongyu Li , Hongbin Sun

A central problem of turbulence theory is to produce a predictive model for turbulent fluxes. These have profound implications for virtually all aspects of the turbulence dynamics. In magnetic confinement devices, drift-wave turbulence…

Plasma Physics · Physics 2020-07-01 R. A. Heinonen , P. H. Diamond

Numerical simulations of atmospheric circulation models are limited by their finite spatial resolution, and so large eddy simulation (LES) is the preferred approach to study these models. In LES a low-pass filter is applied to the flow…

Fluid Dynamics · Physics 2016-04-27 Leila N. Azadani , Anne E. Staples

Large Eddy Simulation (LES) is a very useful tool when simulating turbulent flows if we are only interested in its "larger" scales. One of the possible ways to derive the LES equations is to apply a filter operator to the Navier-Stokes…

Analysis of PDEs · Mathematics 2017-03-14 José M. Rodríguez , Raquel Taboada-Vázquez

Reinforcement learning (RL) has become a foundational approach for enabling intelligent robotic behavior in dynamic and uncertain environments. This work presents an in-depth review of RL principles, advanced deep reinforcement learning…

Robotics · Computer Science 2026-03-17 Kumater Ter , Abolanle Adetifa , Daniel Udekwe

Embodied agents, such as robots and virtual characters, must continuously select actions to execute tasks effectively, solving complex sequential decision-making problems. Given the difficulty of designing such controllers manually,…

Robotics · Computer Science 2026-05-18 Pedro Santana

In this paper we propose a new modeling framework for large eddy simulations (LES) of particle-laden turbulent flows that captures the interaction between the particle and fluid phase on both the resolved and subgrid-scales. Unlike the vast…

Fluid Dynamics · Physics 2023-10-26 Max Hausmann , Fabien Evrard , Berend van Wachem

This work proposes a unified control architecture that couples a Reinforcement Learning (RL)-driven controller with a disturbance-rejection Extended State Observer (ESO), complemented by an Event-Triggered Mechanism (ETM) to limit…

Optimization and Control · Mathematics 2026-01-01 Ningwei Bai , Chi Pui Chan , Qichen Yin , Tengyang Gong , Yunda Yan , Zezhi Tang

The simulation of high Reynolds number (Re) separated turbulent flows faces significant problems for decades: large eddy simulation (LES) is computationally too expensive, and Reynolds-averaged Navier-Stokes (RANS) methods and hybrid…

Fluid Dynamics · Physics 2024-12-02 Stefan Heinz , Adeyemi Fagbade

Reinforcement learning (RL) has shown promise in solving various combinatorial optimization problems. However, conventional RL faces challenges when dealing with complex, real-world constraints, especially when action space feasibility is…

Machine Learning · Computer Science 2025-08-12 Jaike van Twiller , Yossiri Adulyasak , Erick Delage , Djordje Grbic , Rune Møller Jensen

Reinforcement Learning (RL) has emerged as a powerful paradigm in Artificial Intelligence (AI), enabling agents to learn optimal behaviors through interactions with their environments. Drawing from the foundations of trial and error, RL…

Artificial Intelligence · Computer Science 2025-02-04 Majid Ghasemi , Amir Hossein Moosavi , Dariush Ebrahimi

We draw on the latest advancements in the physics community to propose a novel method for discovering the governing non-linear dynamics of physical systems in reinforcement learning (RL). We establish that this method is capable of…

Machine Learning · Computer Science 2022-09-01 Rushiv Arora , Bruno Castro da Silva , Eliot Moss

The popularity of deep reinforcement learning (DRL) methods in economics have been exponentially increased. DRL through a wide range of capabilities from reinforcement learning (RL) and deep learning (DL) for handling sophisticated dynamic…

Statistical Finance · Quantitative Finance 2020-04-06 Amir Mosavi , Pedram Ghamisi , Yaser Faghan , Puhong Duan

This study presents the first experimental implementation of deep reinforcement learning (DRL) for the active real-time suppression of flow-induced vibrations in simultaneously vibrating tandem cylinders using rotary actuation, considering…

Fluid Dynamics · Physics 2026-05-21 Hussam Sababha , Mohammed Daqaq

In this work, we propose using an ensemble Kalman method to learn a nonlinear eddy viscosity model, represented as a tensor basis neural network, from velocity data. Data-driven turbulence models have emerged as a promising alternative to…

Fluid Dynamics · Physics 2022-10-12 Xin-Lei Zhang , Heng Xiao , Xiaodong Luo , Guowei He

Large-eddy simulation (LES) is a well-established numerical technique, which resolves the most energetic turbulent fluctuations in the planetary boundary layers. Averaging these fluctuations, high-quality profiles of mean values and…

Atmospheric and Oceanic Physics · Physics 2007-05-23 Igor N. Esau , Oyvind Byrkjedal