English
Related papers

Related papers: Log-law recovery through reinforcement-learning wa…

200 papers

Despite the low dimensionalities of dissipative viscous fluids, reinforcement learning (RL) requires many observables in fluid control problems. This is because the observables are assumed to follow a policy-independent Markov decision…

Fluid Dynamics · Physics 2021-04-30 Akira Kubo , Masaki Shimizu

Advancing our understanding of astrophysical turbulence is bottlenecked by the limited resolution of numerical simulations that may not fully sample scales in the inertial range. Machine learning (ML) techniques have demonstrated promise in…

Fluid Dynamics · Physics 2024-02-02 Diane M. Salim , Blakesley Burkhart , David Sondak

Large Language Model (LLM) agents have shown stunning results in complex tasks, yet they often operate in isolation, failing to learn from past experiences. Existing memory-based methods primarily store raw trajectories, which are often…

Data-driven approaches offer novel opportunities for improving the performance of turbulent flow simulations, which are critical to wide-ranging applications from wind farms and aerodynamic designs to weather and climate forecasting. While…

Fluid Dynamics · Physics 2024-02-14 Xiao Xue , Shuo Wang , Hua-Dong Yao , Lars Davidson , Peter V. Coveney

Model extrapolation to unseen flow is one of the biggest challenges facing data-driven turbulence modeling, especially for models with high dimensional inputs that involve many flow features. In this study we review previous efforts on…

Fluid Dynamics · Physics 2020-01-16 Shirui Luo , Jiahuan Cui , Madhu Vellakal , Jian Liu , Enyi Jiang , Seid Koric , Volodymyr Kindratenko

In this work, we study model-based reinforcement learning (RL) in unknown stabilizable linear dynamical systems. When learning a dynamical system, one needs to stabilize the unknown dynamics in order to avoid system blow-ups. We propose an…

Machine Learning · Computer Science 2022-06-06 Sahin Lale , Kamyar Azizzadenesheli , Babak Hassibi , Anima Anandkumar

Reinforcement learning is able to solve complex sequential decision-making tasks but is currently limited by sample efficiency and required computation. To improve sample efficiency, recent work focuses on model-based RL which interleaves…

Machine Learning · Computer Science 2023-06-19 Yi Zhao , Wenshuai Zhao , Rinu Boney , Juho Kannala , Joni Pajarinen

We propose a reinforcement learning (RL) framework for the dynamic selection of the filter parameter in Evolve-Filter (EF) regularization strategies for incompressible turbulent flows. Instead of prescribing the filter radius heuristically,…

Numerical Analysis · Mathematics 2026-03-03 Anna Ivagnes , Maria Strazzullo , Gianluigi Rozza

Reinforcement learning (RL) can refine Vision-Language-Action (VLA) policies beyond behavior cloning, but real-world RL remains expensive due to extensive rollouts, resets, supervision, and safety risks. Action-conditioned video world…

Robotics · Computer Science 2026-05-26 Xiaokang Liu , Zechen Bai , Hai Ci , Kevin Yuchen Ma , Mike Zheng Shou

Reinforcement Learning (RL) of robotic manipulation skills, despite its impressive successes, stands to benefit from incorporating domain knowledge from control theory. One of the most important properties that is of interest is control…

Robotics · Computer Science 2021-03-03 Shahbaz Abdul Khader , Hang Yin , Pietro Falco , Danica Kragic

A new velocity scale is derived that yields a Reynolds number independent profile for the streamwise turbulent fluctuations in the near-wall region of wall bounded flows for $y^+<25$. The scaling demonstrates the important role played by…

Fluid Dynamics · Physics 2024-02-06 Marcus Hultmark , Alexander J. Smits

The application of rule-based reinforcement learning (RL) to multimodal large language models (MLLMs) introduces unique challenges and potential deviations from findings in text-only domains, particularly for perception-heavy tasks. This…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Zifu Wang , Junyi Zhu , Bo Tang , Zhiyu Li , Feiyu Xiong , Jiaqian Yu , Matthew B. Blaschko

Enhancing the reasoning capabilities of large language models (LLMs) typically relies on massive computational resources and extensive datasets, limiting accessibility for resource-constrained settings. Our study investigates the potential…

Machine Learning · Computer Science 2026-01-21 Quy-Anh Dang , Chris Ngo

Reinforcement learning (RL) has been widely applied to dynamic routing, modulation and spectrum assignment (RMSA) in optical networks, yet no prior work has trained a transformer model for this task. We attribute this to the high data and…

Networking and Internet Architecture · Computer Science 2026-05-19 Michael Doherty , Alejandra Beghelli , Laura Toni

A new scaling is derived that yields a Reynolds number independent profile for all components of the Reynolds stress in the near-wall region of wall bounded flows, including channel, pipe and boundary layer flows. The scaling demonstrates…

Fluid Dynamics · Physics 2024-02-06 Alexander J. Smits , Marcus Hultmark , Myoungkyu Lee , Sergio Pirozzoli , Xiaohua Wu

This paper focuses on the active flow control of a computational fluid dynamics simulation over a range of Reynolds numbers using deep reinforcement learning (DRL). More precisely, the proximal policy optimization (PPO) method is used to…

Fluid Dynamics · Physics 2020-06-24 Hongwei Tang , Jean Rabault , Alexander Kuhnle , Yan Wang , Tongguang Wang

Designing active-flow-control (AFC) strategies for three-dimensional (3D) bluff bodies is a challenging task with critical industrial implications. In this study we explore the potential of discovering novel control strategies for drag…

Fluid Dynamics · Physics 2025-03-04 P. Suárez , F. Alcántara-Ávila , J. Rabault , A. Miró , B. Font , O. Lehmkuhl , R. Vinuesa

We systematically investigated a reinforcement learning (RL)-based closed-loop active flow control strategy to enhance the lift-to-drag ratio of a wing section with an NLF(1)-0115 airfoil at an angle of attack 5 degree. The effects of key…

Fluid Dynamics · Physics 2025-05-09 Qiong Liu , Luis Javier Trujillo Corona , Fangjun Shu , Andreas Gross

Reinforcement learning (RL) is a general framework for adaptive control, which has proven to be efficient in many domains, e.g., board games, video games or autonomous vehicles. In such problems, an agent faces a sequential decision-making…

Machine Learning · Computer Science 2020-06-16 Olivier Buffet , Olivier Pietquin , Paul Weng

Reinforcement learning (RL) has shown impressive results in sequential decision-making tasks. Meanwhile, Large Language Models (LLMs) and Vision-Language Models (VLMs) have emerged, exhibiting impressive capabilities in multimodal…