English
Related papers

Related papers: HydroGym: A Reinforcement Learning Platform for Fl…

200 papers

Turbulent-flow control aims to develop strategies that effectively manipulate fluid systems, such as the reduction of drag in transportation and enhancing energy efficiency, both critical steps towards reducing global CO$_2$ emissions. Deep…

Fluid Dynamics · Physics 2026-05-25 Miguel Beneitez , Andres Cremades , Luca Guastoni , Ricardo Vinuesa

Motile microorganisms develop effective swimming gaits to adapt to complex biological environments. Translating this adaptability to smart microrobots presents significant challenges in motion planning and stroke design. In this work, we…

Robotics · Computer Science 2025-06-03 Yuyang Lai , Sina Heydari , On Shun Pak , Yi Man

Neural control is an exciting mystery which we instinctively master. Yet, researchers have a hard time explaining the motor control trajectories. Physiologically accurate biomechanical simulations can, to some extent, mimic live subjects…

Signal Processing · Electrical Eng. & Systems 2019-12-10 Amir H. Abdi , Masoud Malakoutian , Thomas Oxland , Sidney Fels

Deep Reinforcement Learning (DRL) has recently been proposed as a methodology to discover complex Active Flow Control (AFC) strategies [Rabault, J., Kuchta, M., Jensen, A., Reglade, U., & Cerardi, N. (2019): "Artificial neural networks…

Computational Physics · Physics 2019-10-23 Jean Rabault , Alexander Kuhnle

A flow control system is a critical concept for increasing the production capacity of manufacturing systems. To solve the scheduling optimization problem related to the flow control with the aim of improving productivity, existing methods…

Machine Learning · Computer Science 2023-10-13 Hwajong Lee , Chan Kim , Seong-Woo Kim

This work studies the application of a reinforcement-learning-based (RL) flow control strategy to the flow past a cylinder confined between two walls in order to suppress vortex shedding. The control action is blowing and suction of two…

Fluid Dynamics · Physics 2021-12-16 Jichao Li , Mengqi Zhang

Humans manipulate various kinds of fluids in their everyday life: creating latte art, scooping floating objects from water, rolling an ice cream cone, etc. Using robots to augment or replace human labors in these daily settings remain as a…

Robotics · Computer Science 2023-03-07 Zhou Xian , Bo Zhu , Zhenjia Xu , Hsiao-Yu Tung , Antonio Torralba , Katerina Fragkiadaki , Chuang Gan

In recent years, Artificial Neural Networks (ANNs) and Deep Learning have become increasingly popular across a wide range of scientific and technical fields, including Fluid Mechanics. While it will take time to fully grasp the…

Fluid Dynamics · Physics 2020-01-09 Jean Rabault , Feng Ren , Wei Zhang , Hui Tang , Hui Xu

Reinforcement learning (RL) has been successfully applied to a variety of robotics applications, where it outperforms classical methods. However, the safety aspect of RL and the transfer to the real world remain an open challenge. A…

Robotics · Computer Science 2025-04-21 Murad Dawood , Ahmed Shokry , Maren Bennewitz

Reinforcement learning is applied to the development of control strategies in order to reduce skin friction drag in a fully developed turbulent channel flow at a low Reynolds number. Motivated by the so-called opposition control (Choi et…

Fluid Dynamics · Physics 2023-04-26 Takahiro Sonoda , Zhuchen Liu , Toshitaka Itoh , Yosuke Hasegawa

Many Reinforcement Learning (RL) approaches use joint control signals (positions, velocities, torques) as action space for continuous control tasks. We propose to lift the action space to a higher level in the form of subgoals for a motion…

Artificial Intelligence · Computer Science 2021-03-29 Fei Xia , Chengshu Li , Roberto Martín-Martín , Or Litany , Alexander Toshev , Silvio Savarese

With large-scale integration of renewable generation and distributed energy resources, modern power systems are confronted with new operational challenges, such as growing complexity, increasing uncertainty, and aggravating volatility.…

Machine Learning · Computer Science 2022-02-28 Xin Chen , Guannan Qu , Yujie Tang , Steven Low , Na Li

Reinforcement learning (RL) can provide adaptive and scalable controllers essential for power grid decarbonization. However, RL methods struggle with power grids' complex dynamics, long-horizon goals, and hard physical constraints. For…

Reinforcement learning (RL) is a flexible and efficient method for programming micro-robots in complex environments. Here we investigate whether reinforcement learning can provide insights into biological systems when trained to perform…

Biological Physics · Physics 2024-04-03 Samuel Tovey , Christoph Lohrmann , Christian Holm

Developing autonomous LLM agents capable of making a series of intelligent decisions to solve complex, real-world tasks is a fast-evolving frontier. Like human cognitive development, agents are expected to acquire knowledge and skills…

PC-Gym is an open-source tool for developing and evaluating reinforcement learning (RL) algorithms in chemical process control. It features environments that simulate various chemical processes, incorporating nonlinear dynamics,…

Reinforcement Learning (RL) has gained significant momentum in the development of network protocols. However, RL-based protocols are still in their infancy, and substantial research is required to build deployable solutions. Developing a…

Networking and Internet Architecture · Computer Science 2023-10-05 Luca Giacomoni , Basil Benny , George Parisis

Solving real-world complex tasks using reinforcement learning (RL) without high-fidelity simulation environments or large amounts of offline data can be quite challenging. Online RL agents trained in imperfect simulation environments can…

Machine Learning · Computer Science 2025-04-17 Haoyi Niu , Tianying Ji , Bingqi Liu , Haocheng Zhao , Xiangyu Zhu , Jianying Zheng , Pengfei Huang , Guyue Zhou , Jianming Hu , Xianyuan Zhan

Deep reinforcement learning (DRL) is employed to develop control strategies for drag reduction in direct numerical simulations (DNS) of turbulent channel flows at high Reynolds numbers. The DRL agent uses near-wall streamwise velocity…

Fluid Dynamics · Physics 2025-03-19 Zisong Zhou , Mengqi Zhang , Xiaojue Zhu

The large-scale integration of intermittent renewable energy resources introduces increased uncertainty and volatility to the supply side of power systems, thereby complicating system operation and control. Recently, data-driven approaches,…

Systems and Control · Electrical Eng. & Systems 2024-07-02 Peipei Yu , Zhenyi Wang , Hongcai Zhang , Yonghua Song