English
Related papers

Related papers: Hypersonic Flow Control: Generalized Deep Reinforc…

200 papers

In the last decade, data-driven approaches have become popular choices for quadrotor control, thanks to their ability to facilitate the adaptation to unknown or uncertain flight conditions. Among the different data-driven paradigms, Deep…

Robotics · Computer Science 2024-12-30 Alberto Dionigi , Gabriele Costante , Giuseppe Loianno

When learning behavior, training data is often generated by the learner itself; this can result in unstable training dynamics, and this problem has particularly important applications in safety-sensitive real-world control tasks such as…

Machine Learning · Computer Science 2019-10-10 Vibhavari Dasagi , Jake Bruce , Thierry Peynot , Jürgen Leitner

This paper focuses on the active flow control (AFC) of the flow over a circular cylinder with synthetic jets through deep reinforcement learning (DRL) by implementing a reward function based on dynamic mode decomposition (DMD). As a main…

Fluid Dynamics · Physics 2021-08-10 Sheng Qin , Shuyue Wang , Jean Rabault , Gang Sun

This paper presents a novel hierarchical deep reinforcement learning (DRL) based design for the voltage control of power grids. DRL agents are trained for fast, and adaptive selection of control actions such that the voltage recovery…

Systems and Control · Electrical Eng. & Systems 2021-02-02 Sayak Mukherjee , Renke Huang , Qiuhua Huang , Thanh Long Vu , Tianzhixi Yin

The control of complex systems is of critical importance in many branches of science, engineering, and industry. Controlling an unsteady fluid flow is particularly important, as flow control is a key enabler for technologies in energy…

Machine Learning · Computer Science 2020-12-18 Katharina Bieker , Sebastian Peitz , Steven L. Brunton , J. Nathan Kutz , Michael Dellnitz

Docking control of an autonomous underwater vehicle (AUV) is a task that is integral to achieving persistent long term autonomy. This work explores the application of state-of-the-art model-free deep reinforcement learning (DRL) approaches…

Robotics · Computer Science 2021-08-06 Mihir Patil , Bilal Wehbe , Matias Valdenegro-Toro

Accurate control of autonomous marine robots still poses challenges due to the complex dynamics of the environment. In this paper, we propose a Deep Reinforcement Learning (DRL) approach to train a controller for autonomous surface vessel…

In response to the trade-off between control performance and computational burden hindering the deployment of Deep Reinforcement Learning (DRL) in power inverters, this paper presents a novel model-free control framework leveraging policy…

Systems and Control · Electrical Eng. & Systems 2026-03-10 Yang Yang , Chenggang Cui , Xitong Niu , Jiaming Liu , Chuanlin Zhang

Effective traffic control methods have great potential in alleviating network congestion. Existing literature generally focuses on a single control approach, while few studies have explored the effectiveness of integrated and coordinated…

Machine Learning · Computer Science 2023-03-08 Zijian Hu , Wei Ma

Effectively controlling systems governed by Partial Differential Equations (PDEs) is crucial in several fields of Applied Sciences and Engineering. These systems usually yield significant challenges to conventional control schemes due to…

Machine Learning · Computer Science 2024-11-07 Florian Wolf , Nicolò Botteghi , Urban Fasel , Andrea Manzoni

The fast and accurate prediction of unsteady flow becomes a serious challenge in fluid dynamics, due to the high-dimensional and nonlinear characteristics. A novel hybrid deep neural network (DNN) architecture was designed to capture the…

Fluid Dynamics · Physics 2020-01-08 Renkun Han , Yixing Wang , Yang Zhang , Gang Chen

Active flow control remains a significant challenge due to the high-dimensional, nonlinear nature of fluid dynamics. Quantum machine learning may prove effective in addressing these issues, given that quantum computing possesses superiority…

Fluid Dynamics · Physics 2026-01-27 Hongfu Zhang , Hui Tang

Deep reinforcement learning (DRL) has found application in numerous use-cases pertaining to flow control. Multi-agent RL (MARL), a variant of DRL, has shown to be more effective than single-agent RL in controlling flows exhibiting locality…

Robotic systems driven by artificial muscles present unique challenges due to the nonlinear dynamics of actuators and the complex designs of mechanical structures. Traditional model-based controllers often struggle to achieve desired…

Robotics · Computer Science 2025-08-12 Jiyue Tao , Yunsong Zhang , Sunil Kumar Rajendran , Feitian Zhang

Reinforcement learning (RL) in few-shot scenarios with limited sensor data is challenging due to insufficient training samples, particularly in applications like Dynamic Voltage and Frequency Scaling (DVFS) where sensor readings are…

Machine Learning · Computer Science 2026-01-13 Mohammad Pivezhandi , Abusayeed Saifullah

We develop neural-network active flow controllers using a deep learning PDE augmentation method (DPM). The sensitivities for optimization are computed using adjoints of the governing equations without restriction on the terms that may…

Fluid Dynamics · Physics 2023-07-20 Xuemin Liu , Jonathan F. MacArt

In recent years, deep reinforcement learning has emerged as a technique to solve closed-loop flow control problems. Employing simulation-based environments in reinforcement learning enables a priori end-to-end optimization of the control…

Fluid Dynamics · Physics 2024-04-11 Andre Weiner , Janis Geise

Load shedding has been one of the most widely used and effective emergency control approaches against voltage instability. With increased uncertainties and rapidly changing operational conditions in power systems, existing methods have…

Systems and Control · Electrical Eng. & Systems 2020-12-08 Renke Huang , Yujiao Chen , Tianzhixi Yin , Xinya Li , Ang Li , Jie Tan , Wenhao Yu , Yuan Liu , Qiuhua Huang

Deep Reinforcement Learning (DRL) has been applied successfully to many robotic applications. However, the large number of trials needed for training is a key issue. Most of existing techniques developed to improve training efficiency (e.g.…

Robotics · Computer Science 2018-12-13 Linhai Xie , Sen Wang , Stefano Rosa , Andrew Markham , Niki Trigoni

This paper focuses on the continuous control of the unmanned aerial vehicle (UAV) based on a deep reinforcement learning method for a large-scale 3D complex environment. The purpose is to make the UAV reach any target point from a certain…

Robotics · Computer Science 2023-04-13 Xuyang Li , Jianwu Fang , Kai Du , Kuizhi Mei , Jianru Xue