English
Related papers

Related papers: Deep Reinforcement Learning for Active Flow Contro…

200 papers

Although deep reinforcement learning (DRL) algorithms have made important achievements in many control tasks, they still suffer from the problems of sample inefficiency and unstable training process, which are usually caused by sparse…

Robotics · Computer Science 2020-02-28 Ke Lin , Liang Gong , Xudong Li , Te Sun , Binhao Chen , Chengliang Liu , Zhengfeng Zhang , Jian Pu , Junping Zhang

Fluid antenna systems (FAS) enable dynamic antenna positioning, offering new opportunities to enhance integrated sensing and communication (ISAC) performance. However, existing studies primarily focus on communication enhancement or…

Signal Processing · Electrical Eng. & Systems 2025-01-03 Shunxing Yang , Junteng Yao , Jie Tang , Tuo Wu , Maged Elkashlan , Chau Yuen , Merouane Debbah , Hyundong Shin , Matthew Valenti

This paper presents a novel deep reinforcement learning (DRL)-based control strategy for achieving precise and robust output voltage regulation in LCC-S resonant converters, specifically designed for wireless power transfer applications.…

Systems and Control · Electrical Eng. & Systems 2025-05-06 Reza Safari , Mohsen Hamzeh , Nima Mahdian Dehkordi

Accurate control of autonomous marine robots still poses challenges due to the complex dynamics of the environment. In this paper, we propose a Deep Reinforcement Learning (DRL) approach to train a controller for autonomous surface vessel…

Dynamic Reinforcement Learning (Dynamic RL), proposed in this paper, directly controls system dynamics, instead of the actor (action-generating neural network) outputs at each moment, bringing about a major qualitative shift in…

Machine Learning · Computer Science 2025-02-17 Katsunari Shibata

We consider a typical heterogeneous network (HetNet), in which multiple access points (APs) are deployed to serve users by reusing the same spectrum band. Since different APs and users may cause severe interference to each other, advanced…

Information Theory · Computer Science 2020-08-11 Lin Zhang , Ying-Chang Liang

Deep reinforcement learning (DRL) has recently been used to perform efficient resource allocation in wireless communications. In this paper, the vulnerabilities of such DRL agents to adversarial attacks is studied. In particular, we…

Machine Learning · Computer Science 2021-05-13 Feng Wang , M. Cenk Gursoy , Senem Velipasalar

In this paper, a deep reinforcement learning (DRL) method is proposed to address the problem of UAV navigation in an unknown environment. However, DRL algorithms are limited by the data efficiency problem as they typically require a huge…

Robotics · Computer Science 2020-08-07 Lei He , Nabil Aouf , James F. Whidborne , Bifeng Song

Transmission interface power flow adjustment is a critical measure to ensure the security and economy operation of power systems. However, conventional model-based adjustment schemes are limited by the increasing variations and…

Systems and Control · Electrical Eng. & Systems 2024-05-28 Shunyu Liu , Wei Luo , Yanzhen Zhou , Kaixuan Chen , Quan Zhang , Huating Xu , Qinglai Guo , Mingli Song

Reinforcement learning has gained traction for active flow control tasks, with initial applications exploring drag mitigation via flow field augmentation around a two-dimensional cylinder. RL has since been extended to more complex…

Machine Learning · Computer Science 2025-04-01 Marius Kurz , Rohan Kaushik , Marcel Blind , Patrick Kopper , Anna Schwarz , Felix Rodach , Andrea Beck

Deep reinforcement learning (DRL) holds significant promise for managing voltage control challenges in simulated power grid environments. However, its real-world application in power system operations remains underexplored. This study…

Systems and Control · Electrical Eng. & Systems 2024-10-29 Di Shi , Qiang Zhang , Mingguo Hong , Fengyu Wang , Slava Maslennikov , Xiaochuan Luo , Yize Chen

Reinforcement learning (RL) is highly suitable for devising control strategies in the context of dynamical systems. A prominent instance of such a dynamical system is the system of equations governing fluid dynamics. Recent research results…

Machine Learning · Computer Science 2022-11-21 Marius Kurz , Philipp Offenhäuser , Dominic Viola , Oleksandr Shcherbakov , Michael Resch , Andrea Beck

Automatic Curriculum Learning (ACL) has become a cornerstone of recent successes in Deep Reinforcement Learning (DRL).These methods shape the learning trajectories of agents by challenging them with tasks adapted to their capacities. In…

Machine Learning · Computer Science 2020-06-01 Rémy Portelas , Cédric Colas , Lilian Weng , Katja Hofmann , Pierre-Yves Oudeyer

We present a deep learning-based reduced order model (DL-ROM) for predicting the fluid forces and unsteady vortex patterns. We consider flow past a sphere to examine the accuracy of our DL-ROM predictions. The proposed methodology relies on…

Fluid Dynamics · Physics 2022-04-06 Rachit Gupta , Rajeev Jaiman

A residual deep reinforcement learning (RDRL) approach is proposed by integrating DRL with model-based optimization for inverter-based volt-var control in active distribution networks when the accurate power flow model is unknown. RDRL…

Systems and Control · Electrical Eng. & Systems 2024-08-14 Qiong Liu , Ye Guo , Lirong Deng , Haotian Liu , Dongyu Li , Hongbin Sun

This paper presents a model-free deep reinforcement learning (DRL) approach for controlling a fiber drawing system. The custom DRL-based control system predictively regulates fiber diameter and produces a fiber with a desired, constant or…

Systems and Control · Electrical Eng. & Systems 2021-01-07 Sangwoon Kim , David Donghyun Kim , Brian Anthony

As power systems are undergoing a significant transformation with more uncertainties, less inertia and closer to operation limits, there is increasing risk of large outages. Thus, there is an imperative need to enhance grid emergency…

Machine Learning · Computer Science 2022-02-08 Renke Huang , Yujiao Chen , Tianzhixi Yin , Qiuhua Huang , Jie Tan , Wenhao Yu , Xinya Li , Ang Li , Yan Du

We propose an open-source python platform for applications of Deep Reinforcement Learning (DRL) in fluid mechanics. DRL has been widely used in optimizing decision-making in nonlinear and high-dimensional problems. Here, an agent maximizes…

Fluid Dynamics · Physics 2024-06-19 Qiulei Wang , Lei Yan , Gang Hu , Chao Li , Yiqing Xiao , Hao Xiong , Jean Rabault , Bernd R. Noack

Today, human operators primarily perform voltage control of the electric transmission system. As the complexity of the grid increases, so does its operation, suggesting additional automation could be beneficial. A subset of machine learning…

Machine Learning · Computer Science 2020-10-19 Brandon L. Thayer , Thomas J. Overbye

Traditional economic models often rely on fixed assumptions about market dynamics, limiting their ability to capture the complexities and stochastic nature of real-world scenarios. However, reality is more complex and includes noise, making…