English
Related papers

Related papers: Reinforcement Learning Increases Wind Farm Power P…

200 papers

We introduce a reinforcement learning (RL) environment to design and benchmark control strategies aimed at reducing drag in turbulent fluid flows enclosed in a channel. The environment provides a framework for computationally-efficient,…

Fluid Dynamics · Physics 2023-02-09 L. Guastoni , J. Rabault , P. Schlatter , H. Azizpour , R. Vinuesa

To provide automatic generation control (AGC) service, wind farms (WFs) are required to control their operation dynamically to track the time-varying power reference. Wake effects impose significant aerodynamic interactions among turbines,…

Optimization and Control · Mathematics 2021-08-25 Kaixuan Chen , Jin Lin , Yiwei Qiu , Feng Liu , Yonghua Song

The industrial multi-generator Wave Energy Converters (WEC) must handle multiple simultaneous waves coming from different directions called spread waves. These complex devices in challenging circumstances need controllers with multiple…

Wind farm flow control aims to improve wind turbine performance by reducing aerodynamic wake interaction between turbines. Dynamic, physics-based models of wind farm flows have been essential for exploring control strategies such as wake…

Systems and Control · Electrical Eng. & Systems 2022-11-15 Maarten J. van den Broek , Delphine De Tavernier , Benjamin Sanderse , Jan-Willem van Wingerden

The electric grid is undergoing a major transition from fossil fuel-based power generation to renewable energy sources, typically interfaced to the grid via power electronics. The future power systems are thus expected to face increased…

Systems and Control · Electrical Eng. & Systems 2020-07-13 Ognjen Stanojev , Ognjen Kundacina , Uros Markovic , Evangelos Vrettos , Petros Aristidou , Gabriela Hug

Reinforcement learning (RL)-based driver assistance systems seek to improve fuel consumption via continual improvement of powertrain control actions considering experiential data from the field. However, the need to explore diverse…

Robotics · Computer Science 2023-01-04 Habtamu Hailemichael , Beshah Ayalew , Lindsey Kerbel , Andrej Ivanco , Keith Loiselle

Dynamic induction control is a wind farm flow control strategy that utilises wind turbine thrust variations to accelerate breakdown of the aerodynamic wake and improve downstream turbine performance. However, when floating wind turbines are…

Optimization and Control · Mathematics 2023-03-28 Maarten J. van den Broek , Daniel van den Berg , Benjamin Sanderse , Jan-Willem van Wingerden

This paper demonstrates that continual relearning of control policies using incremental deep reinforcement learning (RL) can improve policy learning for non-stationary processes. We demonstrate this approach for a data-driven 'smart…

Machine Learning · Computer Science 2020-08-06 Avisek Naug , Marcos Quiñones-Grueiro , Gautam Biswas

Reinforcement learning (RL)-based methods have achieved significant success in managing grid-interactive efficient buildings (GEBs). However, RL does not carry intrinsic guarantees of constraint satisfaction, which may lead to severe safety…

Systems and Control · Electrical Eng. & Systems 2024-09-13 Xiang Huo , Boming Liu , Jin Dong , Jianming Lian , Mingxi Liu

We aim to better understand the tradeoffs between traditional and reinforcement learning (RL) approaches for energy storage management. More specifically, we wish to better understand the performance loss incurred when using a generative RL…

Machine Learning · Computer Science 2025-06-03 Elinor Ginzburg , Itay Segev , Yoash Levron , Sarah Keren

Reinforcement learning is employed to optimize the periodic forcing signal of a pulsed blowing system that controls flow separation in a fully-turbulent $Re_\theta = 1000$ diffuser flow. Based on the state of the wind tunnel experiment that…

Fluid Dynamics · Physics 2024-12-11 Alexandra Müller , Tobias Schesny , Ben Steinfurth , Julien Weiss

Improving the power output from wind farms is vital in transitioning to renewable electricity generation. However, in wind farms, wind turbines often operate in the wake of other turbines, leading to a reduction in the wind speed and the…

Fluid Dynamics · Physics 2024-07-31 Andrew Mole , Sylvain Laizet

Reinforcement learning (RL) is a promising approach for optimizing HVAC control. RL offers a framework for improving system performance, reducing energy consumption, and enhancing cost efficiency. We benchmark two popular classical and deep…

Machine Learning · Computer Science 2023-08-11 Marshall Wang , John Willes , Thomas Jiralerspong , Matin Moezzi

The paradigm shift in the electric power grid necessitates a revisit of existing control methods to ensure the grid's security and resilience. In particular, the increased uncertainties and rapidly changing operational conditions in power…

Systems and Control · Electrical Eng. & Systems 2020-11-20 Thanh Long Vu , Sayak Mukherjee , Tim Yin , Renke Huang , and Jie Tan , Qiuhua Huang

This paper presents a safe learning-based eco-driving framework tailored for mixed traffic flows, which aims to optimize energy efficiency while guaranteeing safety during real-system operations. Even though reinforcement learning (RL) is…

Systems and Control · Electrical Eng. & Systems 2024-02-01 Ke Lu , Dongjun Li , Qun Wang , Kaidi Yang , Lin Zhao , Ziyou Song

The state-of-the-art in wind-farm flow-physics modeling is Large Eddy Simulation (LES) which makes accurate predictions of most relevant physics, but requires extensive computational resources. The next-fidelity model types are…

Fluid Dynamics · Physics 2021-01-19 Julia Steiner , Richard P. Dwight , Axelle Viré

District cooling energy plants (DCEPs) consisting of chillers, cooling towers, and thermal energy storage (TES) systems consume a considerable amount of electricity. Optimizing the scheduling of the TES and chillers to take advantage of…

Systems and Control · Electrical Eng. & Systems 2022-03-16 Zhong Guo , Austin R. Coffman , Prabir Barooah

Due to the high efficiency and less weather dependency, autonomous greenhouses provide an ideal solution to meet the increasing demand for fresh food. However, managers are faced with some challenges in finding appropriate control…

Artificial Intelligence · Computer Science 2021-10-20 Wanpeng Zhang , Xiaoyan Cao , Yao Yao , Zhicheng An , Xi Xiao , Dijun Luo

Variable renewable generation increases the challenge of balancing power supply and demand. Grid-scale batteries co-located with generation can help mitigate this misalignment. This paper explores the use of reinforcement learning (RL) for…

Machine Learning · Computer Science 2024-11-26 Caleb Ju , Constance Crozier

This paper presents a model-based reinforcement learning (RL) framework for optimal closed-loop control of nonlinear robotic systems. The proposed approach learns linear lifted dynamics through Koopman operator theory and integrates the…

Robotics · Computer Science 2026-04-23 Wenjian Hao , Yuxuan Fang , Zehui Lu , Shaoshuai Mou