English
Related papers

Related papers: Continual Reinforcement Learning for HVAC Systems …

200 papers

Real-time applications of energy management strategies (EMSs) in hybrid electric vehicles (HEVs) are the harshest requirements for researchers and engineers. Inspired by the excellent problem-solving capabilities of deep reinforcement…

Signal Processing · Electrical Eng. & Systems 2022-12-14 Hao Chen , Gang Guo , Bangbei Tang , Guo Hu , Xiaolin Tang , Teng Liu

Heating in private households is a major contributor to the emissions generated today. Heat pumps are a promising alternative for heat generation and are a key technology in achieving our goals of the German energy transformation and to…

Machine Learning · Computer Science 2022-12-27 Tobias Rohrer , Lilli Frison , Lukas Kaupenjohann , Katrin Scharf , Elke Hergenrother

Today, human operators primarily perform voltage control of the electric transmission system. As the complexity of the grid increases, so does its operation, suggesting additional automation could be beneficial. A subset of machine learning…

Machine Learning · Computer Science 2020-10-19 Brandon L. Thayer , Thomas J. Overbye

Meta-Reinforcement Learning addresses the critical limitations of conventional Reinforcement Learning in multi-task and non-stationary environments by enabling fast policy adaptation and improved generalization. We introduce a novel Meta-RL…

Machine Learning · Computer Science 2026-03-10 Théo Zangato , Aomar Osmani , Pegah Alizadeh

The electric grid is undergoing a major transition from fossil fuel-based power generation to renewable energy sources, typically interfaced to the grid via power electronics. The future power systems are thus expected to face increased…

Systems and Control · Electrical Eng. & Systems 2020-07-13 Ognjen Stanojev , Ognjen Kundacina , Uros Markovic , Evangelos Vrettos , Petros Aristidou , Gabriela Hug

This research study explores the applicability of Deep Reinforcement Learning (DRL) for thermal control based on Computational Fluid Dynamics. To accomplish that, the forced convection on a hot plate prone to a pulsating cooling jet with…

Numerical Analysis · Mathematics 2024-02-19 Sajad Salavatidezfouli , Giovanni Stabile , Gianluigi Rozza

Deep reinforcement learning (DRL) holds significant promise for managing voltage control challenges in simulated power grid environments. However, its real-world application in power system operations remains underexplored. This study…

Systems and Control · Electrical Eng. & Systems 2024-10-29 Di Shi , Qiang Zhang , Mingguo Hong , Fengyu Wang , Slava Maslennikov , Xiaochuan Luo , Yize Chen

Deep Reinforcement Learning (DRL) emerges as a prime solution for Unmanned Aerial Vehicle (UAV) trajectory planning, offering proficiency in navigating high-dimensional spaces, adaptability to dynamic environments, and making sequential…

Signal Processing · Electrical Eng. & Systems 2024-05-17 Chenrui Sun , Gianluca Fontanesi , Swarna Bindu Chetty , Xuanyu Liang , Berk Canberk , Hamed Ahmadi

Next Generation (NextG) networks are expected to support demanding tactile internet applications such as augmented reality and connected autonomous vehicles. Whereas recent innovations bring the promise of larger link capacity, their…

Machine Learning · Computer Science 2021-12-08 Peyman Tehrani , Francesco Restuccia , Marco Levorato

Learning physical dynamics in a series of non-stationary environments is a challenging but essential task for model-based reinforcement learning (MBRL) with visual inputs. It requires the agent to consistently adapt to novel tasks without…

Machine Learning · Computer Science 2025-07-08 Minting Pan , Wendong Zhang , Geng Chen , Xiangming Zhu , Siyu Gao , Yunbo Wang , Xiaokang Yang

Robust control of mechanical systems with multiple uncertainties remains a fundamental challenge, particularly when nonlinear dynamics and operating-condition variations are intricately intertwined. Although deep reinforcement learning…

Machine Learning · Computer Science 2026-03-11 Heisei Yonezawa , Ansei Yonezawa , Itsuro Kajiwara

Continual learning (CL) has been a critical topic in contemporary deep neural network applications, where higher levels of both forward and backward transfer are desirable for an effective CL performance. Existing CL strategies primarily…

Machine Learning · Computer Science 2026-01-15 Yanru Wu , Jianning Wang , Xiangyu Chen , Enming Zhang , Yang Tan , Hanbing Liu , Yang Li

Smart grids are designed to efficiently handle variable power demands, especially for large loads, by real-time monitoring, distributed generation and distribution of electricity. However, the grid's distributed nature and the internet…

Systems and Control · Electrical Eng. & Systems 2024-11-26 Anjana B. , Suman Maiti , Sunandan Adhikary , Soumyajit Dey , Ashish R. Hota

Data processing and analytics are fundamental and pervasive. Algorithms play a vital role in data processing and analytics where many algorithm designs have incorporated heuristics and general rules from human knowledge and experience to…

Machine Learning · Computer Science 2022-02-07 Qingpeng Cai , Can Cui , Yiyuan Xiong , Wei Wang , Zhongle Xie , Meihui Zhang

We propose a new class of deep reinforcement learning (RL) algorithms that model latent representations in hyperbolic space. Sequential decision-making requires reasoning about the possible future consequences of current behavior.…

Machine Learning · Computer Science 2022-10-05 Edoardo Cetin , Benjamin Chamberlain , Michael Bronstein , Jonathan J Hunt

We approach the task of network congestion control in datacenters using Reinforcement Learning (RL). Successful congestion control algorithms can dramatically improve latency and overall network throughput. Until today, no such…

The intrinsic high dimension of fluid dynamics is an inherent challenge to control of aerodynamic flows, and this is further complicated by a flow's nonlinear response to strong disturbances. Deep reinforcement learning, which takes…

Fluid Dynamics · Physics 2025-07-28 Zhecheng Liu , Diederik Beckers , Jeff D. Eldredge

Demand response (DR) programs aim to engage distributed small-scale flexible loads, such as thermostatically controllable loads (TCLs), to provide various grid support services. Linearly Solvable Markov Decision Process (LS-MDP), a variant…

Systems and Control · Electrical Eng. & Systems 2020-04-22 Ali Hassan , Deepjyoti Deka , Michael Chertkov , Yury Dvorkin

The recent breakthroughs of deep reinforcement learning (DRL) technique in Alpha Go and playing Atari have set a good example in handling large state and actions spaces of complicated control problems. The DRL technique is comprised of (i)…

Artificial Intelligence · Computer Science 2017-10-12 Hongjia Li , Tianshu Wei , Ao Ren , Qi Zhu , Yanzhi Wang

In the context of Industry 4.0 and smart manufacturing, the field of process industry optimization and control is also undergoing a digital transformation. With the rise of Deep Reinforcement Learning (DRL), its application in process…

Systems and Control · Electrical Eng. & Systems 2025-04-23 Runze Lin , Junghui Chen , Lei Xie , Hongye Su