English
Related papers

Related papers: Direct Load Control of Thermostatically Controlled…

200 papers

We investigate sparse representations for control in reinforcement learning. While these representations are widely used in computer vision, their prevalence in reinforcement learning is limited to sparse coding where extracting…

Machine Learning · Computer Science 2018-11-19 Vincent Liu , Raksha Kumaraswamy , Lei Le , Martha White

Energy consumption for hot water production is a major draw in high efficiency buildings. Optimizing this has typically been approached from a thermodynamics perspective, decoupled from occupant influence. Furthermore, optimization usually…

Systems and Control · Computer Science 2018-01-08 Hussain Kazmi , Fahad Mehmood , Stefan Lodeweyckx , Johan Driesen

Despite rapid advancements in sensor networks, conventional battery-powered sensor networks suffer from limited operational lifespans and frequent maintenance requirements that severely constrain their deployment in remote and inaccessible…

Networking and Internet Architecture · Computer Science 2025-10-27 Bowei Tong , Hui Kang , Jiahui Li , Geng Sun , Jiacheng Wang , Yaoqi Yang , Bo Xu , Dusit Niyato

Unpredictability of renewable energy sources coupled with the complexity of those methods used for various purposes in this area calls for the development of robust methods such as DL models within the renewable energy domain. Given the…

Machine Learning · Computer Science 2025-05-07 Lutfu Sua , Haibo Wang , Jun Huang

Appliance-level load forecasting plays a critical role in residential energy management, besides having significant importance for ancillary services performed by the utilities. In this paper, we propose to use an LSTM-based…

Signal Processing · Electrical Eng. & Systems 2021-06-30 Mina Razghandi , Hao Zhou , Melike Erol-Kantarci , Damla Turgut

This article proposes a model-based deep reinforcement learning (DRL) method to design emergency control strategies for short-term voltage stability problems in power systems. Recent advances show promising results in model-free DRL-based…

Systems and Control · Electrical Eng. & Systems 2022-12-07 Ramij R. Hossain , Tianzhixi Yin , Yan Du , Renke Huang , Jie Tan , Wenhao Yu , Yuan Liu , Qiuhua Huang

Real-world problems often involve complex and unstructured sets of measurements, which occur when sensors are sparsely placed in either space or time. Being able to model this irregular spatiotemporal data and extract meaningful forecasts…

Machine Learning · Computer Science 2024-04-17 Arnaud Pannatier , Kyle Matoba , François Fleuret

A properly designed controller can help improve the quality of experimental measurements or force a dynamical system to follow a completely new time-evolution path. Recent developments in deep reinforcement learning have made steep advances…

Statistical Mechanics · Physics 2025-02-26 Ruslan Mukhamadiarov

This paper investigates different methods and various neural network architectures applicable in the time series classification domain. The data is obtained from a fleet of gas sensors that measure and track quantities such as oxygen and…

Machine Learning · Computer Science 2023-07-06 Mohamed Abouelnaga , Julien Vitay , Aida Farahani

This research gauges the ability of deep reinforcement learning (DRL) techniques to assist the control of conjugate heat transfer systems governed by the coupled Navier--Stokes and heat equations. It uses a novel, "degenerate" version of…

Fluid Dynamics · Physics 2021-03-25 Elie Hachem , Hassan Ghraieb , Jonathan Viquerat , Aurélien Larcher , Philippe Meliga

Electricity is a volatile power source that requires great planning and resource management for both short and long term. More specifically, in the short-term, accurate instant energy consumption forecasting contributes greatly to improve…

Artificial Intelligence · Computer Science 2022-07-05 Nuno Oliveira , Norberto Sousa , Isabel Praça

The research addresses sensor task management for radar systems, focusing on efficiently searching and tracking multiple targets using reinforcement learning. The approach develops a 3D simulation environment with an active electronically…

Machine Learning · Computer Science 2025-02-20 Jan-Hendrik Ewers , David Cormack , Joe Gibbs , David Anderson

Modeling multivariate time series as temporal signals over a (possibly dynamic) graph is an effective representational framework that allows for developing models for time series analysis. In fact, discrete sequences of graphs can be…

Machine Learning · Computer Science 2022-10-11 Ivan Marisca , Andrea Cini , Cesare Alippi

The availability of reliable, high-resolution climate and weather data is important to inform long-term decisions on climate adaptation and mitigation and to guide rapid responses to extreme events. Forecasting models are limited by…

Dynamical systems describe how a physical system evolves over time. Physical processes can evolve faster or slower in different environmental conditions. We use time-warping as rescaling the time in a model of a physical system. This thesis…

Machine Learning · Computer Science 2026-05-12 Jonathon Hirschi

Intensity control is a class of continuous-time dynamic optimization problems with many important applications in Operations Research including queueing and revenue management. In this study, we propose a practical continuous-time…

Machine Learning · Computer Science 2026-04-14 Huiling Meng , Ningyuan Chen , Xuefeng Gao

Thermostatically controlled loads such as refrigerators are exceptionally suitable as a flexible demand resource. This paper derives a decentralised load control algorithm for refrigerators. It is adapted from an existing continuous time…

Systems and Control · Computer Science 2019-08-09 Simon Tindemans , Goran Strbac

Many consequential real-world systems, like wind fields and ocean currents, are dynamic and hard to model. Learning their governing dynamics remains a central challenge in scientific machine learning. Dynamic Mode Decomposition (DMD)…

Machine Learning · Computer Science 2025-11-26 Yujin Kim , Sarah Dean

This paper proposes a deep learning approach to a class of active sensing problems in wireless communications in which an agent sequentially interacts with an environment over a predetermined number of time frames to gather information in…

Information Theory · Computer Science 2022-02-10 Foad Sohrabi , Tao Jiang , Wei Cui , Wei Yu

Reinforcement learning (RL) algorithms allow artificial agents to improve their selection of actions to increase rewarding experiences in their environments. Temporal Difference (TD) Learning -- a model-free RL method -- is a leading…

Machine Learning · Computer Science 2019-09-05 Jacob Rafati , David C. Noelle