English
Related papers

Related papers: Learning Agent for a Heat-Pump Thermostat With a S…

200 papers

It is estimated that about 40%-50% of total electricity consumption in commercial buildings can be attributed to Heating, Ventilation, and Air Conditioning (HVAC) systems. Minimizing the energy cost while considering the thermal comfort of…

Machine Learning · Computer Science 2021-10-27 Vinay Hanumaiah , Sahika Genc

Demand response (DR) programs aim to engage distributed small-scale flexible loads, such as thermostatically controllable loads (TCLs), to provide various grid support services. Linearly Solvable Markov Decision Process (LS-MDP), a variant…

Systems and Control · Electrical Eng. & Systems 2020-04-22 Ali Hassan , Deepjyoti Deka , Michael Chertkov , Yury Dvorkin

Utilities have introduced demand charges to encourage customers to reduce their demand peaks, since a high peak may cause very high costs for both the utility and the consumer. We herein study the bill minimization problem for customers…

Optimization and Control · Mathematics 2024-02-13 Lucas Weber , Ana Bušić , Jiamin Zhu

The continuous introduction of renewable electricity and increased consumption through electrification of the transport and heating sector challenges grid stability. This study investigates load shifting through demand side management as a…

Systems and Control · Electrical Eng. & Systems 2023-07-04 Simon Thorsteinsson , Alex Arash Sand Kalaee , Pierre Vogler-Finck , Henrik Lund Stærmose , Ivan Katic , Jan Dimon Bendtsen

Analyzing data centers with thermal-aware optimization techniques is a viable approach to reduce energy consumption of data centers. By taking into account thermal consequences of job placements among the servers of a data center, it is…

Systems and Control · Computer Science 2016-11-03 Tobias Van Damme , Claudio De Persis , Pietro Tesi

Heat pumps (HPs) have emerged as a cost-effective and clean technology for sustainable energy systems, but their efficiency in producing hot water remains restricted by conventional threshold-based control methods. Although machine learning…

Machine Learning · Computer Science 2025-06-23 Manal Rahal , Bestoun S. Ahmed , Roger Renstrom , Robert Stener , Albrecht Wurtz

The context of the present paper is stochastic thermodynamics - an approach to nonequilibrium thermodynamics rooted within the broader framework of stochastic control. In contrast to the classical paradigm of Carnot engines, we herein…

Systems and Control · Electrical Eng. & Systems 2021-01-08 Rui Fu , Olga Movilla Miangolarra , Amirhossein Taghvaei , Yongxin Chen , Tryphon T. Georgiou

Thermostatically controlled loads and electric vehicles offer flexibility to reduce power peaks in low-voltage distribution networks. This flexibility can be maximized if the devices are coordinated centrally, given some level of…

Systems and Control · Electrical Eng. & Systems 2026-02-10 Katharina Kaiser , Gustavo Valverde , Gabriela Hug

Advancements in combustion technologies are often impeded by complex combustion dynamics. Active control has proven effective at mitigating these dynamics in the lab, but mass adoption requires more affordable, lightweight, and reliable…

Fluid Dynamics · Physics 2023-09-04 Dustin L. Cruise , Aman Satija , Galen B. King

Absorption heat pumping devices (AHPDs, comprising absorption heat pumps and chillers) are devices that use thermal energy instead of electricity to generate heating and cooling, thereby facilitating the use of waste heat and renewable…

Systems and Control · Electrical Eng. & Systems 2023-03-28 Sandra Staudt , Viktor Unterberger , Markus Gölles , Michael Wernhart , René Rieberer , Martin Horn

When developing reinforcement learning agents, the standard approach is to train an agent to converge to a fixed policy that is as close to optimal as possible for a single fixed reward function. If different agent behaviour is required in…

Multiagent Systems · Computer Science 2021-01-29 David O'Callaghan , Patrick Mannion

To perform a precise auscultation for the purposes of examination of respiratory system normally requires the presence of an experienced doctor. With most recent advances in machine learning and artificial intelligence, automatic detection…

We design a simple reinforcement learning (RL) agent that implements an optimistic version of $Q$-learning and establish through regret analysis that this agent can operate with some level of competence in any environment. While we leverage…

Machine Learning · Computer Science 2021-07-13 Shi Dong , Benjamin Van Roy , Zhengyuan Zhou

Interactive reinforcement learning has allowed speeding up the learning process in autonomous agents by including a human trainer providing extra information to the agent in real-time. Current interactive reinforcement learning research has…

Artificial Intelligence · Computer Science 2021-09-06 Adam Bignold , Francisco Cruz , Richard Dazeley , Peter Vamplew , Cameron Foale

In this paper we propose to solve an important problem in recommendation -- user cold start, based on meta leaning method. Previous meta learning approaches finetune all parameters for each new user, which is both computing and storage…

Information Retrieval · Computer Science 2019-12-10 Liang Zhao , Yang Wang , Daxiang Dong , Hao Tian

This paper develops a data-driven inverse reinforcement learning technique for a class of linear systems to estimate the cost function of an agent online, using input-output measurements. A simultaneous state and parameter estimator is…

Systems and Control · Computer Science 2021-07-07 Rushikesh Kamalapurkar

Recent developments in sequential experimental design look to construct a policy that can efficiently navigate the design space, in a way that maximises the expected information gain. Whilst there is work on achieving tractable policies for…

Machine Learning · Computer Science 2025-08-20 Yasir Zubayr Barlas , Kizito Salako

Real-world reinforcement learning applications are often hindered by delayed feedback from environments, which violates the Markov assumption and introduces significant challenges. Although numerous delay-compensating methods have been…

Machine Learning · Computer Science 2026-02-03 Jongsoo Lee , Jangwon Kim , Jiseok Jeong , Soohee Han

Dynamic Data selection aims to accelerate training by prioritizing informative samples during online training. However, existing methods typically rely on task-specific handcrafted metrics or static/snapshot-based criteria to estimate…

Machine Learning · Computer Science 2026-05-14 Suorong Yang , Fangjian Su , Hai Gan , Ziqi Ye , Jie Li , Baile Xu , Furao Shen , Soujanya Poria

An autonomous adaptive MPC architecture is presented for control of heating, ventilation and air condition (HVAC) systems to maintain indoor temperature while reducing energy use. Although equipment use and occupant changes with time,…

Systems and Control · Electrical Eng. & Systems 2021-02-09 Tingting Zeng , Prabir Barooah