English
Related papers

Related papers: A Unified Python Framework for Direct PPO-based Co…

200 papers

Deep Reinforcement Learning (DRL) is employed to develop autonomously optimized and custom-designed heat-treatment processes that are both, microstructure-sensitive and energy efficient. Different from conventional supervised machine…

Materials Science · Physics 2022-09-26 Jaber R. Mianroodi , Nima H. Siboni , Dierk Raabe

Aerodynamic design optimisation plays a crucial role in improving the performance and efficiency of automotive vehicles. This paper presents a novel approach for aerodynamic optimisation in car design using deep reinforcement learning…

Robotics · Computer Science 2024-05-21 Jignesh Patel , Yannis Spyridis , Vasileios Argyriou

In the coming years, the satellite broadband market will experience significant increases in the service demand, especially for the mobility sector, where demand is burstier. Many of the next generation of satellites will be equipped with…

Signal Processing · Electrical Eng. & Systems 2019-06-04 Juan Jose Garau Luis , Markus Guerster , Inigo del Portillo , Edward Crawley , Bruce Cameron

Most of the current game-theoretic demand-side management methods focus primarily on the scheduling of home appliances, and the related numerical experiments are analyzed under various scenarios to achieve the corresponding Nash-equilibrium…

Computers and Society · Computer Science 2019-02-26 Jun Hao

Aquatic organisms are known for their ability to generate efficient propulsion with low energy expenditure. While existing research has sought to leverage bio-inspired structures to reduce energy costs in underwater robotics, the crucial…

Robotics · Computer Science 2025-06-06 Xinyu Cui , Boai Sun , Yi Zhu , Ning Yang , Haifeng Zhang , Weicheng Cui , Dixia Fan , Jun Wang

Building operations consume approximately 40% of global energy, with Heating, Ventilation, and Air Conditioning (HVAC) systems responsible for up to 50% of this consumption. As HVAC energy demands are expected to rise, optimising system…

Machine Learning · Computer Science 2024-12-02 Anaïs Berkes

Efficient energy management in prosumer households is key to alleviating grid stress in an energy transition marked by electric vehicles (EV), renewable energies and battery storage. However, it is unclear how households optimize prosumer…

Systems and Control · Electrical Eng. & Systems 2025-05-28 Lennart Ullner , Alona Zharova , Felix Creutzig

Reinforcement learning (RL) techniques have been increasingly investigated for dynamic HVAC control in buildings. However, most studies focus on exploring solutions in online or off-policy scenarios without discussing in detail the…

Machine Learning · Computer Science 2024-08-16 Jun Wang , Linyan Li , Qi Liu , Yu Yang

The building thermodynamics model, which predicts real-time indoor temperature changes under potential HVAC (Heating, Ventilation, and Air Conditioning) control operations, is crucial for optimizing HVAC control in buildings. While…

Artificial Intelligence · Computer Science 2025-10-24 Yang Deng , Yaohui Liu , Rui Liang , Dafang Zhao , Donghua Xie , Ittetsu Taniguchi , Dan Wang

The rising demand for electricity and its essential nature in today's world calls for intelligent home energy management (HEM) systems that can reduce energy usage. This involves scheduling of loads from peak hours of the day when energy…

Signal Processing · Electrical Eng. & Systems 2020-12-30 Alwyn Mathew , Abhijit Roy , Jimson Mathew

The recent remarkable progress of deep reinforcement learning (DRL) stands on regularization of policy for stable and efficient learning. A popular method, named proximal policy optimization (PPO), has been introduced for this purpose. PPO…

Machine Learning · Computer Science 2023-07-04 Taisuke Kobayashi

Controlling autonomous vehicles at their handling limits is a significant challenge, particularly for electric vehicles with active four wheel drive (A4WD) systems offering independent wheel torque control. While traditional Vehicle…

Robotics · Computer Science 2025-06-09 Gergely Bari , Laszlo Palkovics

We argue that inventory management presents unique opportunities for the reliable application of deep reinforcement learning (DRL). To enable this, we emphasize and test two complementary techniques. The first is Hindsight Differentiable…

Machine Learning · Computer Science 2025-09-12 Matias Alvo , Daniel Russo , Yash Kanoria , Minuk Lee

In this paper, we address energy management for heating, ventilation, and air-conditioning (HVAC) systems in buildings, and present a novel combined optimization and control approach. We first formulate a thermal dynamics and an associated…

Systems and Control · Computer Science 2017-01-23 Takeshi Hatanaka , Xuan Zhang , Wenbo Shi , Minghui Zhu , Na Li

Buildings sector is one of the major consumers of energy in the United States. The buildings HVAC (Heating, Ventilation, and Air Conditioning) systems, whose functionality is to maintain thermal comfort and indoor air quality (IAQ), account…

Systems and Control · Electrical Eng. & Systems 2021-03-24 Chi Zhang , Sanmukh R. Kuppannagari , Rajgopal Kannan , Viktor K. Prasanna

The recent advances in information technology and artificial intelligence have fueled a rapid expansion of the data center (DC) industry worldwide, accompanied by an immense appetite for electricity to power the DCs. In a typical DC, around…

Artificial Intelligence · Computer Science 2025-02-17 Xianyuan Zhan , Xiangyu Zhu , Peng Cheng , Xiao Hu , Ziteng He , Hanfei Geng , Jichao Leng , Huiwen Zheng , Chenhui Liu , Tianshun Hong , Yan Liang , Yunxin Liu , Feng Zhao

Systems for heating, ventilation and air-conditioning (HVAC) of buildings are traditionally controlled by a rule-based approach. In order to reduce the energy consumption and the environmental impact of HVAC systems more advanced control…

Multiagent Systems · Computer Science 2023-09-14 Daniel Bayer , Marco Pruckner

Optimizing the operation of heating, ventilation, and air-conditioning (HVAC) systems is a challenging task, requiring the modeling of complex nonlinear relationships among HVAC load, indoor temperatures, and outdoor environments. This…

Systems and Control · Electrical Eng. & Systems 2021-01-12 Youngjin Kim

Residual policy learning (RPL), in which a learned policy refines a static base policy using deep reinforcement learning (DRL), has shown strong performance across various robotic applications. Its effectiveness is particularly evident in…

Robotics · Computer Science 2026-03-16 Raphael Trumpp , Denis Hoornaert , Mirco Theile , Marco Caccamo

Heating in private households is a major contributor to the emissions generated today. Heat pumps are a promising alternative for heat generation and are a key technology in achieving our goals of the German energy transformation and to…

Machine Learning · Computer Science 2022-12-27 Tobias Rohrer , Lilli Frison , Lukas Kaupenjohann , Katrin Scharf , Elke Hergenrother