English
Related papers

Related papers: Balancing SoC in Battery Cells using Safe Action P…

200 papers

Energy storage devices, such as batteries, thermal energy storages, and hydrogen systems, can help mitigate climate change by ensuring a more stable and sustainable power supply. To maximize the effectiveness of such energy storage,…

Machine Learning · Computer Science 2024-05-21 Jaeik Jeong , Tai-Yeon Ku , Wan-Ki Park

This work introduces a toolchain for applying Reinforcement Learning (RL), specifically the Deep Deterministic Policy Gradient (DDPG) algorithm, in safety-critical real-world environments. As an exemplary application, transient load control…

Machine Learning · Computer Science 2026-02-25 Julian Bedei , Lucas Koch , Kevin Badalian , Alexander Winkler , Patrick Schaber , Jakob Andert

Accurate co-estimations of battery states, such as state-of-charge (SOC), state-of-health (SOH,) and remaining useful life (RUL), are crucial to the battery management systems to assure safe and reliable management. Although the external…

Systems and Control · Electrical Eng. & Systems 2022-10-24 Ningbo Cai , Yuwen Qin , Xin Chen , Kai Wu

Cell inconsistency within a lithium-ion battery system poses a significant challenge in maximizing the system operational time. This study presents an optimization-driven active balancing method to minimize the effects of cell inconsistency…

Systems and Control · Electrical Eng. & Systems 2024-05-03 Yiming Xu , Xiaohua Ge , Ruohan Guo , Weixiang Shen

Learning a risk-aware policy is essential but rather challenging in unstructured robotic tasks. Safe reinforcement learning methods open up new possibilities to tackle this problem. However, the conservative policy updates make it…

Machine Learning · Computer Science 2022-12-15 Linrui Zhang , Zichen Yan , Li Shen , Shoujie Li , Xueqian Wang , Dacheng Tao

Strategic aggregation of electric vehicle batteries as energy reservoirs can optimize power grid demand, benefiting smart and connected communities, especially large office buildings that offer workplace charging. This involves optimizing…

Machine Learning · Computer Science 2025-02-27 Fangqi Liu , Rishav Sen , Jose Paolo Talusan , Ava Pettet , Aaron Kandel , Yoshinori Suzue , Ayan Mukhopadhyay , Abhishek Dubey

Safe reinforcement learning (RL) seeks to mitigate unsafe behaviors that arise from exploration during training by reducing constraint violations while maintaining task performance. Existing approaches typically rely on a single policy to…

Robotics · Computer Science 2026-05-12 Murad Dawood , Usama Ahmed Siddiquie , Shahram Khorshidi , Maren Bennewitz

In this paper, we present the use of Model Predictive Control (MPC) based on Reinforcement Learning (RL) to find the optimal policy for a multi-agent battery storage system. A time-varying prediction of the power price and production-demand…

Systems and Control · Electrical Eng. & Systems 2021-06-08 A. Bahari Kordabad , W. Cai , S. Gros

Fast-charging of lithium-ion batteries is essential for electric vehicle adoption, but aggressive charging can accelerate its degradation and create safety risks. This study investigates a control framework that coordinates charging current…

Systems and Control · Electrical Eng. & Systems 2026-05-26 Frederic Fabry , Alessio Lodge , Robinson Medina , Feye Hoekstra , Steven Wilkins , Madalin Frunzete

Accurately predicting the lifetime of battery cells in early cycles holds tremendous value for battery research and development as well as numerous downstream applications. This task is rather challenging because diverse conditions, such as…

Signal Processing · Electrical Eng. & Systems 2023-11-27 Han Zhang , Yuqi Li , Shun Zheng , Ziheng Lu , Xiaofan Gui , Wei Xu , Jiang Bian

We address the problem of deploying a reinforcement learning (RL) agent on a physical system such as a datacenter cooling unit or robot, where critical constraints must never be violated. We show how to exploit the typically smooth dynamics…

Artificial Intelligence · Computer Science 2018-01-29 Gal Dalal , Krishnamurthy Dvijotham , Matej Vecerik , Todd Hester , Cosmin Paduraru , Yuval Tassa

Accurate state-of-charge (SOC) estimation is essential for optimizing battery performance, ensuring safety, and maximizing economic value. Conventional current and voltage measurements, however, have inherent limitations in fully inferring…

Systems and Control · Electrical Eng. & Systems 2025-06-25 Xiaolei Bian , Changfu Zou , Björn Fridholm , Christian Sundvall , Torsten Wik

Deep Reinforcement Learning (DRL) algorithms have recently made significant strides in improving network performance. Nonetheless, their practical use is still limited in the absence of safe exploration and safe decision-making. In the…

Networking and Internet Architecture · Computer Science 2024-01-12 Lam Dinh , Pham Tran Anh Quang , Jérémie Leguay

Under voltage load shedding has been considered as a standard approach to recover the voltage stability of the electric power grid under emergency conditions, yet this scheme usually trips a massive amount of load inefficiently.…

Machine Learning · Computer Science 2021-12-06 Thanh Long Vu , Sayak Mukherjee , Renke Huang , Qiuhua Huang

Growth in the penetration of renewable energy sources makes supply more uncertain and leads to an increase in the system imbalance. This trend, together with the single imbalance pricing, opens an opportunity for balance responsible parties…

Machine Learning · Computer Science 2024-01-02 Seyed Soroush Karimi Madahi , Bert Claessens , Chris Develder

Reinforcement learning (RL) agents with pre-specified reward functions cannot provide guaranteed safety across variety of circumstances that an uncertain system might encounter. To guarantee performance while assuring satisfaction of safety…

Artificial Intelligence · Computer Science 2021-04-20 Aquib Mustafa , Majid Mazouchi , Subramanya Nageshrao , Hamidreza Modares

Reinforcement learning (RL) enables agents to learn optimal behaviors through interaction with their environment and has been increasingly deployed in safety-critical applications, including autonomous driving. Despite its promise, RL is…

Reinforcement Learning (RL) has been shown to be effective in many scenarios. However, it typically requires the exploration of a sufficiently large number of state-action pairs, some of which may be unsafe. Consequently, its application to…

Systems and Control · Electrical Eng. & Systems 2022-06-24 Yousef Emam , Gennaro Notomista , Paul Glotfelter , Zsolt Kira , Magnus Egerstedt

The large-scale integration of intermittent renewable energy resources introduces increased uncertainty and volatility to the supply side of power systems, thereby complicating system operation and control. Recently, data-driven approaches,…

Systems and Control · Electrical Eng. & Systems 2024-07-02 Peipei Yu , Zhenyi Wang , Hongcai Zhang , Yonghua Song

Reinforcement learning (RL) has been successfully applied to a variety of robotics applications, where it outperforms classical methods. However, the safety aspect of RL and the transfer to the real world remain an open challenge. A…

Robotics · Computer Science 2025-04-21 Murad Dawood , Ahmed Shokry , Maren Bennewitz