English
Related papers

Related papers: Balancing SoC in Battery Cells using Safe Action P…

200 papers

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

Machine Learning · Computer Science 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

This paper addresses the problem of maintaining safety during training in Reinforcement Learning (RL), such that the safety constraint violations are bounded at any point during learning. In a variety of RL applications the safety of the…

Machine Learning · Computer Science 2023-12-19 Rohan Mitta , Hosein Hasanbeig , Jun Wang , Daniel Kroening , Yiannis Kantaros , Alessandro Abate

Given the availability of more comprehensive measurement data in modern power systems, reinforcement learning (RL) has gained significant interest in operation and control. Conventional RL relies on trial-and-error interactions with the…

Systems and Control · Electrical Eng. & Systems 2025-07-01 Tong Su , Tong Wu , Junbo Zhao , Anna Scaglione , Le Xie

Real-world reinforcement learning (RL) problems often demand that agents behave safely by obeying a set of designed constraints. We address the challenge of safe RL by coupling a safety guide based on model predictive control (MPC) with a…

Machine Learning · Computer Science 2022-03-30 Samuel Pfrommer , Tanmay Gautam , Alec Zhou , Somayeh Sojoudi

Active voltage control presents a promising avenue for relieving power congestion and enhancing voltage quality, taking advantage of the distributed controllable generators in the power network, such as roof-top photovoltaics. While…

Machine Learning · Computer Science 2024-09-04 Yang Qu , Jinming Ma , Feng Wu

In the realm of battery charging, several complex aspects demand meticulous attention, including thermal management, capacity degradation, and the need for rapid charging while maintaining safety and battery lifespan. By employing the…

Systems and Control · Electrical Eng. & Systems 2024-09-19 Jorge Espin , Dong Zhang , Daniele Toti , Andrea Pozzi

Accurately predicting the state of health for sodium-ion batteries is crucial for managing battery modules, playing a vital role in ensuring operational safety. However, highly accurate models available thus far are rare due to a lack of…

Machine Learning · Computer Science 2025-09-11 Jiapeng Liu , Lunte Li , Jing Xiang , Laiyong Xie , Yuhao Wang , Francesco Ciucci

Accurate forecasting of battery health indicators, including remaining capacity and lifetime, is of paramount importance for ensuring the reliability, safety, and operational efficiency of applications such as electric vehicles and large…

Signal Processing · Electrical Eng. & Systems 2026-05-29 Athanasios Koukosias , Vasileios Tzanidakis , Sotiris Athanasiou , Kostas Kolomvatsos

Accurate state-of-health (SOH) estimation is critical to guarantee the safety, efficiency and reliability of battery-powered applications. Most SOH estimation methods focus on the 0-100\% full state-of-charge (SOC) range that has similar…

Machine Learning · Computer Science 2023-04-12 Xin Chen , Yuwen Qin , Weidong Zhao , Qiming Yang , Ningbo Cai , Kai Wu

Lithium-Ion (Li-I) batteries have recently become pervasive and are used in many physical assets. To enable a good prediction of the end of discharge of batteries, detailed electrochemical Li-I battery models have been developed. Their…

Machine Learning · Computer Science 2020-12-09 Ajaykumar Unagar , Yuan Tian , Manuel Arias-Chao , Olga Fink

This article presents two Deep Forward Networks with two and four hidden layers, respectively, that model the drive cycle of a Panasonic 18650PF lithium-ion (Li-ion) battery at a given temperature using the K-fold cross-validation method,…

Signal Processing · Electrical Eng. & Systems 2020-09-22 Alexandre Barbosa de Lima , Maurício B. C. Salles , José Roberto Cardoso

The rapid rise in electric vehicle (EV) adoption presents significant challenges in managing the vast number of retired EV batteries. Research indicates that second-life batteries (SLBs) from EVs typically retain considerable residual…

Systems and Control · Electrical Eng. & Systems 2025-02-06 Rouzbeh Haghighi , Ali Hassan , Van-Hai Bui , Akhtar Hussain , Wencong Su

Accurate parameter estimation in electrochemical battery models is essential for monitoring and assessing the performance of lithium-ion batteries (LiBs). This paper presents a novel approach that combines deep reinforcement learning (DRL)…

Systems and Control · Electrical Eng. & Systems 2025-06-25 Mehmet Fatih Ozkan , Samuel Filgueira da Silva , Faissal El Idrissi , Prashanth Ramesh , Marcello Canova

The paradigm shift in the electric power grid necessitates a revisit of existing control methods to ensure the grid's security and resilience. In particular, the increased uncertainties and rapidly changing operational conditions in power…

Systems and Control · Electrical Eng. & Systems 2020-11-20 Thanh Long Vu , Sayak Mukherjee , Tim Yin , Renke Huang , and Jie Tan , Qiuhua Huang

Safe Reinforcement Learning (Safe RL) is one of the prevalently studied subcategories of trial-and-error-based methods with the intention to be deployed on real-world systems. In safe RL, the goal is to maximize reward performance while…

Machine Learning · Computer Science 2024-08-16 Homayoun Honari , Amir Mehdi Soufi Enayati , Mehran Ghafarian Tamizi , Homayoun Najjaran

Wireless sensor networks (WSNs) have become a promising solution for structural health monitoring (SHM), especially in hard-to-reach or remote locations. Battery-powered WSNs offer various advantages over wired systems, however limited…

Machine Learning · Computer Science 2025-03-25 Jong-Hyun Jeong , Hongki Jo , Qiang Zhou , Tahsin Afroz Hoque Nishat , Lang Wu

Fault diagnosis of lithium-ion batteries is critical for system safety. While existing deep learning methods exhibit superior detection accuracy, their "black-box" nature hinders interpretability. Furthermore, restricted by binary…

Artificial Intelligence · Computer Science 2026-01-01 Songqi Zhou , Ruixue Liu , Boman Su , Jiazhou Wang , Yixing Wang , Benben Jiang

Deep Reinforcement Learning (RL) has shown promise in addressing complex robotic challenges. In real-world applications, RL is often accompanied by failsafe controllers as a last resort to avoid catastrophic events. While necessary for…

Robotics · Computer Science 2023-09-26 Jakob Thumm , Guillaume Pelat , Matthias Althoff

Autonomous vehicles are suited for continuous area patrolling problems. Finding an optimal patrolling strategy can be challenging due to unknown environmental factors, such as wind or landscape; or autonomous vehicles' constraints, such as…

Robotics · Computer Science 2024-02-19 Chenhao Tong , Maria A. Rodriguez , Richard O. Sinnott

Reinforcement learning (RL) has recently been used for solving challenging decision-making problems in the context of automated driving. However, one of the main drawbacks of the presented RL-based policies is the lack of safety guarantees,…

Robotics · Computer Science 2021-07-16 Danial Kamran , Yu Ren , Martin Lauer