English
Related papers

Related papers: Balancing SoC in Battery Cells using Safe Action P…

200 papers

Safe reinforcement learning (RL) trains a policy to maximize the task reward while satisfying safety constraints. While prior works focus on the performance optimality, we find that the optimal solutions of many safe RL problems are not…

Machine Learning · Computer Science 2023-03-03 Zuxin Liu , Zijian Guo , Zhepeng Cen , Huan Zhang , Jie Tan , Bo Li , Ding Zhao

In this paper, we present a Symbolic Reinforcement Learning (SRL) based architecture for safety control of Radio Access Network (RAN) applications. In particular, we provide a purely automated procedure in which a user can specify…

Artificial Intelligence · Computer Science 2022-04-26 Alexandros Nikou , Anusha Mujumdar , Vaishnavi Sundararajan , Marin Orlic , Aneta Vulgarakis Feljan

Reinforcement Learning (RL) is essentially a trial-and-error learning procedure which may cause unsafe behavior during the exploration-and-exploitation process. This hinders the application of RL to real-world control problems, especially…

Machine Learning · Computer Science 2021-05-03 Yutong Li , Nan Li , H. Eric Tseng , Anouck Girard , Dimitar Filev , Ilya Kolmanovsky

We develop a hybrid system model to describe the behavior of multiple agents cooperatively solving an optimal coverage problem under energy depletion and repletion constraints. The model captures the controlled switching of agents between…

Signal Processing · Electrical Eng. & Systems 2020-03-04 Xiangyu Meng , Arian Houshmand , Christos G. Cassandras

Deep reinforcement learning (RL) has been endowed with high expectations in tackling challenging manipulation tasks in an autonomous and self-directed fashion. Despite the significant strides made in the development of reinforcement…

Robotics · Computer Science 2023-04-27 Zhenshan Bing , Aleksandr Mavrichev , Sicong Shen , Xiangtong Yao , Kejia Chen , Kai Huang , Alois Knoll

Next-generation lithium-ion batteries with silicon anodes have positive characteristics due to higher energy densities compared to state-of-the-art graphite anodes. However, the large volume expansion of silicon anodes can cause high…

Numerical Analysis · Mathematics 2024-04-03 R. Schoof , G. F. Castelli , W. Dörfler

Accurate and reliable state of charge (SoC) estimation becomes increasingly important to provide a stable and efficient environment for Lithium-ion batteries (LiBs) powered devices. Most data-driven SoC models are built for a fixed ambient…

Machine Learning · Computer Science 2021-01-12 Yan Qin , Stefan Adams , Chau Yuen

The application of deep reinforcement learning algorithms to economic battery dispatch problems has significantly increased recently. However, optimizing battery dispatch over long horizons can be challenging due to delayed rewards. In our…

Systems and Control · Electrical Eng. & Systems 2025-04-08 Manuel Sage , Martin Staniszewski , Yaoyao Fiona Zhao

Safety is an essential component for deploying reinforcement learning (RL) algorithms in real-world scenarios, and is critical during the learning process itself. A natural first approach toward safe RL is to manually specify constraints on…

Machine Learning · Computer Science 2020-10-29 Krishnan Srinivasan , Benjamin Eysenbach , Sehoon Ha , Jie Tan , Chelsea Finn

Reinforcement learning (RL) agents are vulnerable to adversarial disturbances, which can deteriorate task performance or compromise safety specifications. Existing methods either address safety requirements under the assumption of no…

Machine Learning · Computer Science 2023-09-14 Zeyang Li , Chuxiong Hu , Yunan Wang , Yujie Yang , Shengbo Eben Li

New forms of on-demand transportation such as ride-hailing and connected autonomous vehicles are proliferating, yet are a challenging use case for electric vehicles (EV). This paper explores the feasibility of using deep reinforcement…

Systems and Control · Electrical Eng. & Systems 2019-12-10 Jacob F. Pettit , Ruben Glatt , Jonathan R. Donadee , Brenden K. Petersen

Electric power systems are undergoing a major transformation as they integrate intermittent renewable energy sources, and batteries to smooth out variations in renewable energy production. As privately-owned batteries grow from their role…

Theoretical Economics · Economics 2025-04-02 Jerry Anunrojwong , Santiago R. Balseiro , Omar Besbes , Bolun Xu

Reinforcement learning (RL) has been widely used in decision-making and control tasks, but the risk is very high for the agent in the training process due to the requirements of interaction with the environment, which seriously limits its…

Machine Learning · Computer Science 2024-09-13 Xuemin Hu , Pan Chen , Yijun Wen , Bo Tang , Long Chen

Autonomous vehicles inevitably encounter a vast array of scenarios in real-world environments. Addressing long-tail scenarios, particularly those involving intensive interactions with numerous traffic participants, remains one of the most…

Robotics · Computer Science 2024-12-16 Guanzhou Li , Jianping Wu , Yujing He

This manuscript presents an algorithm for individual Lithium-ion (Li-ion) battery cell state of charge (SOC) estimation in a large-scale battery pack under minimal sensing, where only pack-level voltage and current are measured. For battery…

Systems and Control · Electrical Eng. & Systems 2021-09-20 Dong Zhang , Luis D. Couto , Ross Drummond , Shashank Sripad , Venkatasubramanian Viswanathan

Multi-agent reinforcement learning (RL) often struggles to ensure the safe behaviours of the learning agents, and therefore it is generally not adapted to safety-critical applications. To address this issue, we present a methodology that…

Multiagent Systems · Computer Science 2021-04-05 Pierre El Mqirmi , Francesco Belardinelli , Borja G. León

This paper explores the application of a federated learning-based multi-agent reinforcement learning (MARL) strategy to enhance physical-layer security (PLS) in a multi-cellular network within the context of beyond 5G networks. At each…

Signal Processing · Electrical Eng. & Systems 2025-07-10 Deemah H. Tashman , Soumaya Cherkaoui , Walaa Hamouda

Safe reinforcement learning deals with mitigating or avoiding unsafe situations by reinforcement learning (RL) agents. Safe RL approaches are based on specific risk representations for particular problems or domains. In order to analyze…

Machine Learning · Computer Science 2023-12-11 Leonardo Villalobos-Arias , Derek Martin , Abhijeet Krishnan , Madeleine Gagné , Colin M. Potts , Arnav Jhala

The trial and error approach of reinforcement learning (RL) results in high performance across many complex tasks, but it can also lead to unsafe behavior. Run time assurance (RTA) approaches can be used to assure safety of the agent during…

Systems and Control · Electrical Eng. & Systems 2024-06-18 Kyle Dunlap , Kochise Bennett , David van Wijk , Nathaniel Hamilton , Kerianne Hobbs

This paper presents the concept of an adaptive safe padding that forces Reinforcement Learning (RL) to synthesise optimal control policies while ensuring safety during the learning process. Policies are synthesised to satisfy a goal,…

Machine Learning · Computer Science 2020-03-24 Mohammadhosein Hasanbeig , Alessandro Abate , Daniel Kroening