English
Related papers

Related papers: Balancing SoC in Battery Cells using Safe Action P…

200 papers

Reinforcement learning (RL)-based adaptive cruise control systems (ACC) that learn and adapt to road, traffic and vehicle conditions are attractive for enhancing vehicle energy efficiency and traffic flow. However, the application of RL in…

Systems and Control · Electrical Eng. & Systems 2023-01-04 Habtamu Hailemichael , Beshah Ayalew , Lindsey Kerbel , Andrej Ivanco , Keith Loiselle

This paper presents a Vehicle-to-Grid (V2G) coordination framework using reinforcement learning (RL). {An intelligent control strategy based on the soft actor-critic algorithm is developed for voltage regulation through single and multi-hub…

Systems and Control · Electrical Eng. & Systems 2026-03-10 Jingbo Wang , Roshni Anna Jacob , Harshal D. Kaushik , Jie Zhang

Safety is one of the main challenges in applying reinforcement learning to realistic environmental tasks. To ensure safety during and after training process, existing methods tend to adopt overly conservative policy to avoid unsafe…

Machine Learning · Computer Science 2023-06-27 Xiao Zhang , Hai Zhang , Hongtu Zhou , Chang Huang , Di Zhang , Chen Ye , Junqiao Zhao

Reinforcement learning (RL) agents are powerful tools for managing power grids. They use large amounts of data to inform their actions and receive rewards or penalties as feedback to learn favorable responses for the system. Once trained,…

Systems and Control · Electrical Eng. & Systems 2024-11-19 Benjamin M. Peter , Mert Korkali

While Deep Reinforcement Learning (DRL) has emerged as a promising solution for intricate control tasks, the lack of explainability of the learned policies impedes its uptake in safety-critical applications, such as automated driving…

Machine Learning · Computer Science 2024-04-30 Amir Samadi , Konstantinos Koufos , Kurt Debattista , Mehrdad Dianati

Determining the optimal cost function parameters of Model Predictive Control (MPC) to optimize multiple control objectives is a challenging and time-consuming task. Multiobjective Bayesian Optimization (BO) techniques solve this problem by…

Robotics · Computer Science 2024-02-06 Baha Zarrouki , Marios Spanakakis , Johannes Betz

Although safety stock optimisation has been studied for more than 60 years, most companies still use simplistic means to calculate necessary safety stock levels, partly due to the mismatch between existing analytical methods' emphases on…

Multiagent Systems · Computer Science 2021-07-05 Edward Elson Kosasih , Alexandra Brintrup

Fast and safe voltage regulation algorithms can serve as fundamental schemes for achieving a high level of renewable penetration in the modern distribution power grids. Faced with uncertain or even unknown distribution grid models and…

Systems and Control · Electrical Eng. & Systems 2021-12-01 Yize Chen , Yuanyuan Shi , Daniel Arnold , Sean Peisert

Safe interaction with the environment is one of the most challenging aspects of Reinforcement Learning (RL) when applied to real-world problems. This is particularly important when unsafe actions have a high or irreversible negative impact…

Machine Learning · Computer Science 2021-10-22 Erik Aumayr , Saman Feghhi , Filippo Vannella , Ezeddin Al Hakim , Grigorios Iakovidis

Reinforcement learning (RL) agents need to explore their environment to learn optimal behaviors and achieve maximum rewards. However, exploration can be risky when training RL directly on real systems, while simulation-based training…

Robotics · Computer Science 2024-10-10 Dvij Kalaria , Qin Lin , John M. Dolan

This paper presents a safe learning-based eco-driving framework tailored for mixed traffic flows, which aims to optimize energy efficiency while guaranteeing safety during real-system operations. Even though reinforcement learning (RL) is…

Systems and Control · Electrical Eng. & Systems 2024-02-01 Ke Lu , Dongjun Li , Qun Wang , Kaidi Yang , Lin Zhao , Ziyou Song

By informing accurate performance (e.g., capacity), health state management plays a significant role in safeguarding battery and its powered system. While most current approaches are primarily based on data-driven methods, lacking in-depth…

Signal Processing · Electrical Eng. & Systems 2020-08-13 Yan Qin , Chau Yuen , Stefan Adams

Reinforcement learning (RL) is effective in many robotic applications, but it requires extensive exploration of the state-action space, during which behaviors can be unsafe. This significantly limits its applicability to large robots with…

Robotics · Computer Science 2026-01-05 Mehdi Heydari Shahna , Pauli Mustalahti , Jouni Mattila

The ball-balancing robot (ballbot) is a good platform to test the effectiveness of a balancing controller. Considering balancing control, conventional model-based feedback control methods have been widely used. However, contacts and…

Robotics · Computer Science 2022-08-23 Yifan Zhou , Jianghao Lin , Shuai Wang , Chong Zhang

With the growing prevalence of electric vehicles (EVs) and advancements in EV electronics, vehicle-to-grid (V2G) techniques and large-scale scheduling strategies have emerged to promote renewable energy utilization and power grid stability.…

Systems and Control · Electrical Eng. & Systems 2023-08-02 Yubao Zhang , Xin Chen , Yi Gu , Zhicheng Li , Wu Kai

Collision avoidance is key for mobile robots and agents to operate safely in the real world. In this work we present SAFER, an efficient and effective collision avoidance system that is able to improve safety by correcting the control…

Robotics · Computer Science 2023-06-30 Mario Srouji , Hugues Thomas , Hubert Tsai , Ali Farhadi , Jian Zhang

It is of extreme importance to monitor and manage the battery health to enhance the performance and decrease the maintenance cost of operating electric vehicles. This paper concerns the machine-learning-enabled state-of-health (SoH)…

Machine Learning · Computer Science 2021-03-31 Matti Huotari , Shashank Arora , Avleen Malhi , Kary Främling

This paper develops a Decentralized Multi-Agent Reinforcement Learning (Dec-MARL) method to solve the SoC balancing problem in the distributed energy storage system (DESS). First, the SoC balancing problem is formulated into a finite Markov…

Artificial Intelligence · Computer Science 2023-08-30 Zheng Xiong , Biao Luo , Bing-Chuan Wang , Xiaodong Xu , Xiaodong Liu , Tingwen Huang

The state of charge (SoC) and the rate of charging/discharging current are the vital parameters associated with a battery by which its accurate runtime can be estimated. This paper aims to design a controller which comprises of a…

Signal Processing · Electrical Eng. & Systems 2020-05-26 P. Dinesh , K. Kumar Teja , Shashank Singh , Selvan M. P. , Moorthi S

In this work, we derive analytical expressions governing state-of-charge and current imbalance dynamics for two parallel-connected batteries. The model, based on equivalent circuits and an affine open circuit voltage relation, describes the…

Systems and Control · Electrical Eng. & Systems 2022-11-10 Andrew Weng , Sravan Pannala , Jason B. Siegel , Anna G. Stefanopoulou