English
Related papers

Related papers: Reinforcement Learning for Charging Optimization o…

200 papers

Manipulate and control of the complex quantum system with high precision are essential for achieving universal fault tolerant quantum computing. For a physical system with restricted control resources, it is a challenge to control the…

Quantum Physics · Physics 2021-01-20 Zheng An , Qi-Kai He , Hai-Jing Song , D. L. Zhou

We investigate the use of Reinforcement Learning for the optimal execution of meta-orders, where the objective is to execute incrementally large orders while minimizing implementation shortfall and market impact over an extended period of…

Trading and Market Microstructure · Quantitative Finance 2025-11-20 Tomas Espana , Yadh Hafsi , Fabrizio Lillo , Edoardo Vittori

We investigate the performance of a novel model based on a one-dimensional (1D) spin-$1/2$ Heisenberg $XY-\Gamma(\gamma)$ quantum chain, also known as 1D Kitaev chain, as a working medium for a quantum battery (QB) in both closed and open…

Quantum batteries (QBs) exploit principles of quantum mechanics to accelerate the charging process and aim to achieve optimal energy storage. However, analytical results for investigating these problems remain lacking due to the challenges…

Quantum Physics · Physics 2025-02-11 Hui-Yu Yang , Kun Zhang , Xiao-Hui Wang , Hai-Long Shi

Reinforcement learning algorithms typically rely on the assumption that the environment dynamics and value function can be expressed in terms of a Markovian state representation. However, when state information is only partially observable,…

Quantum batteries have emerged as promising devices that work within the quantum regime and provide energy storage and power delivery. In this work, we explore the interplay between the battery and charger Hamiltonians, focusing on…

Quantum Physics · Physics 2025-11-21 Rohit Kumar Shukla , Rajiv Kumar , Ujjwal Sen , Sunil K. Mishra

We propose an algorithm for distributed charging control of electric vehicles (EVs) using online learning and online convex optimization. Many distributed charging control algorithms in the literature implicitly assume fast two-way…

Optimization and Control · Mathematics 2015-07-28 Wann-Jiun Ma , Vijay Gupta , Ufuk Topcu

The variable and unpredictable load demands in hybrid agricultural tractors make it difficult to design optimal rule-based energy management strategies, motivating the use of adaptive, learning-based control. However, existing approaches…

Systems and Control · Electrical Eng. & Systems 2025-08-06 Hend Abououf , Sidra Ghayour Bhatti , Qadeer Ahmed

A total 19% of generation capacity in California is offered by PV units and over some months, more than 10% of this energy is curtailed. In this research, a novel approach to reduce renewable generation curtailments and increasing system…

Systems and Control · Electrical Eng. & Systems 2022-01-20 Reza Bayani , Saeed D. Manshadi , Guangyi Liu , Yawei Wang , Renchang Dai

The increasing integration of electric vehicles (EVs) into the grid can pose a significant risk to the distribution system operation in the absence of coordination. In response to the need for effective coordination of EVs within the…

Systems and Control · Electrical Eng. & Systems 2024-03-21 Jiarong Fan , Ariel Liebman , Hao Wang

We present a collision model for the charging of a quantum battery by identical nonequilibrium qubit units. When the units are prepared in a mixture of energy eigenstates, the energy gain in the battery can be described by a classical…

The rapid rise in electric vehicle (EV) adoption presents significant challenges in managing the vast number of retired EV batteries. Research indicates that second-life batteries (SLBs) from EVs typically retain considerable residual…

Systems and Control · Electrical Eng. & Systems 2025-02-06 Rouzbeh Haghighi , Ali Hassan , Van-Hai Bui , Akhtar Hussain , Wencong Su

Millions of battery-powered sensors deployed for monitoring purposes in a multitude of scenarios, e.g., agriculture, smart cities, industry, etc., require energy-efficient solutions to prolong their lifetime. When these sensors observe a…

Machine Learning · Computer Science 2021-09-30 Jernej Hribar , Andrei Marinescu , Alessandro Chiumento , Luiz A. DaSilva

Fast charging of lithium-ion batteries is limited by lithium plating, which occurs when the anode potential drops below 0 V vs Li/Li+. Model-based control aims to maximize charging current while maintaining anode potentials above this…

Systems and Control · Electrical Eng. & Systems 2026-05-19 Alessio Alberto Lodge , Alessio Lombardo Pontillo , Feye S. J. Hoekstra , Robinson Medina , Steven Wilkins , Ilenia Battiato

Information asymmetry between the Distribution System Operator (DSO) and Distributed Energy Resource Aggregators (DERAs) obstructs designing effective incentives for voltage regulation. To capture this effect, we employ a Stackelberg…

Systems and Control · Electrical Eng. & Systems 2024-08-07 Zhirui Liang , Qi Li , Joshua Comden , Andrey Bernstein , Yury Dvorkin

The integration of photovoltaic (PV) systems, stationary energy storage systems (ESSs), and electric vehicles (EVs) alongside demand response (DR) programmes in industrial parks presents opportunities to reduce costs and improve renewable…

Systems and Control · Electrical Eng. & Systems 2026-04-07 Meng Yuan , Tinghui Yan , Zhezhuang Xu

Growth in the penetration of renewable energy sources makes supply more uncertain and leads to an increase in the system imbalance. This trend, together with the single imbalance pricing, opens an opportunity for balance responsible parties…

Machine Learning · Computer Science 2024-01-02 Seyed Soroush Karimi Madahi , Bert Claessens , Chris Develder

We study how high charging rate demands from electric vehicles (EVs) in a power distribution grid may collectively cause poor dynamic performance, and propose a price incentivization strategy to steer customers to settle for lesser charging…

Optimization and Control · Mathematics 2025-08-26 Amit Kumer Podder , Tomonori Sadamoto , Aranya Chakrabortty

Reinforcement learning algorithms are typically designed for discrete-time dynamics, even though the underlying real-world control systems are often continuous in time. In this paper, we study the problem of continuous-time reinforcement…

Machine Learning · Computer Science 2026-03-03 Klemens Iten , Lenart Treven , Bhavya Sukhija , Florian Dörfler , Andreas Krause

Reinforcement learning demonstrated immense success in modelling complex physics-driven systems, providing end-to-end trainable solutions by interacting with a simulated or real environment, maximizing a scalar reward signal. In this work,…

Computational Physics · Physics 2025-01-10 Tobias Kortus , Ralf Keidel , Nicolas R. Gauger , Jan Kieseler