English
Related papers

Related papers: A Deep Reinforcement Learning-Based Charging Sched…

200 papers

The resource recharging station location routing problem is a generalization of the location routing problem with sophisticated and critical resource consumption and recharging constraints. Based on a representation of discretized acyclic…

Optimization and Control · Mathematics 2016-02-24 Gongyuan Lu , Xuesong Zhou , Qiyuan Peng , Bisheng He , Monirehalsadat Mahmoudi , Jun Zhao

The growing penetration of electric vehicles (EVs) significantly changes typical load curves in smart grids. With the development of fast charging technology, the volatility of EV charging demand is increasing, which requires additional…

Systems and Control · Electrical Eng. & Systems 2024-11-05 Kedi Zheng , Hanwei Xu , Zeyang Long , Yi Wang , Qixin Chen

Wireless sensor networks consist of randomly distributed sensor nodes for monitoring targets or areas of interest. Maintaining the network for continuous surveillance is a challenge due to the limited battery capacity in each sensor.…

Machine Learning · Computer Science 2023-10-03 Ngoc Bui , Phi Le Nguyen , Viet Anh Nguyen , Phan Thuan Do

Ride-hailing services, such as Didi Chuxing, Lyft, and Uber, arrange thousands of cars to meet ride requests throughout the day. We consider a Markov decision process (MDP) model of a ride-hailing service system, framing it as a…

Optimization and Control · Mathematics 2021-04-30 Jiekun Feng , Mark Gluzman , J. G. Dai

In this paper, we consider the problem of energy efficient uplink scheduling with delay constraint for a multi-user wireless system. We address this problem within the framework of constrained Markov decision processes (CMDPs) wherein one…

Networking and Internet Architecture · Computer Science 2009-08-25 Nitin Salodkar , Abhay Karandikar , V. S. Borkar

Maintaining grid stability amid widespread electric vehicle (EV) adoption is vital for sustainable transportation. Traditional optimization methods and Reinforcement Learning (RL) approaches often struggle with the high dimensionality and…

Systems and Control · Electrical Eng. & Systems 2025-02-06 Stavros Orfanoudakis , Peter Palensky , Pedro P. Vergara

This paper presents a comparative optimization framework for smart charging of electrified vehicle fleets. Using heuristic sequential dynamic programming (SeqDP), the framework minimizes electricity costs while adhering to constraints…

Systems and Control · Electrical Eng. & Systems 2026-03-23 Ipek Kuvvetli , Christofer Sundström , Sogol Kharrazi , Erik Frisk

Despite the rapid expansion of electric vehicle (EV) charging networks, questions remain about their efficiency in meeting the growing needs of EV drivers. Previous simulation-based approaches, which rely on static behavioural rules, have…

Multiagent Systems · Computer Science 2026-02-03 Zixin Feng , Qunshan Zhao , Alison Heppenstall

This paper investigates the scheduling problem of a fleet of electric vehicles, providing mobility as a service to a set of time-specified customers, where the operator needs to solve the routing and charging problem jointly for each EV.…

Optimization and Control · Mathematics 2022-05-27 Canqi Yao , Shibo Chen , Mauro Salazar , Zaiyue Yang

To overcome the curses of dimensionality and modeling of Dynamic Programming (DP) methods to solve Markov Decision Process (MDP) problems, Reinforcement Learning (RL) methods are adopted in practice. Contrary to traditional RL algorithms…

Machine Learning · Computer Science 2021-08-24 Arghyadip Roy , Vivek Borkar , Abhay Karandikar , Prasanna Chaporkar

This paper presents an online reinforcement learning based application which increases the revenue of one particular electric vehicles (EV) station, connected to a renewable source of energy. Moreover, the proposed application adapts to…

Computational Engineering, Finance, and Science · Computer Science 2014-09-18 Stoyan Dimitrov , Redouane Lguensat

Optimizing charging protocols is critical for reducing battery charging time and decelerating battery degradation in applications such as electric vehicles. Recently, reinforcement learning (RL) methods have been adopted for such purposes.…

Systems and Control · Electrical Eng. & Systems 2024-06-19 Myisha A. Chowdhury , Saif S. S. Al-Wahaibi , Qiugang Lu

This paper addresses stochastic charger location and allocation problems under queue congestion for last-mile delivery using electric vehicles (EVs). The objective is to decide where to open charging stations and how many chargers of each…

Optimization and Control · Mathematics 2026-02-17 Waquar Kaleem , Taner Cokyasar , Jeffrey Larson , Omer Verbas , Tanveer Hossain Bhuiyan , Anirudh Subramanyam

Optimized charging of electric vehicles (EVs) at public locations consists of two decisions: how much energy to deliver at what times, which is continuous, and where to plug in, which is binary. This makes optimizing EV charging a…

Optimization and Control · Mathematics 2026-04-17 Nanfei Jiang , Yi Zhou , Josh A. Taylor , Mahnoosh Alizadeh

The robust constrained Markov decision process (RCMDP) is a recent task-modelling framework for reinforcement learning that incorporates behavioural constraints and that provides robustness to errors in the transition dynamics model through…

Machine Learning · Computer Science 2024-05-16 David M. Bossens

As electric vehicle (EV) adoption is growing year after year, there is no doubt that EVs will occupy a significant portion of transporting vehicle in the near future. Although EVs have benefits for environment, large amount of…

Optimization and Control · Mathematics 2017-11-09 Yingqi Xiong , Behnam Khaki , Chi-cheng Chu , Rajit Gadh

Electric vehicles (EVs) are an eco-friendly alternative to vehicles with internal combustion engines. Despite their environmental benefits, the massive electricity demand imposed by the anticipated proliferation of EVs could jeopardize the…

Systems and Control · Electrical Eng. & Systems 2019-11-18 Nanduni I. Nimalsiri , Chathurika P. Mediwaththe , Elizabeth L. Ratnam , Marnie Shaw , David B. Smith , Saman K. Halgamuge

This paper introduces a novel formulation aimed at determining the optimal schedule for recharging a fleet of $n$ heterogeneous robots, with the primary objective of minimizing resource utilization. This study provides a foundational…

Robotics · Computer Science 2024-09-04 Nitesh Kumar , Jaekyung Jackie Lee , Sivakumar Rathinam , Swaroop Darbha , P. B. Sujit , Rajiv Raman

This paper targets at the problem of radio resource management for expected long-term delay-power tradeoff in vehicular communications. At each decision epoch, the road side unit observes the global network state, allocates channels and…

Signal Processing · Electrical Eng. & Systems 2019-06-04 Xianfu Chen , Celimuge Wu , Honggang Zhang , Yan Zhang , Mehdi Bennis , Heli Vuojala

Batteries degrade with usage and continuous cycling. This aging is typically reflected through the resistance growth and the capacity fade of battery cells. Over the years, various charging methods have been presented in the literature that…

Systems and Control · Electrical Eng. & Systems 2025-10-14 Shanthan Kumar Padisala , Bharatkumar Hegde , Ibrahim Haskara , Satadru Dey