English
Related papers

Related papers: A SUMO Framework for Deep Reinforcement Learning E…

200 papers

The increasing complexity of Intelligent Transportation Systems (ITS) has led to significant interest in computational offloading to external infrastructures such as edge servers, vehicular nodes, and UAVs. These dynamic and heterogeneous…

Machine Learning · Computer Science 2026-05-27 Ashab Uddin , Ahmed Hamdi Sakr , Ning Zhang

A major challenge in todays power grid is to manage the increasing load from electric vehicle (EV) charging. Demand response (DR) solutions aim to exploit flexibility therein, i.e., the ability to shift EV charging in time and thus avoid…

Artificial Intelligence · Computer Science 2022-03-29 Manu Lahariya , Nasrin Sadeghianpourhamami , Chris Develder

With the proliferation of electric vehicles (EVs), the transportation network and power grid become increasingly interdependent and coupled via charging stations. The concomitant growth in charging demand has posed challenges for both…

Computational Engineering, Finance, and Science · Computer Science 2025-05-22 Qionghua Liao , Guilong Li , Jiajie Yu , Ziyuan Gu , Wei Ma

The use of electric vehicles (EV) in the last mile is appealing from both sustainability and operational cost perspectives. In addition to the inherent cost efficiency of EVs, selling energy back to the grid during peak grid demand, is a…

Artificial Intelligence · Computer Science 2022-04-13 Ajay Narayanan , Prasant Misra , Ankush Ojha , Vivek Bandhu , Supratim Ghosh , Arunchandar Vasan

Current autonomous vehicle (AV) simulators are built to provide large-scale testing required to prove capabilities under varied conditions in controlled, repeatable fashion. However, they have certain failings including the need for user…

Robotics · Computer Science 2021-09-27 Arpan Kusari , Pei Li , Hanzhi Yang , Nikhil Punshi , Mich Rasulis , Scott Bogard , David J. LeBlanc

Electric Vehicle (EV) has become a preferable choice in the modern transportation system due to its environmental and energy sustainability. However, in many large cities, EV drivers often fail to find the proper spots for charging, because…

Machine Learning · Computer Science 2021-02-16 Weijia Zhang , Hao Liu , Fan Wang , Tong Xu , Haoran Xin , Dejing Dou , Hui Xiong

Maintaining grid stability amid widespread electric vehicle (EV) adoption is vital for sustainable transportation. Traditional optimization methods and Reinforcement Learning (RL) approaches often struggle with the high dimensionality and…

Systems and Control · Electrical Eng. & Systems 2025-02-06 Stavros Orfanoudakis , Peter Palensky , Pedro P. Vergara

Deep Reinforcement Learning can play a key role in addressing sustainable energy challenges. For instance, many grid systems are heavily congested, highlighting the urgent need to enhance operational efficiency. However, reinforcement…

Machine Learning · Computer Science 2025-07-03 Koen Ponse , Jan Felix Kleuker , Aske Plaat , Thomas Moerland

Deep reinforcement learning (DRL) has been used to learn effective heuristics for solving complex combinatorial optimisation problem via policy networks and have demonstrated promising performance. Existing works have focused on solving…

Machine Learning · Computer Science 2020-12-25 Nasrin Sultana , Jeffrey Chan , A. K. Qin , Tabinda Sarwar

The proliferation of Internet of Things (IoT) devices and the advent of 6G technologies have introduced computationally intensive tasks that often surpass the processing capabilities of user devices. Efficient and secure resource allocation…

Machine Learning · Computer Science 2025-01-22 Jianfei Sun , Qiang Gao , Cong Wu , Yuxian Li , Jiacheng Wang , Dusit Niyato

We consider vehicular networking scenarios where existing vehicle-to-vehicle (V2V) links can be leveraged for an effective uploading of large-size data to the network. In particular, we consider a group of vehicles where one vehicle can be…

Signal Processing · Electrical Eng. & Systems 2025-12-22 Talha Akyildiz , Hessam Mahdavifar

This paper proposes an adaptive energy management strategy for hybrid electric vehicles by combining deep reinforcement learning (DRL) and transfer learning (TL). This work aims to address the defect of DRL in tedious training time. First,…

Signal Processing · Electrical Eng. & Systems 2020-07-20 Xiaowei Guo , Teng Liu , Bangbei Tang , Xiaolin Tang , Jinwei Zhang , Wenhao Tan , Shufeng Jin

Traffic signal control is an emerging application scenario for reinforcement learning. Besides being as an important problem that affects people's daily life in commuting, traffic signal control poses its unique challenges for reinforcement…

Multiagent Systems · Computer Science 2019-05-15 Huichu Zhang , Siyuan Feng , Chang Liu , Yaoyao Ding , Yichen Zhu , Zihan Zhou , Weinan Zhang , Yong Yu , Haiming Jin , Zhenhui Li

Integrating Unmanned Aerial Vehicles (UAVs) with Unmanned Ground Vehicles (UGVs) provides an effective solution for persistent surveillance in disaster management. UAVs excel at covering large areas rapidly, but their range is limited by…

Robotics · Computer Science 2025-02-06 Md Safwan Mondal , Subramanian Ramasamy , Pranav Bhounsule

Visual navigation is essential for many applications in robotics, from manipulation, through mobile robotics to automated driving. Deep reinforcement learning (DRL) provides an elegant map-free approach integrating image processing,…

Robotics · Computer Science 2020-10-22 Jonáš Kulhánek , Erik Derner , Robert Babuška

Electric Vehicles (EVs) offer substantial flexibility for grid services, yet large-scale, uncoordinated charging can threaten voltage stability in distribution networks. Existing Reinforcement Learning (RL) approaches for smart charging…

Systems and Control · Electrical Eng. & Systems 2025-10-23 Stavros Orfanoudakis , Frans A. Oliehoek , Peter Palensky , Pedro P. Vergara

In this paper, a deep reinforcement learning (DRL) method is proposed to address the problem of UAV navigation in an unknown environment. However, DRL algorithms are limited by the data efficiency problem as they typically require a huge…

Robotics · Computer Science 2020-08-07 Lei He , Nabil Aouf , James F. Whidborne , Bifeng Song

The placement of charging stations in areas with developing charging infrastructure is a critical component of the future success of electric vehicles (EVs). In Albany County in New York, the expected rise in the EV population requires…

Systems and Control · Electrical Eng. & Systems 2022-07-26 Shankar Padmanabhan , Aidan Petratos , Allen Ting , Kristina Zhou , Dylan Hageman , Jesse R. Pisel , Michael J. Pyrcz

Traffic simulations are commonly used to optimize urban traffic flow, with reinforcement learning (RL) showing promising potential for automated traffic signal control, particularly in intelligent transportation systems involving connected…

Systems and Control · Electrical Eng. & Systems 2025-09-19 Talha Azfar , Kaicong Huang , Andrew Tracy , Sandra Misiewicz , Chenxi Liu , Ruimin Ke

Distance-based reward mechanisms in deep reinforcement learning (DRL) navigation systems suffer from critical safety limitations in dynamic environments, frequently resulting in collisions when visibility is restricted. We propose DRL-NSUO,…

Robotics · Computer Science 2025-03-04 Mingao Tan , Shanze Wang , Biao Huang , Zhibo Yang , Rongfei Chen , Xiaoyu Shen , Wei Zhang