English
Related papers

Related papers: A SUMO Framework for Deep Reinforcement Learning E…

200 papers

Reinforcement learning (RL) is a promising solution for autonomous vehicles to deal with complex and uncertain traffic environments. The RL training process is however expensive, unsafe, and time consuming. Algorithms are often developed…

Robotics · Computer Science 2022-11-29 Kevin Voogd , Jean Pierre Allamaa , Javier Alonso-Mora , Tong Duy Son

With the increasing effects of climate change, the urgency to step away from fossil fuels is greater than ever before. Electric vehicles (EVs) are one way to diminish these effects, but their widespread adoption is often limited by the…

Optimization and Control · Mathematics 2023-12-12 Pierre-Luc Parent , Margarida Carvalho , Miguel F. Anjos , Ribal Atallah

This paper proposes a reinforcement learning approach for nightly offline rebalancing operations in free-floating electric vehicle sharing systems (FFEVSS). Due to sparse demand in a network, FFEVSS require relocation of electrical vehicles…

Machine Learning · Computer Science 2021-04-07 Aigerim Bogyrbayeva , Sungwook Jang , Ankit Shah , Young Jae Jang , Changhyun Kwon

As electric vehicles (EVs) become central to decarbonization efforts, the need for uninterrupted power supply in time-critical logistics, particularly in medical transportation, poses unique challenges for power systems integration.…

Optimization and Control · Mathematics 2026-04-28 Jingyi Zhao , Haoxiang Yang , Youxuan Pan , Yang Liu

Recent technology development brings the boom of numerous new Demand-Driven Services (DDS) into urban lives, including ridesharing, on-demand delivery, express systems and warehousing. In DDS, a service loop is an elemental structure,…

Machine Learning · Computer Science 2024-10-29 Zefang Zong , Jingwei Wang , Tao Feng , Tong Xia , Depeng Jin , Yong Li

Electric vehicles (EVs) are being actively adopted as a solution to sustainable transportation. However, a bottleneck remains with charging, where two of the main problems are the long charging time and the range anxiety of EV drivers. In…

Applications · Statistics 2022-06-07 Duc Minh Nguyen , Mustafa A. Kishk , Mohamed-Slim Alouini

The increasing demand for autonomous systems in complex and dynamic environments has driven significant research into intelligent path planning methodologies. For decades, graph-based search algorithms, linear programming techniques, and…

Electric Vehicle (EV) is playing a significant role in the distribution energy management systems since the power consumption level of the EVs is much higher than the other regular home appliances. The randomness of the EV driver behaviors…

Machine Learning · Computer Science 2018-02-13 Yingqi Xiong , Bin Wang , Chi-Cheng Chu , Rajit Gadh

The rapid growth of EVs and the subsequent increase in charging demand pose significant challenges for load grid scheduling and the operation of EV charging stations. Effectively harnessing the spatiotemporal correlations among EV charging…

Signal Processing · Electrical Eng. & Systems 2025-06-05 Hang Fan , Mingxuan Li , Jingshi Cui , Zuhan Zhang , Wencai Run , Dunnan Liu

The growing integration of renewable energy sources in modern power systems has introduced significant operational challenges due to their intermittent and uncertain outputs. In recent years, mobile energy storage systems (ESSs) have…

Systems and Control · Electrical Eng. & Systems 2025-07-22 Jun Kang Yap , Vishnu Monn Baskaran , Wen Shan Tan , Ze Yang Ding , Hao Wang , David L. Dowe

Deep reinforcement learning (DRL) algorithms have recently gained wide attention in the wireless networks domain. They are considered promising approaches for solving dynamic radio resource management (RRM) problems in next-generation…

Networking and Internet Architecture · Computer Science 2022-09-29 Ahmad M. Nagib , Hatem Abou-zeid , Hossam S. Hassanein

Path planning is an important problem with the the applications in many aspects, such as video games, robotics etc. This paper proposes a novel method to address the problem of Deep Reinforcement Learning (DRL) based path planning for a…

Robotics · Computer Science 2024-04-11 Hao Liu , Yi Shen , Shuangjiang Yu , Zijun Gao , Tong Wu

Multi-echelon parcel delivery systems using electric vehicles (EVs) are crucial for managing urban logistics complexity and promoting sustainability. In multi-echelon systems, particularly within two-stage systems, larger vehicles transport…

Optimization and Control · Mathematics 2025-06-26 Nima Moradi , Niloufar Mirzavand Boroujeni , Navid Aftabi , Amin Aslani

Wireless network optimization has been becoming very challenging as the problem size and complexity increase tremendously, due to close couplings among network entities with heterogeneous service and resource requirements. By continuously…

Information Theory · Computer Science 2020-01-29 Shimin Gong , Yutong Xie , Jing Xu , Dusit Niyato , Ying-Chang Liang

High renewable penetration has been witnessed in power systems, resulting in reduced system inertia and increasing requirements for frequency response services. Electric vehicles (EVs), owing to their vehicle-to-grid (V2G) capabilities, can…

Systems and Control · Electrical Eng. & Systems 2025-07-25 Yi Wang , Dawei Qiu , Fei Teng , Goran Strbac

The challenges to solving the collision avoidance problem lie in adaptively choosing optimal robot velocities in complex scenarios full of interactive obstacles. In this paper, we propose a distributed approach for multi-robot navigation…

Robotics · Computer Science 2022-03-22 Ruihua Han , Shengduo Chen , Shuaijun Wang , Zeqing Zhang , Rui Gao , Qi Hao , Jia Pan

Connected and Automated Vehicles (CAVs), in particular those with multiple power sources, have the potential to significantly reduce fuel consumption and travel time in real-world driving conditions. In particular, the Eco-driving problem…

Systems and Control · Electrical Eng. & Systems 2023-09-21 Zhaoxuan Zhu , Shobhit Gupta , Abhishek Gupta , Marcello Canova

Vehicle tracking has become one of the key applications of wireless sensor networks (WSNs) in the fields of rescue, surveillance, traffic monitoring, etc. However, the increased tracking accuracy requires more energy consumption. In this…

Systems and Control · Electrical Eng. & Systems 2020-02-25 Jun Li , Zhichao Xing , Weibin Zhang , Yan Lin , Feng Shu

Deep reinforcement learning (DRL), leveraging Deep Learning (DL) in reinforcement learning, has shown significant potential in achieving human-level autonomy in a wide range of domains, including robotics, computer vision, and computer…

Machine Learning · Computer Science 2023-08-25 Ahmed Haj Yahmed , Altaf Allah Abbassi , Amin Nikanjam , Heng Li , Foutse Khomh

Vehicular Edge Computing (VEC) is a promising paradigm to enable huge amount of data and multimedia content to be cached in proximity to vehicles. However, high mobility of vehicles and dynamic wireless channel condition make it challenge…

Cryptography and Security · Computer Science 2020-11-20 Yueyue Dai , Du Xu , Ke Zhang , Sabita Maharjan , Yan Zhang