English
Related papers

Related papers: Edge-DIRECT: A Deep Reinforcement Learning-based M…

200 papers

An electric vehicle charging station (EVCS) infrastructure is the backbone of transportation electrification. However, the EVCS has myriads of exploitable vulnerabilities in software, hardware, supply chain, and incumbent legacy…

Systems and Control · Electrical Eng. & Systems 2022-07-15 M. Basnet , MH Ali

With the recent advances in mobile energy storage technologies, electric vehicles (EVs) have become a crucial part of smart grids. When EVs participate in the demand response program, the charging cost can be significantly reduced by taking…

Systems and Control · Electrical Eng. & Systems 2022-10-05 Zixuan Zhang , Yuning Jiang , Yuanming Shi , Ye Shi , Wei Chen

This paper introduces and formalizes the Dynamic and Stochastic Vehicle Routing Problem with Emission Quota (DS-QVRP-RR), a novel routing problems that integrates dynamic demand acceptance and routing with a global emission constraint. A…

Machine Learning · Computer Science 2026-03-17 Farid Najar , Dominique Barth , Yann Strozecki

This letter presents a novel deep reinforcement learning (DRL) approach for joint time allocation and power control in a cognitive Internet of Things (CIoT) system with simultaneous wireless information and power transfer (SWIPT). The CIoT…

Signal Processing · Electrical Eng. & Systems 2025-12-18 Nadia Abdolkhani , Nada Abdel Khalek , Walaa Hamouda , Iyad Dayoub

Energy management systems (EMS) are becoming increasingly important in order to utilize the continuously growing curtailed renewable energy. Promising energy storage systems (ESS), such as batteries and green hydrogen should be employed to…

Machine Learning · Computer Science 2022-12-13 Dongju Kang , Doeun Kang , Sumin Hwangbo , Haider Niaz , Won Bo Lee , J. Jay Liu , Jonggeol Na

Logistics and transport are core of many industrial and business processes. One of the most promising segments in the field is optimisation of vehicle routes. Scientific effort is focused primarily on algorithms developed in simplified…

Optimization and Control · Mathematics 2024-03-08 Nikica Peric , Slaven Begovic , Vinko Lesic

Autonomous driving is a promising technology to reduce traffic accidents and improve driving efficiency. In this work, a deep reinforcement learning (DRL)-enabled decision-making policy is constructed for autonomous vehicles to address the…

Signal Processing · Electrical Eng. & Systems 2020-07-20 Jiangdong Liao , Teng Liu , Xiaolin Tang , Xingyu Mu , Bing Huang , Dongpu Cao

Balancing mutually diverging performance metrics, such as, processing latency, outcome accuracy, and end device energy consumption is a challenging undertaking for deep learning model inference in ad-hoc edge environments. In this paper, we…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-17 Motahare Mounesan , Xiaojie Zhang , Saptarshi Debroy

Global routing has been a historically challenging problem in electronic circuit design, where the challenge is to connect a large and arbitrary number of circuit components with wires without violating the design rules for the printed…

Machine Learning · Computer Science 2019-06-24 Haiguang Liao , Wentai Zhang , Xuliang Dong , Barnabas Poczos , Kenji Shimada , Levent Burak Kara

Detailed routing remains one of the most complex and time-consuming steps in modern physical design due to the challenges posed by shrinking feature sizes and stricter design rules. Prior detailed routers achieve state-of-the-art results by…

Hardware Architecture · Computer Science 2025-12-04 Afsara Khan , Austin Rovinski

This paper introduces a Deep Reinforcement Learning (DRL) based TCP congestion-control algorithm that uses a Deep Q-Network (DQN) to adapt the congestion window (cWnd) dynamically based on observed network state. The proposed approach…

Networking and Internet Architecture · Computer Science 2026-01-21 Efe Ağlamazlar , Emirhan Eken , Harun Batur Geçici

We develop a heuristic for the Consistent Vehicle Routing Problem with Time Windows (ConVRPTW), which is motivated by a real-world application at a food company's distribution center. Besides standard VRPTW restrictions, ConVRPTW assigns…

Artificial Intelligence · Computer Science 2020-12-08 Hernán Lespay , Karol Suchan

In today's era, autonomous vehicles demand a safety level on par with aircraft. Taking a cue from the aerospace industry, which relies on redundancy to achieve high reliability, the automotive sector can also leverage this concept by…

Machine Learning · Computer Science 2023-10-09 Fouzi Boukhalfa , Reda Alami , Mastane Achab , Eric Moulines , Mehdi Bennis

The recently emerging multi-mode plug-in hybrid electric vehicle (PHEV) technology is one of the pathways making contributions to decarbonization, and its energy management requires multiple-input and multipleoutput (MIMO) control. At the…

Robotics · Computer Science 2023-08-29 Min Hua , Cetengfei Zhang , Fanggang Zhang , Zhi Li , Xiaoli Yu , Hongming Xu , Quan Zhou

Deep Reinforcement Learning (DRL) algorithms have been successfully applied to a range of challenging control tasks. However, these methods typically suffer from three core difficulties: temporal credit assignment with sparse rewards, lack…

Machine Learning · Computer Science 2018-10-30 Shauharda Khadka , Kagan Tumer

In this paper, we present the Electric Mobility Dial-a-Ride Problem (EM-DARP), which extends the Electric Vehicle Dial-a-Ride Problem (EV-DARP) to better accommodate human-focused mobility services. The problem involves utilizing a fleet of…

Systems and Control · Electrical Eng. & Systems 2026-04-27 Mostafa Emam , Björn Martens , Thomas Rottmann , Matthias Gerdts

This paper considers the problem of cost-aware downlink sum-rate maximization via joint optimal radio access technologies (RATs) assignment and power allocation in next-generation heterogeneous wireless networks (HetNets). We consider a…

Signal Processing · Electrical Eng. & Systems 2025-07-04 Abdulmalik Alwarafy , Bekir Sait Ciftler , Mohamed Abdallah , Mounir Hamdi , Naofal Al-Dhahir

Routing problems are a class of combinatorial problems with many practical applications. Recently, end-to-end deep learning methods have been proposed to learn approximate solution heuristics for such problems. In contrast, classical…

Machine Learning · Computer Science 2021-12-06 Wouter Kool , Herke van Hoof , Joaquim Gromicho , Max Welling

Overtaking on two-lane roads is a great challenge for autonomous vehicles, as oncoming traffic appearing on the opposite lane may require the vehicle to change its decision and abort the overtaking. Deep reinforcement learning (DRL) has…

Robotics · Computer Science 2023-08-21 Jinxiong Lu , Gokhan Alcan , Ville Kyrki

Graph problems such as traveling salesman problem, or finding minimal Steiner trees are widely studied and used in data engineering and computer science. Typically, in real-world applications, the features of the graph tend to change over…

Machine Learning · Computer Science 2022-01-14 Udesh Gunarathna , Renata Borovica-Gajic , Shanika Karunasekara , Egemen Tanin