English
Related papers

Related papers: Energy-Efficient Routing Protocol in Vehicular Opp…

200 papers

Deep reinforcement learning (DRL) has been proven its efficiency in capturing users' dynamic interests in recent literature. However, training a DRL agent is challenging, because of the sparse environment in recommender systems (RS), DRL…

Information Retrieval · Computer Science 2022-09-20 Xiaocong Chen , Siyu Wang , Lina Yao , Lianyong Qi , Yong Li

Urban railway systems increasingly rely on communication based train control (CBTC) systems, where optimal deployment of access points (APs) in tunnels is critical for robust wireless coverage. Traditional methods, such as empirical…

Signal Processing · Electrical Eng. & Systems 2025-09-30 Kunyu Wu , Qiushi Zhao , Zihan Feng , Yunxi Mu , Hao Qin , Xinyu Zhang , Xingqi Zhang

The increasing device heterogeneity and decentralization requirements in the computing continuum (i.e., spanning edge, fog, and cloud) introduce new challenges in resource orchestration. In such environments, agents are often responsible…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-23 Vlad Popescu-Vifor , Ilir Murturi , Praveen Kumar Donta , Schahram Dustdar

Deep reinforcement learning (DRL) finds extensive application in autonomous drone navigation within complex, high-risk environments. However, its practical deployment faces a safety-exploration dilemma: soft penalty mechanisms encourage…

Robotics · Computer Science 2026-05-04 Wentao Chen , Jingtang Chen , Mingjian Fu , Tiantian Li , Youfeng Su , Wenxi Liu , Yuanlong Yu

The traveling purchaser problem (TPP) is an important combinatorial optimization problem with broad applications. Due to the coupling between routing and purchasing, existing works on TPPs commonly address route construction and purchase…

Optimization and Control · Mathematics 2025-07-03 Haofeng Yuan , Rongping Zhu , Wanlu Yang , Shiji Song , Keyou You , Wei Fan , C. L. Philip Chen

This paper develops an inherently parallelised, fast, approximate learning-based solution to the generic class of Capacitated Vehicle Routing Problems with Time Windows and Dynamic Routing (CVRP-TWDR). Considering vehicles in a fleet as…

Artificial Intelligence · Computer Science 2021-04-15 Nazneen N Sultana , Vinita Baniwal , Ansuma Basumatary , Piyush Mittal , Supratim Ghosh , Harshad Khadilkar

Integrating Unmanned Aerial Vehicles (UAVs) with Unmanned Ground Vehicles (UGVs) provides an effective solution for persistent surveillance in disaster management. UAVs excel at covering large areas rapidly, but their range is limited by…

Robotics · Computer Science 2025-02-06 Md Safwan Mondal , Subramanian Ramasamy , Pranav Bhounsule

This paper presents a multi-agent Deep Reinforcement Learning (DRL) framework for autonomous control and integration of renewable energy resources into smart power grid systems. In particular, the proposed framework jointly considers demand…

The Internet of Things (IoT) has been continuously rising in the past few years, and its potentials are now more apparent. However, transient data generation and limited energy resources are the major bottlenecks of these networks. Besides,…

Networking and Internet Architecture · Computer Science 2022-03-25 Hongda Wu , Ali Nasehzadeh , Ping Wang

Flexible demand response (DR) resources can be leveraged to accommodate the stochasticity of some distributed energy resources. This paper develops an online learning approach that continuously estimates price sensitivities of residential…

Systems and Control · Computer Science 2020-04-28 Robert Mieth , Yury Dvorkin

Next Generation (NextG) networks are expected to support demanding tactile internet applications such as augmented reality and connected autonomous vehicles. Whereas recent innovations bring the promise of larger link capacity, their…

Machine Learning · Computer Science 2021-12-08 Peyman Tehrani , Francesco Restuccia , Marco Levorato

In multi-agent informative path planning (MAIPP), agents must collectively construct a global belief map of an underlying distribution of interest (e.g., gas concentration, light intensity, or pollution levels) over a given domain, based on…

Robotics · Computer Science 2023-10-25 Tianze Yang , Yuhong Cao , Guillaume Sartoretti

Traffic scenarios in roundabouts pose substantial complexity for automated driving. Manually mapping all possible scenarios into a state space is labor-intensive and challenging. Deep reinforcement learning (DRL) with its ability to learn…

Robotics · Computer Science 2023-06-21 Henan Yuan , Penghui Li , Bart van Arem , Liujiang Kang , Yongqi Dong

Effective planning in model-based reinforcement learning (MBRL) and model-predictive control (MPC) relies on the accuracy of the learned dynamics model. In many instances of MBRL and MPC, this model is assumed to be stationary and is…

Machine Learning · Computer Science 2026-05-27 Yizhou Huang , Kevin Xie , Homanga Bharadhwaj , Florian Shkurti

Opportunistic routing relies on the broadcast capability of wireless networks. It brings higher reliability and robustness in highly dynamic and/or severe environments such as mobile or vehicular ad-hoc networks (MANETs/VANETs). To reduce…

Networking and Internet Architecture · Computer Science 2023-06-19 Saeed Kaviani , Bo Ryu , Ejaz Ahmed , Deokseong Kim , Jae Kim , Carrie Spiker , Blake Harnden

Developing an automated driving system capable of navigating complex traffic environments remains a formidable challenge. Unlike rule-based or supervised learning-based methods, Deep Reinforcement Learning (DRL) based controllers eliminate…

Machine Learning · Computer Science 2025-01-28 Zhihao Zhang , Ekim Yurtsever , Keith A. Redmill

The open radio access network (O-RAN) architecture supports intelligent network control algorithms as one of its core capabilities. Data-driven applications incorporate such algorithms to optimize radio access network (RAN) functions via…

Networking and Internet Architecture · Computer Science 2023-09-20 Ahmad M. Nagib , Hatem Abou-Zeid , Hossam S. Hassanein

Developing an autonomous vehicle control strategy for signalised intersections (SI) is one of the challenging tasks due to its inherently complex decision-making process. This study proposes a Deep Reinforcement Learning (DRL) based…

Artificial Intelligence · Computer Science 2025-05-15 Pankaj Kumar , Aditya Mishra , Pranamesh Chakraborty , Subrahmanya Swamy Peruru

Unmanned aerial vehicles (UAVs) are playing an increasingly pivotal role in modern communication networks,offering flexibility and enhanced coverage for a variety of applica-tions. However, UAV networks pose significant challenges due to…

Networking and Internet Architecture · Computer Science 2025-02-19 Wei Zhao , Shaoxin Cui , Wen Qiu , Zhiqiang He , Zhi Liu , Xiao Zheng , Bomin Mao , Nei Kato

This study focuses on optimizing path planning for unmanned ground vehicles (UGVs) in precision agriculture using deep reinforcement learning (DRL) techniques in continuous action spaces. The research begins with a review of traditional…

Robotics · Computer Science 2026-01-09 Laukik Patade , Rohan Rane , Sandeep Pillai