English
Related papers

Related papers: Hierarchical Deep Double Q-Routing

200 papers

With the rapid increase in demand for mobile data, mobile network operators are trying to expand wireless network capacity by deploying wireless local area network (LAN) hotspots on to which they can offload their mobile traffic. However,…

Networking and Internet Architecture · Computer Science 2018-02-07 Cheng Zhang , Zhi Liu , Bo Gu , Kyoko Yamori , Yoshiaki Tanaka

This study proposes a novel approach for dynamic load balancing in Software-Defined Networks (SDNs) using a Transformer-based Deep Q-Network (DQN). Traditional load balancing mechanisms, such as Round Robin (RR) and Weighted Round Robin…

In this paper we combine one method for hierarchical reinforcement learning - the options framework - with deep Q-networks (DQNs) through the use of different "option heads" on the policy network, and a supervisory network for choosing…

Machine Learning · Computer Science 2017-06-20 Kai Arulkumaran , Nat Dilokthanakul , Murray Shanahan , Anil Anthony Bharath

This paper presents a predictive deep learning framework for dynamic sub-band allocation in Sub-Band Full Duplex (SBFD) systems, addressing the challenge of balancing uplink (UL) and downlink (DL) performance under highly dynamic traffic…

Networking and Internet Architecture · Computer Science 2026-05-15 Abhiram D , Aiswarya Rajan , Arin Shemeem , Vipindev Adat Vasudevan , Abdulla P

In distributed optimization, the practical problem-solving performance is essentially sensitive to algorithm selection, parameter setting, problem type and data pattern. Thus, it is often laborious to acquire a highly efficient method for a…

Optimization and Control · Mathematics 2024-01-04 Daokuan Zhu , Tianqi Xu , Jie Lu

In an RF-powered backscatter cognitive radio network, multiple secondary users communicate with a secondary gateway by backscattering or harvesting energy and actively transmitting their data depending on the primary channel state. To…

Machine Learning · Computer Science 2018-10-11 Tran The Anh , Nguyen Cong Luong , Dusit Niyato , Ying-Chang Liang , Dong In Kim

Autonomous driving is a promising technology to reduce traffic accidents and improve driving efficiency. In this work, a deep reinforcement learning (DRL)-enabled decision-making policy is constructed for autonomous vehicles to address the…

Signal Processing · Electrical Eng. & Systems 2020-07-20 Jiangdong Liao , Teng Liu , Xiaolin Tang , Xingyu Mu , Bing Huang , Dongpu Cao

Customer services are critical to all companies, as they may directly connect to the brand reputation. Due to a great number of customers, e-commerce companies often employ multiple communication channels to answer customers' questions, for…

Machine Learning · Computer Science 2019-12-03 Zining Liu , Chong Long , Xiaolu Lu , Zehong Hu , Jie Zhang , Yafang Wang

Planning coverage path for multiple robots in a decentralized way enhances robustness to coverage tasks handling uncertain malfunctions. To achieve high efficiency in a distributed manner for each single robot, a comprehensive understanding…

Robotics · Computer Science 2022-10-17 Yongkai Liu , Jiawei Hu , Wei Dong

Due to emerging real-time and multimedia applications, efficient routing of information packets in dynamically changing communication network requires that as the load levels, traffic patterns and topology of the network change, the routing…

Networking and Internet Architecture · Computer Science 2008-12-18 Said Hoceini , Abdelhamid Mellouk , Hayet Hafi

Nowadays, as the need for capacity continues to grow, entirely novel services are emerging. A solid cloud-network integrated infrastructure is necessary to supply these services in a real-time responsive, and scalable way. Due to their…

Networking and Internet Architecture · Computer Science 2023-09-20 Masoud Shokrnezhad , Tarik Taleb , Patrizio Dazzi

Recently, multiagent deep reinforcement learning (DRL) has received increasingly wide attention. Existing multiagent DRL algorithms are inefficient when facing with the non-stationarity due to agents update their policies simultaneously in…

Multiagent Systems · Computer Science 2018-04-17 Yan Zheng , Jianye Hao , Zongzhang Zhang

The quantum cloud computing paradigm presents unique challenges in task placement due to the dynamic and heterogeneous nature of quantum computation resources. Traditional heuristic approaches fall short in adapting to the rapidly evolving…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-04 Hoa T. Nguyen , Muhammad Usman , Rajkumar Buyya

Caching is envisioned to play a critical role in next-generation content delivery infrastructure, cellular networks, and Internet architectures. By smartly storing the most popular contents at the storage-enabled network entities during…

Information Theory · Computer Science 2019-07-12 Alireza Sadeghi , Gang Wang , Georgios B. Giannakis

Resource allocation remains NP-hard due to combinatorial complexity. While deep reinforcement learning (DRL) methods, such as the Rainbow Deep Q-Network (DQN), improve scalability through prioritized replay and distributional heads,…

Artificial Intelligence · Computer Science 2025-12-08 Truong Thanh Hung Nguyen , Truong Thinh Nguyen , Hung Cao

Resource allocation has a direct and profound impact on the performance of vehicle-to-everything (V2X) networks. Considering the dynamic nature of vehicular environments, it is appealing to devise a decentralized strategy to perform…

Networking and Internet Architecture · Computer Science 2019-08-12 Liang Wang , Hao Ye , Le Liang , Geoffrey Ye Li

The transport capacity of a communication network can be characterized by the transition from a free-flow state to a congested state. Here, we propose a dynamic routing strategy in complex networks based on hierarchical bypass selections.…

Multiagent Systems · Computer Science 2022-07-05 Shiyuan Hu , Shihan Xiao

This paper presents a hierarchical path-planning and control framework that combines a high-level Deep Q-Network (DQN) for discrete sub-goal selection with a low-level Twin Delayed Deep Deterministic Policy Gradient (TD3) controller for…

Robotics · Computer Science 2025-10-31 Xiaoyi He , Danggui Chen , Zhenshuo Zhang , Zimeng Bai

Packet routing is one of the fundamental problems in computer networks in which a router determines the next-hop of each packet in the queue to get it as quickly as possible to its destination. Reinforcement learning (RL) has been…

Networking and Internet Architecture · Computer Science 2019-11-15 Xinyu You , Xuanjie Li , Yuedong Xu , Hui Feng , Jin Zhao , Huaicheng Yan

Deep Q-learning Network (DQN) is a successful way which combines reinforcement learning with deep neural networks and leads to a widespread application of reinforcement learning. One challenging problem when applying DQN or other…

Machine Learning · Computer Science 2022-09-19 Zhe Zhang , Yukun Zou , Junjie Lai , Qing Xu