English
Related papers

Related papers: Continual Reinforcement Learning for Digital Twin …

200 papers

Intelligent wireless networks have long been expected to have self-configuration and self-optimization capabilities to adapt to various environments and demands. In this paper, we develop a novel distributed hierarchical deep reinforcement…

Signal Processing · Electrical Eng. & Systems 2023-12-06 Kaiwen Yu , Chonghao Zhao , Gang Wu , Geoffrey Ye Li

This paper studies the allocation of shared resources between vehicle-to-infrastructure (V2I) and vehicle-to-vehicle (V2V) links in vehicle-to-everything (V2X) communications. In existing algorithms, dynamic vehicular environments and…

Information Theory · Computer Science 2021-10-18 Yi Yuan , Gan Zheng , Kai-Kit Wong , Khaled B. Letaief

Due to the scarcity in the wireless spectrum and limited energy resources especially in mobile applications, efficient resource allocation strategies are critical in wireless networks. Motivated by the recent advances in deep reinforcement…

Information Theory · Computer Science 2021-12-30 Ziyang Lu , Chen Zhong , M. Cenk Gursoy

There has been a growing interest in developing data-driven, and in particular deep neural network (DNN) based methods for modern communication tasks. For a few popular tasks such as power control, beamforming, and MIMO detection, these…

Signal Processing · Electrical Eng. & Systems 2022-05-11 Haoran Sun , Wenqiang Pu , Xiao Fu , Tsung-Hui Chang , Mingyi Hong

Deep Reinforcement Learning (DRL) is widely used to optimize the performance of multi-UAV networks. However, the training of DRL relies on the frequent interactions between the UAVs and the environment, which consumes lots of energy due to…

Machine Learning · Computer Science 2023-10-26 Xiucheng Wang , Nan Cheng , Longfei Ma , Zhisheng Yin , Tom. Luan , Ning Lu

The uncertainties from distributed energy resources (DERs) bring significant challenges to the real-time operation of microgrids. In addition, due to the nonlinear constraints in the AC power flow equation and the nonlinearity of the…

Systems and Control · Electrical Eng. & Systems 2023-04-06 Hang Shuai , Xiaomeng Ai , Jiakun Fang , Wei Yao , Jinyu Wen

Reinforcement learning (RL) is currently one of the most prominent methods for optimizing dynamical systems, with breakthrough results across various fields. The framework is based on the concept of a Markov decision process (MDP), leading…

Optimization and Control · Mathematics 2025-11-17 Rene Carmona , Mathieu Lauriere

Federated Reinforcement Learning (FRL) has been deemed as a promising solution for intelligent decision-making in the era of Artificial Internet of Things. However, existing FRL approaches often entail repeated interactions with the…

Machine Learning · Computer Science 2024-05-30 Sheng Yue , Zerui Qin , Xingyuan Hua , Yongheng Deng , Ju Ren

In distributed optimization, the practical problem-solving performance is essentially sensitive to algorithm selection, parameter setting, problem type and data pattern. Thus, it is often laborious to acquire a highly efficient method for a…

Optimization and Control · Mathematics 2024-01-04 Daokuan Zhu , Tianqi Xu , Jie Lu

Beamforming enhances signal strength and quality by focusing energy in specific directions. This capability is particularly crucial in cell-free integrated sensing and communication (ISAC) systems, where multiple distributed access points…

Emerging Technologies · Computer Science 2026-01-21 Jiexin Zhang , Shu Xu , Chunguo Li , Yongming Huang , Luxi Yang

The model-based power allocation algorithm has been investigated for decades, but it requires the mathematical models to be analytically tractable and it usually has high computational complexity. Recently, the data-driven model-free…

Information Theory · Computer Science 2019-01-23 Fan Meng , Peng Chen , Lenan Wu , Julian Cheng

In this paper, a deep reinforcement learning (DRL) method is proposed to address the problem of UAV navigation in an unknown environment. However, DRL algorithms are limited by the data efficiency problem as they typically require a huge…

Robotics · Computer Science 2020-08-07 Lei He , Nabil Aouf , James F. Whidborne , Bifeng Song

Deep reinforcement learning (DRL) has attracted much attention as an approach to solve optimal control problems without mathematical models of systems. On the other hand, in general, constraints may be imposed on optimal control problems.…

Machine Learning · Statistics 2022-11-22 Junya Ikemoto , Toshimitsu Ushio

In this paper, we tackle the task of adaptive time allocation in integrated sensing and communication systems equipped with radar and communication units. The dual-functional radar-communication system's task involves allocating dwell times…

Machine Learning · Computer Science 2025-06-27 Ziyang Lu , M. Cenk Gursoy , Chilukuri K. Mohan , Pramod K. Varshney

Digital twin (DT)-driven deep reinforcement learning (DRL) has emerged as a promising paradigm for wireless network optimization, offering safe and efficient training environment for policy exploration. However, in theory existing methods…

Machine Learning · Computer Science 2025-02-26 Zhenyu Tao , Wei Xu , Xiaohu You

With the advent of 5G and the research into beyond 5G (B5G) networks, a novel and very relevant research issue is how to manage the coexistence of different types of traffic, each with very stringent but completely different requirements.…

Signal Processing · Electrical Eng. & Systems 2026-03-16 Fabio Saggese , Luca Pasqualini , Marco Moretti , Andrea Abrardo

Urban railway systems increasingly rely on communication based train control (CBTC) systems, where optimal deployment of access points (APs) in tunnels is critical for robust wireless coverage. Traditional methods, such as empirical…

Signal Processing · Electrical Eng. & Systems 2025-09-30 Kunyu Wu , Qiushi Zhao , Zihan Feng , Yunxi Mu , Hao Qin , Xinyu Zhang , Xingqi Zhang

Efficient task scheduling in large-scale distributed systems presents significant challenges due to dynamic workloads, heterogeneous resources, and competing quality-of-service requirements. Traditional centralized approaches face…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-27 Daniel Benniah John

This study addresses the challenge of optimal power allocation in stochastic wireless networks by employing a Deep Reinforcement Learning (DRL) framework. Specifically, we design a Deep Q-Network (DQN) agent capable of learning adaptive…

Networking and Internet Architecture · Computer Science 2026-01-09 Marie Diane Iradukunda , Chabi F. Elégbédé , Yaé Ulrich Gaba

Device-to-device (D2D) technology enables direct communication between adjacent devices within cellular networks. Due to its high data rate, low latency, and performance improvement in spectrum and energy efficiency, it has been widely…

Networking and Internet Architecture · Computer Science 2024-10-07 Yang Yu , Xiaoqing Tang