English
Related papers

Related papers: Digital-Twin Empowered Deep Reinforcement Learning…

200 papers

Base station (BS) association and beam selection in multi-cell drone corridor networks present unique challenges due to the high altitude, mobility and three-dimensional movement of drones. These factors lead to frequent handovers and…

Information Theory · Computer Science 2025-07-08 Pulok Tarafder , Imtiaz Ahmed , Danda B. Rawat , Md. Zoheb Hassan , Kamrul Hasan

This article presents a digital twin (DT)-enhanced reinforcement learning (RL) framework aimed at optimizing performance and reliability in network resource management, since the traditional RL methods face several unified challenges when…

Systems and Control · Electrical Eng. & Systems 2024-06-18 Nan Cheng , Xiucheng Wang , Zan Li , Zhisheng Yin , Tom Luan , Xuemin Shen

Deep Reinforcement Learning (DRL) is widely used to optimize the performance of multi-UAV networks. However, the training of DRL relies on the frequent interactions between the UAVs and the environment, which consumes lots of energy due to…

Machine Learning · Computer Science 2023-10-26 Xiucheng Wang , Nan Cheng , Longfei Ma , Zhisheng Yin , Tom. Luan , Ning Lu

In this paper, we study a digital twin (DT)-empowered integrated sensing, communication, and computation network. Specifically, the users perform radar sensing and computation offloading on the same spectrum, while unmanned aerial vehicles…

Signal Processing · Electrical Eng. & Systems 2023-10-27 Bin Li , Wenshuai Liu , Wancheng Xie , Ning Zhang , Yan Zhang

In this paper, we investigate a novel digital network twin (DNT) assisted deep learning (DL) model training framework. In particular, we consider a physical network where a base station (BS) uses several antennas to serve multiple mobile…

Networking and Internet Architecture · Computer Science 2026-03-11 Hanzhi Yu , Hasan Farooq , Julien Forgeat , Shruti Bothe , Kristijonas Cyras , Md Moin Uddin Chowdhury , Mingzhe Chen

Task scheduling is a critical problem when one user offloads multiple different tasks to the edge server. When a user has multiple tasks to offload and only one task can be transmitted to server at a time, while server processes tasks…

Machine Learning · Computer Science 2022-08-05 Xiucheng Wang , Longfei Ma , Haocheng Li , Zhisheng Yin , Tom. Luan , Nan Cheng

In this paper, we design a resource management scheme to support stateful applications, which will be prevalent in 6G networks. Different from stateless applications, stateful applications require context data while executing computing…

Networking and Internet Architecture · Computer Science 2022-12-08 Conghao Zhou , Jie Gao , Mushu Li , Xuemin , Shen , Weihua Zhuang

Realizing the potential gains of large-scale MIMO systems requires the accurate estimation of their channels or the fine adjustment of their narrow beams. This, however, is typically associated with high channel acquisition/beam sweeping…

Signal Processing · Electrical Eng. & Systems 2023-01-19 Shuaifeng Jiang , Ahmed Alkhateeb

Optimizing modern wireless networks is exceptionally challenging due to their high dynamism and complexity. While the agentic artificial intelligence (AI) powered by reinforcement learning (RL) offers a promising solution, its practical…

Systems and Control · Electrical Eng. & Systems 2025-11-26 Zhenyu Tao , Wei Xu , Xiaohu You

Network slicing-based communication systems can dynamically and efficiently allocate resources for diversified services. However, due to the limitation of the network interface on channel access and the complexity of the resource…

Networking and Internet Architecture · Computer Science 2023-11-29 Zhengming Zhang , Yongming Huang , Cheng Zhang , Qingbi Zheng , Luxi Yang , Xiaohu You

Next-generation (NextG) wireless networks are expected to require intelligent, scalable, and context-aware radio resource management (RRM) to support ultra-dense deployments, diverse service requirements, and dynamic network conditions.…

Signal Processing · Electrical Eng. & Systems 2025-06-24 Majumder Haider , Imtiaz Ahmed , Zoheb Hassan , Kamrul Hasan , H. Vincent Poor

Beamforming enhances signal strength and quality by focusing energy in specific directions. This capability is particularly crucial in cell-free integrated sensing and communication (ISAC) systems, where multiple distributed access points…

Emerging Technologies · Computer Science 2026-01-21 Jiexin Zhang , Shu Xu , Chunguo Li , Yongming Huang , Luxi Yang

Optimization of user association in a densely deployed cellular network is usually challenging and even more complicated due to the dynamic nature of user mobility and fluctuation in user counts. While deep reinforcement learning (DRL)…

Machine Learning · Computer Science 2025-05-19 Zhenyu Tao , Wei Xu , Xiaohu You

Reinforcement Learning (RL) or Deep Reinforcement Learning (DRL) is a powerful approach to solving Markov Decision Processes (MDPs) when the model of the environment is not known a priori. However, RL models are still faced with challenges…

Systems and Control · Electrical Eng. & Systems 2024-06-04 Kabirat Olayemi , Mien Van , Luke Maguire , Sean McLoone

In this paper, we investigate a resource allocation and model retraining problem for dynamic wireless networks by utilizing incremental learning, in which the digital twin (DT) scheme is employed for decision making. A two-timescale…

Signal Processing · Electrical Eng. & Systems 2024-11-28 Jiayi Cong , Guoliang Cheng , Changsheng You , Xinyu Huang , Wen Wu

Reconfigurable intelligent surfaces (RISs) are envisioned to play a key role in future wireless communication networks. However, channel estimation in RIS-aided wireless networks is challenging due to their passive nature and the large…

Signal Processing · Electrical Eng. & Systems 2024-06-21 Sadjad Alikhani , Ahmed Alkhateeb

As 5G and future 6G mobile networks become increasingly more sophisticated, the requirements for agility, scalability, resilience, and precision in real-time service provisioning cannot be met using traditional and heuristic-based resource…

Networking and Internet Architecture · Computer Science 2026-01-08 John Sengendo , Fabrizio Granelli

In the context of communication networks, digital twin technology provides a means to replicate the radio frequency (RF) propagation environment as well as the system behaviour, allowing for a way to optimize the performance of a deployed…

Signal Processing · Electrical Eng. & Systems 2024-02-01 Maximilian Arnold , Bence Major , Fabio Valerio Massoli , Joseph B. Soriaga , Arash Behboodi

Unmanned aerial vehicles (UAVs) enhance coverage and provide flexible deployment in 5G and next-generation wireless networks. The performance of such wireless networks can be improved by developing new navigation and wireless adaptation…

Networking and Internet Architecture · Computer Science 2025-03-12 Md Sharif Hossen , Anil Gurses , Mihail Sichitiu , Ismail Guvenc

Effective channel estimation in sparse and high-dimensional environments is essential for next-generation wireless systems, particularly in large-scale MIMO deployments. This paper introduces a novel framework that leverages digital twins…

Signal Processing · Electrical Eng. & Systems 2025-04-10 Sadjad Alikhani , Ahmed Alkhateeb
‹ Prev 1 2 3 10 Next ›