English
Related papers

Related papers: Digital-Twin Empowered Deep Reinforcement Learning…

200 papers

The emergence of beyond 5G (B5G) and 6G networks underscores the critical role of advanced computer-aided tools, such as network digital twins (DTs), in fostering autonomous networks and ubiquitous intelligence. Existing solutions in the DT…

Networking and Internet Architecture · Computer Science 2024-09-04 Caglar Tunc , Kubra Duran , Buse Bilgin , Gokhan Kalem , Berk Canberk

Exploiting unmanned aerial vehicles (UAVs) to execute tasks is gaining growing popularity recently. To solve the underlying task scheduling problem, the deep reinforcement learning (DRL) based methods demonstrate notable advantage over the…

Machine Learning · Computer Science 2023-06-07 Xiao Mao , Zhiguang Cao , Mingfeng Fan , Guohua Wu , Witold Pedrycz

The growing demand for services and the rapid deployment of virtualized network functions (VNFs) pose significant challenges for achieving low-latency and energy-efficient orchestration in modern edge-core network infrastructures. To…

Networking and Internet Architecture · Computer Science 2026-01-22 Faisal Ahmed , Suresh Subramaniam , Motoharu Matsuura , Hiroshi Hasegawa , Shih-Chun Lin

Multi-agent reinforcement learning (MARL) for cyber-physical vehicle systems usually requires a significantly long training time due to their inherent complexity. Furthermore, deploying the trained policies in the real world demands a…

Robotics · Computer Science 2026-02-24 Chinmay Vilas Samak , Tanmay Vilas Samak , Venkat Narayan Krovi

Deep learning (DL) techniques have demonstrated strong performance in compressing and reconstructing channel state information (CSI) while reducing feedback overhead in massive MIMO systems. A key challenge, however, is their reliance on…

Signal Processing · Electrical Eng. & Systems 2025-10-01 Hao Luo , Shuaifeng Jiang , Saeed R. Khosravirad , Ahmed Alkhateeb

Wi-Fi networks increasingly suffer from performance degradation caused by contention-based channel access, dense deployments, and largely self-managed operation among mutually interfering access points (APs). In this paper, we propose a…

Networking and Internet Architecture · Computer Science 2026-01-21 Jiunn-Tsair Chen

Digital Twin (DT) technology enables real-time monitoring and optimization of complex network infrastructures by creating accurate virtual replicas of physical systems. In millimeter-wave (mmWave) 5G/6G networks, the deployment of…

Networking and Internet Architecture · Computer Science 2025-09-17 Jie Zhang , Mostafa Rahmani Ghourtani , Swarna Bindu Chetty , Paul Daniel Mitchell , Hamed Ahmadi

Digital twins (DTs), virtual simulated replicas of physical scenes, are transforming various industries. However, their potential in radio frequency (RF) sensing applications has been limited by the unidirectional nature of conventional RF…

Signal Processing · Electrical Eng. & Systems 2025-08-21 Xingyu Chen , Jianrong Ding , Kai Zheng , Xinmin Fang , Xinyu Zhang , Chris Xiaoxuan Lu , Zhengxiong Li

The explosive growth in wireless service demand has prompted the evolution of integrated satellite-terrestrial networks (ISTNs) to overcome the limitations of traditional terrestrial networks (TNs) in terms of coverage, spectrum efficiency,…

Signal Processing · Electrical Eng. & Systems 2026-02-11 Hung Nguyen-Kha , Vu Nguyen Ha , Ti Nguyen , Eva Lagunas , Joel Grotz , Symeon Chatzinotas , Björn Ottersten

Commonly adopted in the manufacturing and aerospace sectors, digital twin (DT) platforms are increasingly seen as a promising paradigm to control and monitor software-based, "open", communication systems, which play the role of the physical…

Signal Processing · Electrical Eng. & Systems 2023-01-30 Clement Ruah , Osvaldo Simeone , Bashir Al-Hashimi

Digital twin (DT) technology can replicate physical entities in cyberspace. A mobility DT digitalizes connected and autonomous vehicles (CAVs) and their surrounding traffic environment, allowing to monitor the maneuvering and distribution…

Networking and Internet Architecture · Computer Science 2024-09-04 Supat Roongpraiwan , Zongdian Li , Tao Yu , Kei Sakaguchi

To meet the demands for ubiquitous communication and temporary edge computing in 6G networks, aerial mobile edge computing (MEC) networks have been envisioned as a new paradigm. However, dynamic user requests pose challenges for task…

Networking and Internet Architecture · Computer Science 2024-10-29 Xin Tang , Qian Chen , Rong Yu , Xiaohuan Li

Autonomous navigation in underwater environments remains a major challenge due to the absence of GPS, degraded visibility, and the presence of submerged obstacles. This article investigates these issues through the case of the BlueROV2, an…

Machine Learning · Computer Science 2025-12-12 Zamirddine Mari , Mohamad Motasem Nawaf , Pierre Drap

With the development of satellite communication technology, satellite-terrestrial integrated networks (STIN), which integrate satellite networks and ground networks, can realize seamless global coverage of communication services.…

Networking and Internet Architecture · Computer Science 2024-09-10 Yihong Tao , Bo Lei , Haoyang Shi , Jingkai Chen , Xing Zhang

Digital twin (DT)-driven deep reinforcement learning (DRL) has emerged as a promising paradigm for wireless network optimization, offering safe and efficient training environment for policy exploration. However, in theory existing methods…

Machine Learning · Computer Science 2025-02-26 Zhenyu Tao , Wei Xu , Xiaohu You

Low-Earth orbit (LEO) satellites utilizing beam hopping (BH) technology offer extensive coverage, low latency, high bandwidth, and significant flexibility. However, the uneven geographical distribution and temporal variability of ground…

Signal Processing · Electrical Eng. & Systems 2024-11-15 Ruili Zhao , Jun Cai , Jiangtao Luo , Junpeng Gao , Yongyi Ran

Unmanned aerial vehicles (UAVs) can be utilized as aerial base stations (ABSs) to assist terrestrial infrastructure for keeping wireless connectivity in various emergency scenarios. To maximize the coverage rate of N ground users (GUs) by…

Information Theory · Computer Science 2020-02-06 Jin Qiu , Jiangbin Lyu , Liqun Fu

The highly dynamic nature of vehicular networks necessitates proactive and site-specific radio resource management (RRM) to achieve ultra-reliable low-latency communications. While Network Digital Twins (NDTs) have emerged as a promising…

Systems and Control · Electrical Eng. & Systems 2026-05-22 Armin Makvandi , Md. Zoheb Hassan , Md. Jahangir Hossain

In this paper, we propose reconfigurable intelligent surface (RIS)-assisted unmanned aerial vehicles (UAVs) networks that can utilise both advantages of UAV's agility and RIS's reflection for enhancing the network's performance. To aim at…

Signal Processing · Electrical Eng. & Systems 2021-08-09 Khoi Khac Nguyen , Saeed Khosravirad , Daniel Benevides da Costa , Long D. Nguyen , Trung Q. Duong

Efficient digital twin (DT) synchronization relies on maintaining high-fidelity virtual representations with minimal age of information (AoI). However, the synergistic potential of cooperative sensing and autonomous mobility of the sensing…