English
Related papers

Related papers: Continual Reinforcement Learning for Digital Twin …

200 papers

Efficient data transfers over high-speed, long-distance shared networks require proper utilization of available network bandwidth. Using parallel TCP streams enables an application to utilize network parallelism and can improve transfer…

Networking and Internet Architecture · Computer Science 2022-12-02 Hasibul Jamil , Elvis Rodrigues , Jacob Goldverg , Tevfik Kosar

Joint base station (BS) association and beam selection in multi-UAV aerial corridors constitutes a challenging radio resource management (RRM) problem. It is driven by high-dimensional action spaces, need for substantial overhead to acquire…

Signal Processing · Electrical Eng. & Systems 2026-02-04 Pulok Tarafder , Zoheb Hassan , Imtiaz Ahmed , Danda B. Rawat , Kamrul Hasan , Cong Pu

We consider a joint uplink and downlink scheduling problem of a fully distributed wireless networked control system (WNCS) with a limited number of frequency channels. Using elements of stochastic systems theory, we derive a sufficient…

Systems and Control · Electrical Eng. & Systems 2025-05-20 Gaoyang Pang , Kang Huang , Daniel E. Quevedo , Branka Vucetic , Yonghui Li , Wanchun Liu

This study addresses the challenge of resource scheduling optimization in edge-cloud collaborative computing using deep reinforcement learning (DRL). The proposed DRL-based approach improves task processing efficiency, reduces overall…

Machine Learning · Computer Science 2025-04-30 Yuqing Wang , Xiao Yang

Utilizing Deep Reinforcement Learning (DRL) for Reconfigurable Intelligent Surface (RIS) assisted wireless communication has been extensively researched. However, existing DRL methods either act as a simple optimizer or only solve problems…

Systems and Control · Electrical Eng. & Systems 2026-01-19 Meng-Qian Alexander Wu , Tzu-Hsien Sang , Luisa Schuhmacher , Ming-Jie Guo , Khodr Hammoud , Sofie Pollin

Deep reinforcement learning (DRL) algorithms have recently gained wide attention in the wireless networks domain. They are considered promising approaches for solving dynamic radio resource management (RRM) problems in next-generation…

Networking and Internet Architecture · Computer Science 2022-09-29 Ahmad M. Nagib , Hatem Abou-zeid , Hossam S. Hassanein

Domain Randomization (DR) is commonly used for sim2real transfer of reinforcement learning (RL) policies in robotics. Most DR approaches require a simulator with a fixed set of tunable parameters from the start of the training, from which…

This paper proposes a blockchain-secured deep reinforcement learning (BC-DRL) optimization framework for {data management and} resource allocation in decentralized {wireless mobile edge computing (MEC)} networks. In our framework, {we…

Machine Learning · Computer Science 2024-04-16 Xin Hao , Phee Lep Yeoh , Changyang She , Branka Vucetic , Yonghui Li

Optimization of user association in a densely deployed cellular network is usually challenging and even more complicated due to the dynamic nature of user mobility and fluctuation in user counts. While deep reinforcement learning (DRL)…

Machine Learning · Computer Science 2025-05-19 Zhenyu Tao , Wei Xu , Xiaohu You

Deep Reinforcement Learning (DRL) has become a popular method for solving control problems in power systems. Conventional DRL encourages the agent to explore various policies encoded in a neural network (NN) with the goal of maximizing the…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Tong Wu , Anna Scaglione , Daniel Arnold

Cellular vehicle-to-everything (V2X) communication is crucial to support future diverse vehicular applications. However, for safety-critical applications, unstable vehicle-to-vehicle (V2V) links and high signalling overhead of centralized…

Networking and Internet Architecture · Computer Science 2020-02-19 Xinran Zhang , Mugen Peng , Shi Yan , Yaohua Sun

To overcome the curse of dimensionality and curse of modeling in Dynamic Programming (DP) methods for solving classical Markov Decision Process (MDP) problems, Reinforcement Learning (RL) algorithms are popular. In this paper, we consider…

Machine Learning · Computer Science 2018-11-29 Arghyadip Roy , Vivek Borkar , Abhay Karandikar , Prasanna Chaporkar

As the quantity and complexity of information processed by software systems increase, large-scale software systems have an increasing requirement for high-performance distributed computing systems. With the acceleration of the Internet in…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-22 Guangyao Zhou , Wenhong Tian , Rajkumar Buyya , Ruini Xue , Liang Song

Power grid load scheduling is a critical task that ensures the balance between electricity generation and consumption while minimizing operational costs and maintaining grid stability. Traditional optimization methods often struggle with…

Machine Learning · Computer Science 2024-10-24 Dongwen Luo

Wireless sensor networks consist of randomly distributed sensor nodes for monitoring targets or areas of interest. Maintaining the network for continuous surveillance is a challenge due to the limited battery capacity in each sensor.…

Machine Learning · Computer Science 2023-10-03 Ngoc Bui , Phi Le Nguyen , Viet Anh Nguyen , Phan Thuan Do

Collaboration among industrial Internet of Things (IoT) devices and edge networks is essential to support computation-intensive deep neural network (DNN) inference services which require low delay and high accuracy. Sampling rate adaption…

Systems and Control · Electrical Eng. & Systems 2023-01-03 Wen Wu , Peng Yang , Weiting Zhang , Conghao Zhou , Xuemin , Shen

The design of Wireless Networked Control System (WNCS) requires addressing critical interactions between control and communication systems with minimal complexity and communication overhead while providing ultra-high reliability. This paper…

Systems and Control · Electrical Eng. & Systems 2023-12-20 Hamida Qumber Ali , Amirhassan Babazadeh Darabi , Sinem Coleri

In this paper, we employ deep reinforcement learning to develop a novel radio resource allocation and packet scheduling scheme for different Quality of Service (QoS) requirements applicable to LTEadvanced and 5G networks. In addition,…

Signal Processing · Electrical Eng. & Systems 2020-08-18 Mahdi Nouri Boroujerdi , Mohammad Akbari , Roghayeh Joda , Mohammad Ali Maddah-Ali , Babak Hossein Khalaj

The collaboration and interaction of multiple robots have become integral aspects of smart manufacturing. Effective planning and management play a crucial role in achieving energy savings and minimising overall costs. This paper addresses…

Robotics · Computer Science 2025-06-16 Ziren Xiao , Ruxin Xiao , Chang Liu , Xinheng Wang

Optimal resource allocation is a fundamental challenge for dense and heterogeneous wireless networks with massive wireless connections. Because of the non-convex nature of the optimization problem, it is computationally demanding to obtain…

Networking and Internet Architecture · Computer Science 2019-05-01 Kazi Ishfaq Ahmed , Ekram Hossain