English
Related papers

Related papers: Digital Twin-Assisted Efficient Reinforcement Lear…

200 papers

As an emerging technology, digital twin (DT) can provide real-time status and dynamic topology mapping for Internet of Things (IoT) devices. However, DT and its implementation within industrial IoT networks necessitates substantial,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-28 Shunfeng Chu , Jun Li , Jianxin Wang , Yiyang Ni , Kang Wei , Wen Chen , Shi Jin

With the development of the Internet of Things (IoT) and the birth of various new IoT devices, the capacity of massive IoT devices is facing challenges. Fortunately, edge computing can optimize problems such as delay and connectivity by…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-02 Shihao Shen , Yiwen Han , Xiaofei Wang , Yan Wang

Joint base station (BS) association and beam selection in multi-UAV aerial corridors constitutes a challenging radio resource management (RRM) problem. It is driven by high-dimensional action spaces, need for substantial overhead to acquire…

Signal Processing · Electrical Eng. & Systems 2026-02-04 Pulok Tarafder , Zoheb Hassan , Imtiaz Ahmed , Danda B. Rawat , Kamrul Hasan , Cong Pu

We are interested in the optimal scheduling of a collection of multi-component application jobs in an edge computing system that consists of geo-distributed edge computing nodes connected through a wide area network. The scheduling and…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-24 Zhi Cao , Honggang Zhang , Yu Cao , Benyuan Liu

Deep Reinforcement Learning (DRL) techniques have been successfully applied for solving complex decision-making and control tasks in multiple fields including robotics, autonomous driving, healthcare and natural language processing. The…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-07 Amanda Jayanetti , Saman Halgamuge , Rajkumar Buyya

Digital twins promise to revolutionize engineering by offering new avenues for optimization, control, and predictive maintenance. We propose a novel framework for simultaneously training the digital twin of an engineering system and an…

Systems and Control · Electrical Eng. & Systems 2024-07-12 Lorenzo Schena , Pedro Marques , Romain Poletti , Samuel Ahizi , Jan Van den Berghe , Miguel A. Mendez

In this paper, we consider a mobile-edge computing system, where an access point assists a mobile device (MD) to execute an application consisting of multiple tasks following a general task call graph. The objective is to jointly determine…

Networking and Internet Architecture · Computer Science 2020-02-20 Jia Yan , Suzhi Bi , Ying-Jun Angela Zhang

Artificial intelligence and distributed algorithms have been widely used in mechanical fault diagnosis with the explosive growth of diagnostic data. A novel intelligent fault diagnosis system framework that allows intelligent terminals to…

Information Theory · Computer Science 2023-02-16 Liang Yu , Qixin Guo , Rui Wang , Minyan Shi , Fucheng Yan , Ran Wang

Considering the user mobility and unpredictable mobile edge computing (MEC) environments, this paper studies the intelligent task offloading problem in unmanned aerial vehicle (UAV)-enabled MEC with the assistance of digital twin (DT). We…

Information Theory · Computer Science 2022-08-02 Bin Li , Yufeng Liu , Ling Tan , Heng Pan , Yan Zhang

Exploiting unmanned aerial vehicles (UAVs) to execute tasks is gaining growing popularity recently. To solve the underlying task scheduling problem, the deep reinforcement learning (DRL) based methods demonstrate notable advantage over the…

Machine Learning · Computer Science 2023-06-07 Xiao Mao , Zhiguang Cao , Mingfeng Fan , Guohua Wu , Witold Pedrycz

Reinforcement Learning (RL) enables an intelligent agent to optimise its performance in a task by continuously taking action from an observed state and receiving a feedback from the environment in form of rewards. RL typically uses tables…

Artificial Intelligence · Computer Science 2025-01-28 Alberto Castagna

Collaborative edge computing addresses the resource constraints of individual edge nodes by enabling resource sharing and task co-processing across multiple nodes. To fully leverage the advantages of collaborative edge computing, joint…

Performance · Computer Science 2025-08-25 Yang Li , Xing Zhang , Yunji Zhao , Wenbo Wang

Reinforcement Learning (RL) or Deep Reinforcement Learning (DRL) is a powerful approach to solving Markov Decision Processes (MDPs) when the model of the environment is not known a priori. However, RL models are still faced with challenges…

Systems and Control · Electrical Eng. & Systems 2024-06-04 Kabirat Olayemi , Mien Van , Luke Maguire , Sean McLoone

Digital Twins (DT) have become crucial to achieve sustainable and effective smart urban solutions. However, current DT modelling techniques cannot support the dynamicity of these smart city environments. This is caused by the lack of…

Machine Learning · Computer Science 2024-08-30 Lal Verda Cakir , Kubra Duran , Craig Thomson , Matthew Broadbent , Berk Canberk

Deep Reinforcement Learning (DRL) has emerged as a powerful solution for meeting the growing demands for connectivity, reliability, low latency and operational efficiency in advanced networks. However, most research has focused on…

Networking and Internet Architecture · Computer Science 2025-07-21 Haiyuan Li , Hari Madhukumar , Peizheng Li , Yuelin Liu , Yiran Teng , Yulei Wu , Ning Wang , Shuangyi Yan , Dimitra Simeonidou

Collaborative edge computing (CEC) has emerged as a promising paradigm, enabling edge nodes to collaborate and execute microservices from end devices. Microservice offloading, a fundamentally important problem, decides when and where…

Networking and Internet Architecture · Computer Science 2024-03-14 Xiangchun Chen , Jiannong Cao , Zhixuan Liang , Yuvraj Sahni , Mingjin Zhang

Human digital twin (HDT) is an emerging paradigm that bridges physical twins (PTs) with powerful virtual twins (VTs) for assisting complex task executions in human-centric services. In this paper, we study a two-timescale online…

Networking and Internet Architecture · Computer Science 2024-01-31 Yuye Yang , You Shi , Changyan Yi , Jun Cai , Jiawen Kang , Dusit Niyato , Xuemin , Shen

Deep neural networks (DNNs) have been widely used in various video analytic tasks. These tasks demand real-time responses. Due to the limited processing power on mobile devices, a common way to support such real-time analytics is to offload…

Networking and Internet Architecture · Computer Science 2023-05-04 Jian He , Chenxi Yang , Zhaoyuan He , Ghufran Baig , Lili Qiu

The synchronization of digital twins (DT) serves as the cornerstone for effective operation of the DT framework. However, the limitations of channel capacity can greatly affect the data transmission efficiency of wireless communication.…

Emerging Technologies · Computer Science 2025-03-07 Bin Li , Haichen Cai , Lei Liu , Zesong Fei

The improvements in the edge computing technology pave the road for diversified applications that demand real-time interaction. However, due to the mobility of the end-users and the dynamic edge environment, it becomes challenging to handle…

Networking and Internet Architecture · Computer Science 2025-02-25 Baris Yamansavascilar , Ahmet Cihat Baktir , Cagatay Sonmez , Atay Ozgovde , Cem Ersoy