English
Related papers

Related papers: Maximizing the Promptness of Metaverse Systems usi…

200 papers

The imminent rise of autonomous vehicles (AVs) is revolutionizing the future of transport. The Vehicular Fog Computing (VFC) paradigm has emerged to alleviate the load of compute-intensive and delay-sensitive AV programs via task offloading…

Networking and Internet Architecture · Computer Science 2024-10-10 Mohammad Parsa Toopchinezhad , Mahmood Ahmadi

In this paper, a deep reinforcement learning (DRL) method is proposed to address the problem of UAV navigation in an unknown environment. However, DRL algorithms are limited by the data efficiency problem as they typically require a huge…

Robotics · Computer Science 2020-08-07 Lei He , Nabil Aouf , James F. Whidborne , Bifeng Song

Deep reinforcement learning (DRL) has recently shown its success in tackling complex combinatorial optimization problems. When these problems are extended to multiobjective ones, it becomes difficult for the existing DRL approaches to…

Artificial Intelligence · Computer Science 2022-02-15 Zizhen Zhang , Zhiyuan Wu , Hang Zhang , Jiahai Wang

In the era of 5G mobile communication, there has been a significant surge in research focused on unmanned aerial vehicles (UAVs) and mobile edge computing technology. UAVs can serve as intelligent servers in edge computing environments,…

Multiagent Systems · Computer Science 2023-09-06 Zhengrong Song , Chuan Ma , Ming Ding , Howard H. Yang , Yuwen Qian , Xiangwei Zhou

Optimization of user association in a densely deployed cellular network is usually challenging and even more complicated due to the dynamic nature of user mobility and fluctuation in user counts. While deep reinforcement learning (DRL)…

Machine Learning · Computer Science 2025-05-19 Zhenyu Tao , Wei Xu , Xiaohu You

With the development of the Internet of Things (IoT) and the birth of various new IoT devices, the capacity of massive IoT devices is facing challenges. Fortunately, edge computing can optimize problems such as delay and connectivity by…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-02 Shihao Shen , Yiwen Han , Xiaofei Wang , Yan Wang

The growing demand for services and the rapid deployment of virtualized network functions (VNFs) pose significant challenges for achieving low-latency and energy-efficient orchestration in modern edge-core network infrastructures. To…

Networking and Internet Architecture · Computer Science 2026-01-22 Faisal Ahmed , Suresh Subramaniam , Motoharu Matsuura , Hiroshi Hasegawa , Shih-Chun Lin

An online resource scheduling framework is proposed for minimizing the sum of weighted task latency for all the Internet of things (IoT) users, by optimizing offloading decision, transmission power and resource allocation in the large-scale…

Machine Learning · Computer Science 2020-04-16 Feibo Jiang , Kezhi Wang , Li Dong , Cunhua Pan , Kun Yang

As the Metaverse envisions deeply immersive and pervasive connectivity in 6G networks, Integrated Access and Backhaul (IAB) emerges as a critical enabler to meet the demanding requirements of massive and immersive communications. IAB…

Networking and Internet Architecture · Computer Science 2025-03-17 Jie Zhang , Swarna Chetty , Qiao Wang , Chenrui Sun , Paul Daniel Mitchell , David Grace , Hamed Ahmadi

With the rapid development of deep learning, deep reinforcement learning (DRL) began to appear in the field of resource scheduling in recent years. Based on the previous research on DRL in the literature, we introduce online resource…

Artificial Intelligence · Computer Science 2018-06-22 Yufei Ye , Xiaoqin Ren , Jin Wang , Lingxiao Xu , Wenxia Guo , Wenqiang Huang , Wenhong Tian

In the rapidly evolving field of serverless computing, efficient function scheduling and resource scaling are critical for optimizing performance and cost. This paper presents a comprehensive review of the application of Deep Reinforcement…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-23 Amjad Yousef Majid , Eduard Marin

This paper introduces a novel approach, Decision Theory-guided Deep Reinforcement Learning (DT-guided DRL), to address the inherent cold start problem in DRL. By integrating decision theory principles, DT-guided DRL enhances agents' initial…

Machine Learning · Computer Science 2024-02-12 Zelin Wan , Jin-Hee Cho , Mu Zhu , Ahmed H. Anwar , Charles Kamhoua , Munindar P. Singh

Reinforcement Learning (RL) enables an intelligent agent to optimise its performance in a task by continuously taking action from an observed state and receiving a feedback from the environment in form of rewards. RL typically uses tables…

Artificial Intelligence · Computer Science 2025-01-28 Alberto Castagna

The traditional Internet has encountered a bottleneck in allocating network resources for emerging technology needs. Network virtualization (NV) technology as a future network architecture, the virtual network embedding (VNE) algorithm it…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-08 Shidong Zhang , Chao Wang , Junsan Zhang , Youxiang Duan , Xinhong You , Peiying Zhang

In the context of Industry 4.0 and smart manufacturing, the field of process industry optimization and control is also undergoing a digital transformation. With the rise of Deep Reinforcement Learning (DRL), its application in process…

Systems and Control · Electrical Eng. & Systems 2025-04-23 Runze Lin , Junghui Chen , Lei Xie , Hongye Su

The setup considered in the paper consists of sensors in a Networked Control System that are used to build a digital twin (DT) model of the system dynamics. The focus is on control, scheduling, and resource allocation for sensory…

Signal Processing · Electrical Eng. & Systems 2023-11-28 Van-Phuc Bui , Shashi Raj Pandey , Pedro M. de Sant Ana , Petar Popovski

Real-time control of pumps can be an infeasible task in water distribution systems (WDSs) because the calculation to find the optimal pump speeds is resource-intensive. The computational need cannot be lowered even with the capabilities of…

Artificial Intelligence · Computer Science 2020-10-14 Gergely Hajgató , György Paál , Bálint Gyires-Tóth

The fifth generation (5G) of wireless networks is set out to meet the stringent requirements of vehicular use cases. Edge computing resources can aid in this direction by moving processing closer to end-users, reducing latency. However,…

Machine Learning · Computer Science 2025-07-01 Cyril Shih-Huan Hsu , Jorge Martín-Pérez , Chrysa Papagianni , Paola Grosso

Recent studies show that deep reinforcement learning (DRL) agents tend to overfit to the task on which they were trained and fail to adapt to minor environment changes. To expedite learning when transferring to unseen tasks, we propose a…

Artificial Intelligence · Computer Science 2024-02-22 Guy Azran , Mohamad H. Danesh , Stefano V. Albrecht , Sarah Keren

We consider vehicular networking scenarios where existing vehicle-to-vehicle (V2V) links can be leveraged for an effective uploading of large-size data to the network. In particular, we consider a group of vehicles where one vehicle can be…

Signal Processing · Electrical Eng. & Systems 2025-12-22 Talha Akyildiz , Hessam Mahdavifar