English
Related papers

Related papers: Deep Reinforcement Learning for Delay-Oriented IoT…

200 papers

With the development of the Internet of Things (IoT) and the birth of various new IoT devices, the capacity of massive IoT devices is facing challenges. Fortunately, edge computing can optimize problems such as delay and connectivity by…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-02 Shihao Shen , Yiwen Han , Xiaofei Wang , Yan Wang

Unmanned aerial vehicles (UAVs) have been recently utilized in multi-access edge computing (MEC) as edge servers. It is desirable to design UAVs' trajectories and user to UAV assignments to ensure satisfactory service to the users and…

Multiagent Systems · Computer Science 2025-08-12 Hamidreza Asadian-Rad , Hossein Soleimani , Shahrokh Farahmand

Reinforcement learning (RL) is capable of managing wireless, energy-harvesting IoT nodes by solving the problem of autonomous management in non-stationary, resource-constrained settings. We show that the state-of-the-art policy-gradient…

Machine Learning · Computer Science 2020-10-12 Abdulmajid Murad , Frank Alexander Kraemer , Kerstin Bach , Gavin Taylor

Future cellular networks will sustainably integrate computing, intelligence and services within a network of networks ecosystem that includes IoT devices and subnetworks for local communications and distributed processing. This integration…

Networking and Internet Architecture · Computer Science 2026-04-20 Keyvan Aghababaiyan , Baldomero Coll-Perales , Javier Gozalvez

Deep Reinforcement Learning (DRL) has emerged as an efficient approach to resource allocation due to its strong capability in handling complex decision-making tasks. However, only limited research has explored the training of DRL models…

Machine Learning · Computer Science 2025-09-23 Aohan Li , Miyu Tsuzuki

Due to their inherent flexibility and autonomous operation, unmanned aerial vehicles (UAVs) have been widely used in Internet of Medical Things (IoMT) to provide real-time biomedical edge computing service for wireless body area network…

Networking and Internet Architecture · Computer Science 2025-12-25 Siqi Mu , Shuo Wen , Yang Lu , Ruihong Jiang , Bo Ai

In order to coordinate energy interactions among various communities and energy conversions among multi-energy subsystems within the multi-community integrated energy system under uncertain conditions, and achieve overall optimization and…

Systems and Control · Electrical Eng. & Systems 2024-04-24 Yang Li , Wenjie Ma , Fanjin Bu , Zhen Yang , Bin Wang , Meng Han

In fog-assisted IoT systems, it is a common practice to offload tasks from IoT devices to their nearby fog nodes to reduce task processing latencies and energy consumptions. However, the design of online energy-efficient scheme is still an…

Networking and Internet Architecture · Computer Science 2020-08-04 Xin Gao , Xi Huang , Ziyu Shao , Yang Yang

Recently, the unmanned aerial vehicles (UAVs) have been widely used in real-time sensing applications over cellular networks, which sense the conditions of the tasks and transmit the real-time sensory data to the base station (BS). The…

Signal Processing · Electrical Eng. & Systems 2018-09-11 Jingzhi Hu , Hongliang Zhang , Lingyang Song

This paper addresses the challenge of efficiently offloading heavy computing tasks from ground mobile devices to the satellite-based mist computing environment. With ground-based edge and cloud servers often being inaccessible, the…

Cryptography and Security · Computer Science 2023-11-27 Messaoud Babaghayou , Noureddine Chaib , Leandros Maglaras , Yagmur Yigit , Mohamed Amine Ferrag

Aerial robots are increasingly being utilized for environmental monitoring and exploration. However, a key challenge is efficiently planning paths to maximize the information value of acquired data as an initially unknown environment is…

Robotics · Computer Science 2022-03-04 Julius Rückin , Liren Jin , Marija Popović

This paper explores the optimization of Ground Delay Programs (GDP), a prevalent Traffic Management Initiative used in Air Traffic Management (ATM) to reconcile capacity and demand discrepancies at airports. Employing Reinforcement Learning…

Machine Learning · Computer Science 2024-08-15 Ke Liu , Fan Hu , Hui Lin , Xi Cheng , Jianan Chen , Jilin Song , Siyuan Feng , Gaofeng Su , Chen Zhu

Today's robotic systems are increasingly turning to computationally expensive models such as deep neural networks (DNNs) for tasks like localization, perception, planning, and object detection. However, resource-constrained robots, like…

With the development of artificial intelligence integrated next-generation communication networks, mobile users (MUs) are increasingly demanding the efficient processing of computation-intensive and latency-sensitive tasks. However,…

Signal Processing · Electrical Eng. & Systems 2025-12-03 Wenchao Liu , Xuhui Zhang , Chunjie Wang , Jinke Ren , Zheng Xing , Bo Yang , Shuqiang Wang , Yanyan Shen

Unmanned Aerial Vehicles (UAVs) have emerged as a key enabler technology for data collection from Internet of Things (IoT) devices. However, effective data collection is challenged by resource constraints and the need for real-time…

Robotics · Computer Science 2026-05-12 Assane Sankara , Daniel Bonilla Licea , Hajar El Hammouti

Serverless computing adopts a pay-as-you-go billing model where applications are executed in stateless and shortlived containers triggered by events, resulting in a reduction of monetary costs and resource utilization. However, existing…

Networking and Internet Architecture · Computer Science 2025-01-27 Chen Chen , Peiyuan Guan , Ziru Chen , Amir Taherkordi , Fen Hou , Lin X. Cai

Many real-time applications (e.g., Augmented/Virtual Reality, cognitive assistance) rely on Deep Neural Networks (DNNs) to process inference tasks. Edge computing is considered a key infrastructure to deploy such applications, as moving…

The high computational complexity and high energy consumption of artificial intelligence (AI) algorithms hinder their application in augmented reality (AR) systems. This paper considers the scene of completing video-based AI inference tasks…

Systems and Control · Electrical Eng. & Systems 2022-08-04 Guangjin Pan , Heng Zhang , Shugong Xu , Shunqing Zhang , Xiaojing Chen

The low-altitude Internet of Things (IoT), supported by unmanned aerial vehicles (UAVs), provides ground sensing networks with advanced real-time monitoring and data collection. To maximize data collection volume from distributed IoT nodes,…

Computational Engineering, Finance, and Science · Computer Science 2026-05-25 Zhenjia Xu , Xiaoling Zhang , Nan Qi , Guangxu Zhu , Xiaojie Li , Luliang Jia

With the increasing and elastic demand for cloud resources, finding an optimal task scheduling mechanism become a challenge for cloud service providers. Due to the time-varying nature of resource demands in length and processing over time…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-14 Seyedakbar Mostafavi , Vesal Hakami