English
Related papers

Related papers: Continual Reinforcement Learning for Digital Twin …

200 papers

Modern large-scale computing deployments consist of complex applications running over machine clusters. An important issue in these is the offering of elasticity, i.e., the dynamic allocation of resources to applications to meet fluctuating…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-13 Konstantinos Lolos , Ioannis Konstantinou , Verena Kantere , Nectarios Koziris

As a promising technology, vehicular edge computing (VEC) can provide computing and caching services by deploying VEC servers near vehicles. However, VEC networks still face challenges such as high vehicle mobility. Digital twin (DT), an…

Machine Learning · Computer Science 2025-06-23 Yu Xie , Qiong Wu , Pingyi Fan , Nan Cheng , Wen Chen , Jiangzhou Wang , Khaled B. Letaief

With the rapid deployment of the Internet of Things (IoT), fifth-generation (5G) and beyond 5G networks are required to support massive access of a huge number of devices over limited radio spectrum radio. In wireless networks, different…

Signal Processing · Electrical Eng. & Systems 2020-12-18 Helin Yang , Zehui Xiong , Jun Zhao , Dusit Niyato , Chau Yuen , Ruilong Deng

As rapidly growing AI computational demands accelerate the need for new hardware installation and maintenance, this work explores optimal data center resource management by balancing operational efficiency with fault tolerance through…

Artificial Intelligence · Computer Science 2025-04-02 Chang-Lin Chen , Jiayu Chen , Tian Lan , Zhaoxia Zhao , Hongbo Dong , Vaneet Aggarwal

Collaborative deep reinforcement learning (CDRL) algorithms in which multiple agents can coordinate over a wireless network is a promising approach to enable future intelligent and autonomous systems that rely on real-time decision-making…

Information Theory · Computer Science 2022-03-07 Fatemeh Lotfi , Omid Semiari , Walid Saad

Network Slice placement with the problem of allocation of resources from a virtualized substrate network is an optimization problem which can be formulated as a multiobjective Integer Linear Programming (ILP) problem. However, to cope with…

Networking and Internet Architecture · Computer Science 2021-05-17 Jose Jurandir Alves Esteves , Amina Boubendir , Fabrice Guillemin , Pierre Sens

Active suspension systems are critical for enhancing vehicle comfort, safety, and stability, yet their performance is often limited by fixed hardware designs and control strategies that cannot adapt to uncertain and dynamic operating…

Robotics · Computer Science 2025-12-04 Ying-Kuan Tsai , Yi-Ping Chen , Vispi Karkaria , Wei Chen

In collaborative human-robot order picking systems, human pickers and Autonomous Mobile Robots (AMRs) travel independently through a warehouse and meet at pick locations where pickers load items onto the AMRs. In this paper, we consider an…

Active Reconfigurable Intelligent Surfaces (RIS) are a promising technology for 6G wireless networks. This paper investigates a novel hybrid deep reinforcement learning (DRL) framework for resource allocation in a multi-user uplink system…

Signal Processing · Electrical Eng. & Systems 2025-12-29 Mohamed Shalma , Engy Aly Maher , Ahmed El-Mahdy

5G New Radio proposes the usage of frequencies above 10 GHz to speed up LTE's existent maximum data rates. However, the effective size of 5G antennas and consequently its repercussions in the signal degradation in urban scenarios makes it a…

Networking and Internet Architecture · Computer Science 2023-01-16 Pedro Enrique Iturria Rivera , Medhat Elsayed , Majid Bavand , Raimundas Gaigalas , Steve Furr , Melike Erol-Kantarci

Automatic decision-making approaches, such as reinforcement learning (RL), have been applied to (partially) solve the resource allocation problem adaptively in the cloud computing system. However, a complete cloud resource allocation…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-08-15 Ning Liu , Zhe Li , Zhiyuan Xu , Jielong Xu , Sheng Lin , Qinru Qiu , Jian Tang , Yanzhi Wang

Intelligent vehicular systems and smart city applications are the fastest growing Internet of things (IoT) implementations at a compound annual growth rate of 30%. In view of the recent advances in IoT devices and the emerging new breed of…

Networking and Internet Architecture · Computer Science 2020-10-21 Almuthanna Nassar , Yasin Yilmaz

In this paper, a joint task, spectrum, and transmit power allocation problem is investigated for a wireless network in which the base stations (BSs) are equipped with mobile edge computing (MEC) servers to jointly provide computational and…

Signal Processing · Electrical Eng. & Systems 2020-07-21 Sihua Wang , Mingzhe Chen , Xuanlin Liu , Changchuan Yin , Shuguang Cui , H. Vincent Poor

With the increasing computing power, using data-driven approaches to co-design a robot's morphology and controller has become a promising way. However, most existing data-driven methods require training the controller for each morphology to…

Robotics · Computer Science 2023-11-08 Ci Chen , Pingyu Xiang , Haojian Lu , Yue Wang , Rong Xiong

Dynamic resource allocation in mobile wireless networks involves complex, time-varying optimization problems, motivating the adoption of deep reinforcement learning (DRL). However, most existing works rely on pre-trained policies,…

Machine Learning · Computer Science 2025-02-12 Xinren Zhang , Jiadong Yu

In software-defined networking (SDN), the implementation of distributed SDN controllers, with each controller responsible for managing a specific sub-network or domain, plays a critical role in achieving a balance between centralized…

Networking and Internet Architecture · Computer Science 2024-03-15 Ioannis Panitsas , Akrit Mudvari , Leandros Tassiulas

This paper presents a framework to tackle constrained combinatorial optimization problems using deep Reinforcement Learning (RL). To this end, we extend the Neural Combinatorial Optimization (NCO) theory in order to deal with constraints in…

Machine Learning · Computer Science 2020-06-23 Ruben Solozabal , Josu Ceberio , Martin Takáč

Scheduling is a fundamental task occurring in various automated systems applications, e.g., optimal schedules for machines on a job shop allow for a reduction of production costs and waste. Nevertheless, finding such schedules is often…

Machine Learning · Computer Science 2021-04-09 Pierre Tassel , Martin Gebser , Konstantin Schekotihin

The exponential proliferation of mobile devices and data-intensive applications in future wireless networks imposes substantial computational burdens on resource-constrained devices, thereby fostering the emergence of over-the-air…

Signal Processing · Electrical Eng. & Systems 2025-12-24 Tuo Wu , Xiazhi Lai , Shihang Lu , Zihao Chen , Xiaotong Zhao , Yuanhao Cui

In cellular networks, resource allocation is usually performed in a centralized way, which brings huge computation complexity to the base station (BS) and high transmission overhead. This paper explores a distributed resource allocation…

Signal Processing · Electrical Eng. & Systems 2024-11-12 Zelin Ji , Zhijin Qin , Xiaoming Tao