English
Related papers

Related papers: Decentralized Task Scheduling in Distributed Syste…

200 papers

Workloads in data processing clusters are often represented in the form of DAG (Directed Acyclic Graph) jobs. Scheduling DAG jobs is challenging. Simple heuristic scheduling algorithms are often adopted in practice in production data…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-30 Zhibo Hu , Chen Wang , Helen , Paik , Yanfeng Shu , Liming Zhu

Decentralized learning (DL) has gained prominence for its potential benefits in terms of scalability, privacy, and fault tolerance. It consists of many nodes that coordinate without a central server and exchange millions of parameters in…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-15 Akash Dhasade , Anne-Marie Kermarrec , Rafael Pires , Rishi Sharma , Milos Vujasinovic

Efficient allocation of resources to activities is pivotal in executing business processes but remains challenging. While resource allocation methodologies are well-established in domains like manufacturing, their application within…

Artificial Intelligence · Computer Science 2024-11-19 J. Middelhuis , R. Lo Bianco , E. Scherzer , Z. A. Bukhsh , I. J. B. F. Adan , R. M. Dijkman

We propose a framework for distributed robust statistical learning on {\em big contaminated data}. The Distributed Robust Learning (DRL) framework can reduce the computational time of traditional robust learning methods by several orders of…

Machine Learning · Statistics 2015-02-10 Jiashi Feng , Huan Xu , Shie Mannor

Multi-Agent Reinforcement Learning (MARL) is a challenging subarea of Reinforcement Learning due to the non-stationarity of the environments and the large dimensionality of the combined action space. Deep MARL algorithms have been applied…

Machine Learning · Computer Science 2021-07-27 Yuanchao Xu , Amal Feriani , Ekram Hossain

Introducing cooperative coded caching into small cell networks is a promising approach to reducing traffic loads. By encoding content via maximum distance separable (MDS) codes, coded fragments can be collectively cached at small-cell base…

Information Theory · Computer Science 2020-06-25 Xiongwei Wu , Jun Li , Ming Xiao , P. C. Ching , H. Vincent Poor

The collaboration and interaction of multiple robots have become integral aspects of smart manufacturing. Effective planning and management play a crucial role in achieving energy savings and minimising overall costs. This paper addresses…

Robotics · Computer Science 2025-06-16 Ziren Xiao , Ruxin Xiao , Chang Liu , Xinheng Wang

Reinforcement Learning (RL) is a well-established framework for sequential decision-making in complex environments. However, state-of-the-art Deep RL (DRL) algorithms typically require large training datasets and often struggle to…

Artificial Intelligence · Computer Science 2026-04-13 Celeste Veronese , Alessandro Farinelli , Daniele Meli

In this thesis, I propose a family of fully decentralized deep multi-agent reinforcement learning (MARL) algorithms to achieve high, real-time performance in network-level traffic signal control. In this approach, each intersection is…

Machine Learning · Computer Science 2020-07-21 Jin Guo

Most deep reinforcement learning algorithms are data inefficient in complex and rich environments, limiting their applicability to many scenarios. One direction for improving data efficiency is multitask learning with shared neural network…

Various mobile applications that comprise dependent tasks are gaining widespread popularity and are increasingly complex. These applications often have low-latency requirements, resulting in a significant surge in demand for computing…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-22 Jiagang Liu , Yun Mi , Xinyu Zhang , Xiaocui Li

The dynamic job-shop scheduling problem (DJSP) is a class of scheduling tasks that specifically consider the inherent uncertainties such as changing order requirements and possible machine breakdown in realistic smart manufacturing…

Artificial Intelligence · Computer Science 2022-01-04 Yunhui Zeng , Zijun Liao , Yuanzhi Dai , Rong Wang , Xiu Li , Bo Yuan

Reinforcement learning (RL) trains many agents, which is resource-intensive and must scale to large GPU clusters. Different RL training algorithms offer different opportunities for distributing and parallelising the computation. Yet,…

Machine Learning · Computer Science 2022-10-31 Huanzhou Zhu , Bo Zhao , Gang Chen , Weifeng Chen , Yijie Chen , Liang Shi , Yaodong Yang , Peter Pietzuch , Lei Chen

Deep Reinforcement Learning (DRL) has made considerable advances in simulated and physical robot control tasks, especially when problems admit a fully observed Markov Decision Process (MDP) formulation. When observations only partially…

Robotics · Computer Science 2026-03-24 Lingheng Meng , Rob Gorbet , Michael Burke , Dana Kulić

Continual Reinforcement Learning (CRL) aims to develop lifelong learning agents to continuously acquire knowledge across diverse tasks while mitigating catastrophic forgetting. This requires efficiently managing the stability-plasticity…

Machine Learning · Computer Science 2026-02-02 Yuxuan Li , Qijun He , Mingqi Yuan , Wen-Tse Chen , Jeff Schneider , Jiayu Chen

Multi-access edge computing provides localized resources within mobile networks to address the requirements of emerging latency-sensitive and computing-intensive applications. At the edge, dynamic requests necessitate sophisticated resource…

Systems and Control · Electrical Eng. & Systems 2025-11-19 Haiyuan Li , Yuelin Liu , Hari Madhukumar , Amin Emami , Xueqing Zhou , Yulei Wu , Xenofon Vasilakos , Shuangyi Yan , Dimitra Simeonidou

Taking advantage of their data-driven and model-free features, Deep Reinforcement Learning (DRL) algorithms have the potential to deal with the increasing level of uncertainty due to the introduction of renewable-based generation. To deal…

Systems and Control · Electrical Eng. & Systems 2022-08-02 Hou Shengren , Edgar Mauricio Salazar , Pedro P. Vergara , Peter Palensky

Multi-task learning aims to learn multiple tasks jointly by exploiting their relatedness to improve the generalization performance for each task. Traditionally, to perform multi-task learning, one needs to centralize data from all the tasks…

Machine Learning · Computer Science 2017-06-21 Sulin Liu , Sinno Jialin Pan , Qirong Ho

Deep reinforcement learning has been recognized as an efficient technique to design optimal strategies for different complex systems without prior knowledge of the control landscape. To achieve a fast and precise control for quantum…

Quantum Physics · Physics 2021-01-05 Hailan Ma , Daoyi Dong , Steven X. Ding , Chunlin Chen

This paper addresses the problem of autonomous task allocation by a swarm of autonomous, interactive drones in large-scale, dynamic spatio-temporal environments. When each drone independently determines navigation, sensing, and recharging…

Robotics · Computer Science 2025-11-13 Chuhao Qin , Evangelos Pournaras