English
Related papers

Related papers: Job Scheduling in Datacenters using Constraint Con…

200 papers

Scheduling deep learning (DL) models to train on powerful clusters with accelerators like GPUs and TPUs, presently falls short, either lacking fine-grained heterogeneity awareness or leaving resources substantially under-utilized. To fill…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-17 Abeda Sultana , Nabin Pakka , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

Power grid load scheduling is a critical task that ensures the balance between electricity generation and consumption while minimizing operational costs and maintaining grid stability. Traditional optimization methods often struggle with…

Machine Learning · Computer Science 2024-10-24 Dongwen Luo

When deploying machine learning solutions, they must satisfy multiple requirements beyond accuracy, such as fairness, robustness, or safety. These requirements are imposed during training either implicitly, using penalties, or explicitly,…

Machine Learning · Computer Science 2024-01-12 Ignacio Hounie , Alejandro Ribeiro , Luiz F. O. Chamon

In distributed machine learning, a central node outsources computationally expensive calculations to external worker nodes. The properties of optimization procedures like stochastic gradient descent (SGD) can be leveraged to mitigate the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-19 Maximilian Egger , Serge Kas Hanna , Rawad Bitar

Load balancing arises as a fundamental problem, underlying the dimensioning and operation of many computing and communication systems, such as job routing in data center clusters, multipath communication, Big Data and queueing systems. In…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-12 Anam Tahir , Bastian Alt , Amr Rizk , Heinz Koeppl

This paper addresses the joint scheduling problem of stochastic workloads and a hydrogen-enabled distributed energy system in a low-carbon Internet data centers (IDC). Although such workloads can be shifted over temporal and spatial…

Systems and Control · Electrical Eng. & Systems 2025-12-05 Maoyuan Ma , Wangyi Guo , Lei Yang , Zhanbo Xu , Xiaohong Guan

With the continuous increase of IoT applications, their effective scheduling in edge and cloud computing has become a critical challenge. The inherent dynamism and stochastic characteristics of edge and cloud computing, along with IoT…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-01 Zhiyu Wang , Mohammad Goudarzi , Rajkumar Buyya

Resource-disaggregated data centres (RDDC) propose a resource-centric, and high-utilisation architecture for data centres (DC), avoiding resource fragmentation and enabling arbitrarily sized resource pools to be allocated to tasks, rather…

Machine Learning · Computer Science 2021-11-12 Zacharaya Shabka , Georgios Zervas

Various congestion control protocols have been designed to achieve high performance in different network environments. Modern online learning solutions that delegate the congestion control actions to a machine cannot properly converge in…

Networking and Internet Architecture · Computer Science 2024-03-27 Shiva Ketabi , Hongkai Chen , Haiwei Dong , Yashar Ganjali

Deep Reinforcement Learning (DRL) is being increasingly applied to the problem of resource allocation for emerging System-on-Chip (SoC) applications, and has shown remarkable promises. In this paper, we introduce SoCRATES (SoC Resource…

Operating Systems · Computer Science 2021-10-13 Tegg Taekyong Sung , Bo Ryu

This study investigates scheduling strategies for the stochastic resource-constrained project scheduling problem with maximal time lags (SRCPSP/max)). Recent advances in Constraint Programming (CP) and Temporal Networks have reinvoked…

Artificial Intelligence · Computer Science 2025-03-25 Kim van den Houten , Léon Planken , Esteban Freydell , David M. J. Tax , Mathijs de Weerdt

As computing power is becoming the core productivity of the digital economy era, the concept of Computing and Network Convergence (CNC), under which network and computing resources can be dynamically scheduled and allocated according to…

Networking and Internet Architecture · Computer Science 2022-09-23 Aidong Yang , Mohan Wu , Boquan Cheng , Xiaozhou Ye , Ye Ouyang

Accommodating long-running deep learning (DL) training and inference jobs is challenging on GPU clusters that use traditional batch schedulers, such as Slurm. Given fixed wall clock time limits, DL researchers usually need to run a sequence…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-27 Qiyang Ding , Pengfei Zheng , Shreyas Kudari , Shivaram Venkataraman , Zhao Zhang

Today high-performance computing (HPC) platforms are still dominated by batch jobs. Accordingly, effective batch job scheduling is crucial to obtain high system efficiency. Existing HPC batch job schedulers typically leverage heuristic…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-03 Di Zhang , Dong Dai , Youbiao He , Forrest Sheng Bao , Bing Xie

In this paper, we investigate the scheduling issue of diesel generators (DGs) in an Internet of Things (IoT)-Driven isolated microgrid (MG) by deep reinforcement learning (DRL). The renewable energy is fully exploited under the uncertainty…

Machine Learning · Computer Science 2023-07-07 Jiaju Qi , Lei Lei , Kan Zheng , Simon X. Yang , Xuemin , Shen

In the past few years, we have envisioned an increasing number of businesses start driving by big data analytics, such as Amazon recommendations and Google Advertisements. At the back-end side, the businesses are powered by big data…

Performance · Computer Science 2021-10-26 Ying Mao , Victoria Green , Jiayin Wang , Haoyi Xiong , Zhishan Guo

This paper considers a cost minimization problem for data centers with N servers and randomly arriving service requests. A central router decides which server to use for each new request. Each server has three types of states (active, idle,…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-20 Xiaohan Wei , Michael J. Neely

Electricity cost is a dominant and rapidly growing expense in data centers. Unfortunately, much of the consumed energy is wasted because servers are idle for extended periods of time. We study a capacity management problem that dynamically…

Data Structures and Algorithms · Computer Science 2021-08-02 Susanne Albers , Jens Quedenfeld

Advance reservation is important to guarantee the quality of services of jobs by allowing exclusive access to resources over a defined time interval on resources. It is a challenge for the scheduler to organize available resources…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-03-06 Bo Li , Yijian Pei , Bin Shen , Hao Wu , Min He , Jundong Yang

This work considers the problem of control and resource scheduling in networked systems. We present DIRA, a Deep reinforcement learning based Iterative Resource Allocation algorithm, which is scalable and control-aware. Our algorithm is…

Systems and Control · Computer Science 2019-09-24 Adrian Redder , Arunselvan Ramaswamy , Daniel E. Quevedo