English
Related papers

Related papers: To schedule or not to schedule: when no-scheduling…

200 papers

Millions of flows are routed concurrently through a modern data-center. These networks are often built as Clos topologies, and flow demands are constrained only by the link capacities at the ingress and egress points. The minimum congestion…

Networking and Internet Architecture · Computer Science 2025-05-08 Miguel Ferreira , Nirav Atre , Justine Sherry , Michael Dinitz , João Luís Sobrinho

Serving systems for Large Language Models (LLMs) improve throughput by processing several requests concurrently. However, multiplexing hardware resources between concurrent requests involves non-trivial scheduling decisions. Practical…

Machine Learning · Computer Science 2025-01-29 Ferdi Kossmann , Bruce Fontaine , Daya Khudia , Michael Cafarella , Samuel Madden

As demand for Large Language Models (LLMs) and AI agents grows rapidly, optimizing systems for efficient LLM inference becomes critical. While significant efforts have targeted system-level engineering, little has been explored from a…

Machine Learning · Statistics 2026-05-19 J. G. Dai , Tianze Deng , Yueying Li , Tianyi Peng

Having large batch sizes is one of the most critical aspects of increasing the accelerator efficiency and the performance of DNN model inference. However, existing model serving systems cannot achieve adequate batch sizes while meeting…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-01 Lequn Chen , Weixin Deng , Anirudh Canumalla , Yu Xin , Danyang Zhuo , Matthai Philipose , Arvind Krishnamurthy

Datacenter networks commonly facilitate the transmission of data in distributed computing frameworks through coflows, which are collections of parallel flows associated with a common task. Most of the existing research has concentrated on…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-24 Olivier Brun , Rachid El-Azouzi , Quang-Trung Luu , Francesco De Pellergrini , Balakrishna J. Prabhu , Cédric Richier

We consider a natural scheduling problem which arises in many distributed computing frameworks. Jobs with diverse resource requirements (e.g. memory requirements) arrive over time and must be served by a cluster of servers, each with a…

Networking and Internet Architecture · Computer Science 2019-01-21 Konstantinos Psychas , Javad Ghaderi

Fog computing brings the functionality of the cloud near the edge of the network with the help of fog devices/micro data centers ($mdcs$). Job scheduling in such systems is a complex problem due to the hierarchical and geo-distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-10 Amanjot Kaur , Nitin Auluck

Coflow is a recently proposed network abstraction for data-parallel computing applications. This paper considers scheduling coflows with precedence constraints in identical parallel networks, such as to minimize the total weighted…

Data Structures and Algorithms · Computer Science 2022-07-15 Chi-Yeh Chen

Training deep neural networks (DNNs) is a major workload in datacenters today, resulting in a tremendously fast growth of energy consumption. It is important to reduce the energy consumption while completing the DL training jobs early in…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-16 Diandian Gu , Xintong Xie , Gang Huang , Xin Jin , Xuanzhe Liu

We study online scheduling problems on a single processor that can be viewed as extensions of the well-studied problem of minimizing total weighted flow time. In particular, we provide a framework of analysis that is derived by duality…

Data Structures and Algorithms · Computer Science 2021-01-08 Spyros Angelopoulos , Giorgio Lucarelli , Nguyen Kim Thang

We consider the problem of scheduling in constrained queueing networks with a view to minimizing packet delay. Modern communication systems are becoming increasingly complex, and are required to handle multiple types of traffic with widely…

Machine Learning · Computer Science 2021-05-04 Mohammani Zaki , Avi Mohan , Aditya Gopalan , Shie Mannor

The ever-increasing gap between compute and I/O performance in HPC platforms, together with the development of novel NVMe storage devices (NVRAM), led to the emergence of the burst buffer concept - an intermediate persistent storage layer…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-11 Jan Kopanski , Krzysztof Rzadca

Motivated by the increasing importance of providing delay-guaranteed services in general computing and communication systems, and the recent wide adoption of learning and prediction in network control, in this work, we consider a general…

Networking and Internet Architecture · Computer Science 2018-01-08 Kun Chen , Longbo Huang

Modern data center workloads are composed of multiserver jobs, computational jobs that require multiple servers in order to run. A data center server can run many multiserver jobs in parallel, as long as it has sufficient resources to meet…

In this paper, we~present a novel scheduling solution for a class of System-on-Chip (SoC) systems where heterogeneous chip resources (DSP, FPGA, GPU, etc.) must be efficiently scheduled for continuously arriving hierarchical jobs with their…

Artificial Intelligence · Computer Science 2020-06-08 Tegg Taekyong Sung , Jeongsoo Ha , Jeewoo Kim , Alex Yahja , Chae-Bong Sohn , Bo Ryu

Modern data centers serve workloads which are capable of exploiting parallelism. When a job parallelizes across multiple servers it will complete more quickly, but jobs receive diminishing returns from being allocated additional servers.…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-20 Benjamin Berg , Rein Vesilo , Mor Harchol-Balter

In data-parallel computing frameworks, intermediate parallel data is often produced at various stages which needs to be transferred among servers in the datacenter network (e.g. the shuffle phase in MapReduce). A stage often cannot start or…

Data Structures and Algorithms · Computer Science 2017-04-28 Mehrnoosh Shafiee , Javad Ghaderi

Co-flows model a modern scheduling setting that is commonly found in a variety of applications in distributed and cloud computing. A stochastic co-flow task contains a set of parallel flows with randomly distributed sizes. Further, many…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-26 Ruijiu Mao , Vaneet Aggarwal , Mung Chiang

We consider a generalized processing system having several queues, where the available service rate combinations are fluctuating over time due to reliability and availability variations. The objective is to allocate the available resources,…

Networking and Internet Architecture · Computer Science 2011-05-04 Kevin Ross , Nicholas Bambos , George Michailidis

This paper addresses the scheduling problem for unrelated crowd workers in mobile social networks, where the required service time for each task varies among the assigned crowd workers. The goal is to minimize the total weighted completion…

Data Structures and Algorithms · Computer Science 2026-03-30 Chi-Yeh Chen