English
Related papers

Related papers: Randomized Work Stealing versus Sharing in Large-s…

200 papers

Modern data centers are tasked with processing heterogeneous workloads consisting of various classes of jobs. These classes differ in their arrival rates, size distributions, and job parallelizability. With respect to paralellizability,…

Performance · Computer Science 2020-05-21 Benjamin Berg , Mor Harchol-Balter , Benjamin Moseley , Weina Wang , Justin Whitehouse

We tackle in this paper an online network resource allocation problem with job transfers. The network is composed of many servers connected by communication links. The system operates in discrete time; at each time slot, the administrator…

Machine Learning · Statistics 2023-11-17 Ahmed Sid-Ali , Ioannis Lambadaris , Yiqiang Q. Zhao , Gennady Shaikhet , Amirhossein Asgharnia

We study in this paper the impact of communication latency on the classical Work Stealing load balancing algorithm. Our paper extends the reference model in which we introduce a latency parameter. By using a theoretical analysis and…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-03 Nicolas Gast , Mohammed Khatiri , Denis Trystram , Frederic Wagner

Computational Grids are a new trend in distributed computing systems. They allow the sharing of geographically distributed resources in an efficient way, extending the boundaries of what we perceive as distributed computing. Various…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-08-24 D. Thilagavathi , Antony Selvadoss Thanamani

Processing computation-intensive jobs at multiple processing cores in parallel is essential in many real-world applications. In this paper, we consider an idealised model for job parallelism in which a job can be served simultaneously by…

Probability · Mathematics 2022-07-22 Ayalvadi Ganesh , Arpan Mukhopadhyay

We study single-machine scheduling of jobs, each belonging to a job type that determines its duration distribution. We start by analyzing the scenario where the type characteristics are known and then move to two learning scenarios where…

Machine Learning · Computer Science 2023-06-02 Nadav Merlis , Hugo Richard , Flore Sentenac , Corentin Odic , Mathieu Molina , Vianney Perchet

Redundant storage maintains the performance of distributed systems under various forms of uncertainty. This paper considers the uncertainty in node access and download service. We consider two access models under two download service…

Information Theory · Computer Science 2021-08-09 Pei Peng , Moslem Noori , Emina Soljanin

In the problem of online load balancing on uniformly related machines with bounded migration, jobs arrive online one after another and have to be immediately placed on one of a given set of machines without knowledge about jobs that may…

Data Structures and Algorithms · Computer Science 2022-09-05 Marten Maack

We study a fair resource scheduling problem, where a set of interval jobs are to be allocated to heterogeneous machines controlled by agents. Each job is associated with release time, deadline, and processing time such that it can be…

Computer Science and Game Theory · Computer Science 2022-01-03 Bo Li , Minming Li , Ruilong Zhang

When parallelizing a set of jobs across many servers, one must balance a trade-off between granting priority to short jobs and maintaining the overall efficiency of the system. When the goal is to minimize the mean flow time of a set of…

Performance · Computer Science 2020-11-24 Benjamin Berg , Rein Vesilo , Mor Harchol-Balter

Proportional fairness is a popular service allocation mechanism to describe and analyze the performance of data networks at flow level. Recently, several authors have shown that the invariant distribution of such networks admits a product…

Probability · Mathematics 2015-06-18 Maria Vlasiou , Jiheng Zhang , Bert Zwart

One typical use case of large-scale distributed computing in data centers is to decompose a computation job into many independent tasks and run them in parallel on different machines, sometimes known as the "embarrassingly parallel"…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-04-07 Da Wang , Gauri Joshi , Gregory Wornell

Allocation of (redundant) file chunks throughout a distributed storage system affects important performance metrics such as the probability of file recovery, data download time, or the service rate of the system under a given data access…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-24 Pei Peng , Emina Soljanin

We consider a distributed server system consisting of a large number of servers, each with limited capacity on multiple resources (CPU, memory, disk, etc.). Jobs with different rewards arrive over time and require certain amounts of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-29 Konstantinos Psychas , Javad Ghaderi

In the context of decision making under explorable uncertainty, scheduling with testing is a powerful technique used in the management of computer systems to improve performance via better job-dispatching decisions. Upon job arrival, a…

Performance · Computer Science 2025-02-13 Jonatha Anselmi , Josu Doncel

We show how to extend classical work-stealing to deal also with data parallel tasks that can require any number of threads r >= 1 for their execution. We explain in detail the so introduced idea of work-stealing with deterministic…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-12-23 Martin Wimmer , Jesper Larsson Träff

A fundamental problem in distributed computing is the task of cooperatively executing a given set of $t$ tasks by $p$ processors where the communication medium is dynamic and subject to failures. The dynamics of the communication medium…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-03-27 Chadi Kari , Alexander Russell , Narasimha Shashidhar

The paper studies approximations and control of a processor sharing (PS) server where the service rate depends on the number of jobs occupying the server. The control of such a system is implemented by imposing a limit on the number of jobs…

Systems and Control · Computer Science 2014-09-02 Varun Gupta , Jiheng Zhang

We consider a distributed computing network consisting of a master and multiple workers processing tasks of different types. The master is running multiple applications. Each application stochastically generates real-time jobs with a strict…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-31 Yu-Pin Hsu , Yu-Chih Huang , Shin-Lin Shieh

This paper revisits the well known single machine scheduling problem to minimize total weighted completion times. The twist is that job sizes are stochastic from unknown distributions, and the scheduler has access to only a single sample…

Data Structures and Algorithms · Computer Science 2023-08-23 Puck te Rietmole , Marc Uetz