English
Related papers

Related papers: Scalable Distributed Job Processing with Dynamic L…

200 papers

Modern data centers are tasked with processing heterogeneous workloads consisting of various classes of jobs. These classes differ in their arrival rates, size distributions, and job parallelizability. With respect to paralellizability,…

Performance · Computer Science 2020-05-21 Benjamin Berg , Mor Harchol-Balter , Benjamin Moseley , Weina Wang , Justin Whitehouse

Present-day quantum systems face critical bottlenecks, including limited qubit counts, brief coherence intervals, and high susceptibility to errors-all of which obstruct the execution of large and complex circuits. The advancement of…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-13 Waylon Luo , Jiapeng Zhao , Tong Zhan , Qiang Guan

Distributed software systems that are designed to run over workstation machines within organisations are termed workstation-based. Workstation-based systems are characterised by dynamically changing sets of machines that are used primarily…

Databases · Computer Science 2012-07-23 Angus Macdonald

Carefully balancing load in distributed stream processing systems has a fundamental impact on execution latency and throughput. Load balancing is challenging because real-world workloads are skewed: some tuples in the stream are associated…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-01-28 Muhammad Anis Uddin Nasir , Gianmarco De Francisci Morales , Nicolas Kourtellis , Marco Serafini

In performative stochastic optimization, decisions can influence the distribution of random parameters, rendering the data-generating process itself decision-dependent. In practice, decision-makers rarely have access to the true…

Optimization and Control · Mathematics 2025-10-27 Zhuangzhuang Jia , Yijie Wang , Roy Dong , Grani A. Hanasusanto

Cyber-physical systems increasingly rely on distributed computing platforms where sensing, computing, actuation, and communication resources are shared by a multitude of applications. Such `cyber-physical cloud computing platforms' present…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-10-03 Gabor Karsai , Daniel Balasubramanian , Abhishek Dubey , William R. Otte

In P2P systems, large volumes of data are declustered naturally across a large number of peers. But it is very difficult to control the initial data distribution because every user has the freedom to share any data with other users. The…

Networking and Internet Architecture · Computer Science 2010-09-24 S. Ayyasamy , S. N. Sivanandam

We develop a Markovian framework for load balancing that combines classical algorithms such as Power-of-$d$ with auto-scaling mechanisms that allow the net service capacity to scale up or down in response to the current load on the same…

Optimization and Control · Mathematics 2025-02-04 Jonatha Anselmi

In the rapidly expanding field of parallel processing, job schedulers are the "operating systems" of modern big data architectures and supercomputing systems. Job schedulers allocate computing resources and control the execution of…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-06 Albert Reuther , Chansup Byun , William Arcand , David Bestor , Bill Bergeron , Matthew Hubbell , Michael Jones , Peter Michaleas , Andrew Prout , Antonio Rosa , Jeremy Kepner

In the problem of online load balancing on uniformly related machines with bounded migration, jobs arrive online one after another and have to be immediately placed on one of a given set of machines without knowledge about jobs that may…

Data Structures and Algorithms · Computer Science 2022-09-05 Marten Maack

This paper introduces a novel architecture of distributed systems--called framed distributed system, or FDS--that braces a given system via a built-in virtual framework that controls the flow of messages between system components and…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-03-21 Naftaly Minsky

Modern databases use dynamic search structures that store an enormous amount of data, and often serve them using multi-threaded algorithms to support the ever-increasing throughput needs. When this throughput need exceeds the capacity of…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-17 Raaghav Ravishankar , Sandeep Kulkarni , Sathya Peri , Gokarna Sharma

We present a principled and efficient planning algorithm for collaborative multiagent dynamical systems. All computation, during both the planning and the execution phases, is distributed among the agents; each agent only needs to model and…

Artificial Intelligence · Computer Science 2013-01-07 Carlos E. Guestrin , Geoffrey Gordon

We propose a new data-centric synchronization framework for carrying out of machine learning (ML) tasks in a distributed environment. Our framework exploits the iterative nature of ML algorithms and relaxes the application agnostic bulk…

Databases · Computer Science 2015-08-06 Naman Goel , Divyakant Agrawal , Sanjay Chawla , Ahmed Elmagarmid

Graph clustering is a fundamental computational problem with a number of applications in algorithm design, machine learning, data mining, and analysis of social networks. Over the past decades, researchers have proposed a number of…

Data Structures and Algorithms · Computer Science 2019-04-12 He Sun , Luca Zanetti

To facilitate load balancing, distributed systems store data redundantly. We evaluate the load balancing performance of storage schemes in which each object is stored at $d$ different nodes, and each node stores the same number of objects.…

Performance · Computer Science 2021-01-26 Mehmet Fatih Aktas , Amir Behrouzi-Far , Emina Soljanin , Philip Whiting

Dynamic resource management is an increasingly important capability of High Performance Computing systems, as it enables jobs to adjust their resource allocation at runtime. This capability can reduce workload makespan, substantially…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-28 Iker Martín-Álvarez , José I. Aliaga , Maribel Castillo

In order to increase availability in a distributed system some or all of the data items are replicated and stored at separate sites. This is an issue of key concern especially since there is such a proliferation of wireless technologies and…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-06-11 Joel M. Crichlow , Stephen J. Hartley , Michael Hosein

Motivated by the growing demand for serving large language model inference requests, we study distributed load balancing for global serving systems with network latencies. We consider a fluid model in which continuous flows of requests…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-16 Santiago R. Balseiro , Vahab S. Mirrokni , Bartek Wydrowski

The efficient allocation of human resources is a critical concern in software development and other industries. This paper introduces a rigorous mathematical methodology for task assignment, employing Mixed Integer Linear Programming (MILP)…

Optimization and Control · Mathematics 2025-12-16 Lokendra Kumar , Neelesh S. Upadhye , Kannan Piedy