English
Related papers

Related papers: Faster Data-access in Large-scale Systems: Network…

200 papers

Low latency is critical for interactive networked applications. But while we know how to scale systems to increase capacity, reducing latency --- especially the tail of the latency distribution --- can be much more difficult. In this paper,…

Networking and Internet Architecture · Computer Science 2013-06-18 Ashish Vulimiri , P. Brighten Godfrey , Radhika Mittal , Justine Sherry , Sylvia Ratnasamy , Scott Shenker

We consider a large distributed service system consisting of $n$ homogeneous servers with infinite capacity FIFO queues. Jobs arrive as a Poisson process of rate $\lambda n/k_n$ (for some positive constant $\lambda$ and integer $k_n$). Each…

Performance · Computer Science 2019-10-23 Martin Zubeldia

In cloud storage systems, hot data is usually replicated over multiple nodes in order to accommodate simultaneous access by multiple users as well as increase the fault tolerance of the system. Recent cloud storage research has proposed…

Information Theory · Computer Science 2018-04-19 Mehmet Fatih Aktas , Elie Najm , Emina Soljanin

Redundant storage maintains the performance of distributed systems under various forms of uncertainty. This paper considers the uncertainty in node access and download service. We consider two access models under two download service…

Information Theory · Computer Science 2021-08-09 Pei Peng , Moslem Noori , Emina Soljanin

Redundancy for straggler mitigation, originally in data download and more recently in distributed computing context, has been shown to be effective both in theory and practice. Analysis of systems with redundancy has drawn significant…

Performance · Computer Science 2017-10-03 Mehmet Fatih Aktas , Pei Peng , Emina Soljanin

Our interest lies in load balancing jobs in large scale systems consisting of multiple dispatchers and FCFS servers. In the absence of any information on job sizes, dispatchers typically use queue length information reported by the servers…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-16 Tim Hellemans , Benny Van Houdt

We consider a load balancing system consisting of $n$ single-server queues working in parallel, with heterogeneous service rates. Jobs arrive to a central dispatcher, which has to dispatch them to one of the queues immediately upon arrival.…

Performance · Computer Science 2025-10-17 Yishun Luo , Martin Zubeldia

Consider a multi-cell mobile edge computing network, in which each user wishes to compute the product of a user-generated data matrix with a network-stored matrix. This is done through task offloading by means of input uploading,…

Information Theory · Computer Science 2021-01-19 Kuikui Li , Meixia Tao , Jingjing Zhang , Osvaldo Simeone

Large Language Models (LLMs) are increasingly deployed in both latency-sensitive online services and cost-sensitive offline workloads. Co-locating these workloads on shared serving instances can improve resource utilization, but directly…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-01 Siyu Wu , Zihan Tang , Yuting Zeng , Hui Chen , Guiguang Ding , Tongxuan Liu , Ke Zhang , Hailong Yang

Data deduplication, one of the key features of modern Big Data storage devices, is the process of removing replicas of data chunks stored by different users. Despite the importance of deduplication, several drawbacks of the method, such as…

Information Theory · Computer Science 2024-11-05 Yun-Han Li , Jin Sima , Ilan Shomorony , Olgica Milenkovic

We consider the following distributed service model: jobs with unit mean, general distribution, and independent processing times arrive as a renewal process of rate $\lambda n$, with $0<\lambda<1$, and are immediately dispatched to one of…

Probability · Mathematics 2018-07-10 David Gamarnik , John N. Tsitsiklis , Martin Zubeldia

We consider a load balancing system comprised of a fixed number of single server queues, operating under the well-known Join-the-Shortest Queue policy, and where jobs/customers are impatient and abandon if they do not receive service after…

Probability · Mathematics 2023-04-05 Prakirt Raj Jhunjhunwala , Martin Zubeldia , Siva Theja Maguluri

Coded computation is a framework which provides redundancy in distributed computing systems to speed up largescale tasks. Although most existing works assume an error-free scenarios in a master-worker setup, the link failures are common in…

Information Theory · Computer Science 2019-01-14 Dong-Jun Han , Jy-yong Sohn , Jaekyun Moon

Performance of distributed optimization and learning systems is bottlenecked by "straggler" nodes and slow communication links, which significantly delay computation. We propose a distributed optimization framework where the dataset is…

Machine Learning · Statistics 2018-03-15 Can Karakus , Yifan Sun , Suhas Diggavi , Wotao Yin

Reliability in distributed storage systems has typically focused on the design and deployment of data replication or erasure coding techniques. Although some scenarios have considered the use of replication for hot data and erasure coding…

Information Theory · Computer Science 2025-11-04 Daniel E. Lucani , Marcell Fehér

Recent studies have shown that retransmissions can cause heavy-tailed transmission delays even when packet sizes are light-tailed. Moreover, the impact of heavy-tailed delays persists even when packets size are upper bounded. The key…

Information Theory · Computer Science 2012-02-22 Yang Yang , Jian Tan , Ness B. Shroff , Hesham El-Gamal

Large-scale machine learning and data mining applications require computer systems to perform massive matrix-vector and matrix-matrix multiplication operations that need to be parallelized across multiple nodes. The presence of straggling…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-01 Ankur Mallick , Malhar Chaudhari , Utsav Sheth , Ganesh Palanikumar , Gauri Joshi

Master-worker distributed computing systems use task replication in order to mitigate the effect of slow workers, known as stragglers. Tasks are grouped into batches and assigned to one or more workers for execution. We first consider the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-29 Amir Behrouzi-Far , Emina Soljanin

The explosion of the amount of data stored in cloud systems calls for more efficient paradigms for redundancy. While replication is widely used to ensure data availability, erasure correcting codes provide a much better trade-off between…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-03-16 Steve Jiekak , Anne-Marie Kermarrec , Nicolas Le Scouarnec , Gilles Straub , Alexandre Van Kempen

This initial version of this document was written back in 2014 for the sole purpose of providing fundamentals of reliability theory as well as to identify the theoretical types of machinery for the prediction of durability/availability of…

Performance · Computer Science 2023-01-24 Suayb S. Arslan