English
Related papers

Related papers: Faster Data-access in Large-scale Systems: Network…

200 papers

We consider the problem of designing a packet-level congestion control and scheduling policy for datacenter networks. Current datacenter networks primarily inherit the principles that went into the design of Internet, where congestion…

Networking and Internet Architecture · Computer Science 2017-10-10 Devavrat Shah , Qiaomin Xie

In this paper we study how coding in distributed storage reduces expected download time, in addition to providing reliability against disk failures. The expected download time is reduced because when a content file is encoded to add…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-03-07 Gauri Joshi , Yanpei Liu , Emina Soljanin

In a multi-server system, how can one get better performance than random assignment of jobs to servers if queue-states cannot be queried by the dispatcher? A replication strategy has recently been proposed where $d$ copies of each arriving…

Performance · Computer Science 2019-12-10 Ken Duffy , Seva Shneer

Cloud resource management is often modeled by two-dimensional bin packing with a set of items that correspond to tasks having fixed CPU and memory requirements. However, applications running in clouds are much more flexible: modern…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-01 Bartłomiej Przybylski , Paweł Żuk , Krzysztof Rzadca

Allocation of (redundant) file chunks throughout a distributed storage system affects important performance metrics such as the probability of file recovery, data download time, or the service rate of the system under a given data access…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-24 Pei Peng , Emina Soljanin

We consider load balancing problem in a cache network consisting of storage-enabled servers forming a distributed content delivery scenario. Previously proposed load balancing solutions cannot perfectly balance out requests among servers,…

Information Theory · Computer Science 2019-08-06 Mahdi Jafari Siavoshani , Farzad Parvaresh , Ali Pourmiri , Seyed Pooya Shariatpanahi

Erasure codes are an integral part of many distributed storage systems aimed at Big Data, since they provide high fault-tolerance for low overheads. However, traditional erasure codes are inefficient on reading stored data in degraded…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-06-27 Kyumars Sheykh Esmaili , Lluis Pamies-Juarez , Anwitaman Datta

Multi-server queueing systems are widely used models for job scheduling in machine learning, wireless networks, crowdsourcing, and healthcare systems. This paper considers a multi-server system with multiple servers and multiple types of…

Machine Learning · Computer Science 2023-06-05 Zixian Yang , R. Srikant , Lei Ying

Runtime variability in computing systems causes some tasks to straggle and take much longer than expected to complete. These straggler tasks are known to significantly slowdown distributed computation. Job execution with speculative…

Performance · Computer Science 2019-06-14 Mehmet Fatih Aktas , Emina Soljanin

Storage allocation affects important performance measures of distributed storage systems. Most previous studies on the storage allocation consider its effect separately either on the success of the data recovery or on the service rate…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Moslem Noori , Emina Soljanin , Masoud Ardakani

Large-scale distributed storage systems typically use erasure codes to provide durability of data in the face of failures. A set of $k$ blocks to be stored is encoded using an $[n, k]$ code to generate $n$ blocks that are then stored on…

Information Theory · Computer Science 2019-07-31 Francisco Maturana , K. V. Rashmi

These days enterprise applications try to integrate online processing and batch jobs into a common software stack for seamless monitoring and driverless operations. Continuous integration of these systems results in choking of the poorly…

Performance · Computer Science 2015-12-16 Subrata Ashe

The work establishes the exact performance limits of stochastic coded caching when users share a bounded number of cache states, and when the association between users and caches, is random. Under the premise that more balanced…

Information Theory · Computer Science 2021-01-12 Adeel Malik , Berksan Serbetci , Emanuele Parrinello , Petros Elia

Distributed storage systems for large clusters typically use replication to provide reliability. Recently, erasure codes have been used to reduce the large storage overhead of three-replicated systems. Reed-Solomon codes are the standard…

Recent studies in different fields of science caused emergence of needs for high performance computing systems like Cloud. A critical issue in design and implementation of such systems is resource allocation which is directly affected by…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-05 Masoud Nosrati , Abdolah Chalechale , Ronak Karimi

In large-scale distributed computing clusters, such as Amazon EC2, there are several types of "system noise" that can result in major degradation of performance: bottlenecks due to limited communication bandwidth, latency due to straggler…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-21 Amirhossein Reisizadeh , Saurav Prakash , Ramtin Pedarsani , Amir Salman Avestimehr

Mean field models are a popular tool used to analyse load balancing policies. In some cases the waiting time distribution of the mean field limit has an explicit form. In other cases it can be computed as the solution of a set of…

Probability · Mathematics 2021-01-29 Tim Hellemans , Benny Van Houdt

We propose two coded schemes for the distributed computing problem of multiplying a matrix by a set of vectors. The first scheme is based on partitioning the matrix into submatrices and applying maximum distance separable (MDS) codes to…

Information Theory · Computer Science 2018-10-22 Albin Severinson , Alexandre Graell i Amat , Eirik Rosnes

In a cloud computing job with many parallel tasks, the tasks on the slowest machines (straggling tasks) become the bottleneck in the job completion. Computing frameworks such as MapReduce and Spark tackle this by replicating the straggling…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-14 Da Wang , Gauri Joshi , Gregory Wornell

This paper investigates an edge computing system where requests are processed by a set of replicated edge servers. We investigate a class of applications where similar queries produce identical results. To reduce processing overhead on the…

Emerging Technologies · Computer Science 2024-05-29 Adrian-Cristian Nicolaescu , Spyridon Mastorakis , Md Washik Al Azad , David Griffin , Miguel Rio
‹ Prev 1 4 5 6 7 8 10 Next ›