English
Related papers

Related papers: Simplex Queues for Hot-Data Download

200 papers

The paper presents techniques for analyzing the expected download time in distributed storage systems that employ systematic availability codes. These codes provide access to hot data through the systematic server containing the object and…

Performance · Computer Science 2021-03-11 Mehmet Fatih Aktas , Swanand Kadhe , Emina Soljanin , Alex Sprintson

We consider a distributed storage system which stores several hot (popular) and cold (less popular) data files across multiple nodes or servers. Hot files are stored using repetition codes while cold files are stored using erasure codes.…

Performance · Computer Science 2021-05-10 Tim Hellemans , Arti Yardi , Tejas Bodas

Cloud storage systems generally add redundancy in storing content files such that $K$ files are replicated or erasure coded and stored on $N > K$ nodes. In addition to providing reliability against failures, the redundant copies can be used…

In this paper, we study the problem of reducing the delay of downloading data from cloud storage systems by leveraging multiple parallel threads, assuming that the data has been encoded and stored in the clouds using fixed rate forward…

Information Theory · Computer Science 2016-11-17 Shengbo Chen , Yin Sun , Ulas C. Kozat , Longbo Huang , Prasun Sinha , Guanfeng Liang , Xin Liu , Ness B. Shroff

One key requirement for storage clouds is to be able to retrieve data quickly. Recent system measurements have shown that the data retrieving delay in storage clouds is highly variable, which may result in a long latency tail. One crucial…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Yin Sun , Zizhan Zheng , C. Emre Koksal , Kyu-Han Kim , Ness B. Shroff

Erasure codes have been widely considered a promising solution to enhance data reliability at low storage costs. However, in modern geo-distributed storage systems, erasure codes may incur high data access latency as they require data…

Information Theory · Computer Science 2020-12-08 Kaiyang Liu , Jun Peng , Jingrong Wang , Jianping Pan

Most data generated by modern applications is stored in the cloud, and there is an exponential growth in the volume of jobs to access these data and perform computations using them. The volume of data access or computing jobs can be…

Performance · Computer Science 2022-08-16 Tuhinangshu Choudhury , Weina Wang , Gauri Joshi

In cloud storage systems with a large number of servers, files are typically not stored in single servers. Instead, they are split, replicated (to ensure reliability in case of server malfunction) and stored in different servers. We analyze…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-09 Avishek Ghosh , Kannan Ramchandran

Cloud computing facilitates the access of applications and data from any location by a distributed storage system. Erasure codes offer better data replication technique with reduced storage costs for more reliability. This paper considers…

Information Theory · Computer Science 2021-02-04 Srujan Teja Thomdapu , Ketan Rajawat

Scientific computing workflows generate enormous distributed data that is short-lived, yet critical for job completion time. This class of data is called intermediate data. A common way to achieve high data availability is to replicate…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-14 Zhe Zhang , Brian Bockelman , Derek Weitzel , David Swanson

Modern distributed storage systems offer large capacity to satisfy the exponentially increasing need of storage space. They often use erasure codes to protect against disk and node failures to increase reliability, while trying to meet the…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-08-04 Yu Xiang , Tian Lan , Vaneet Aggarwal , Yih-Farn R Chen

Modern distributed storage systems often use erasure codes to protect against disk and node failures to increase reliability, while trying to meet the latency requirements of the applications and clients. Storage systems may have caches at…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-07-24 Vaneet Aggarwal , Yih-Farn R. Chen , Tian Lan , Yu Xiang

In this paper we study how coding in distributed storage reduces expected download time, in addition to providing reliability against disk failures. The expected download time is reduced because when a content file is encoded to add…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-03-07 Gauri Joshi , Yanpei Liu , Emina Soljanin

We study the fundamental trade-off between storage and content download time. We show that the download time can be significantly reduced by dividing the content into chunks, encoding it to add redundancy and then distributing it across…

Information Theory · Computer Science 2012-10-11 Gauri Joshi , Yanpei Liu , Emina Soljanin

Erasure coding is a storage-efficient alternative to replication for achieving reliable data backup in distributed storage systems. During the storage process, traditional erasure codes require a unique source node to create and upload all…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-03-19 Lluis Pamies-Juarez , Anwitaman Datta , Frédérique Oggier

Redundant storage maintains the performance of distributed systems under various forms of uncertainty. This paper considers the uncertainty in node access and download service. We consider two access models under two download service…

Information Theory · Computer Science 2021-08-09 Pei Peng , Moslem Noori , Emina Soljanin

Network codes designed specifically for distributed storage systems have the potential to provide dramatically higher storage efficiency for the same availability. One main challenge in the design of such codes is the exact repair problem:…

Information Theory · Computer Science 2011-09-02 Dimitris S. Papailiopoulos , Jianqiang Luo , Alexandros G. Dimakis , Cheng Huang , Jin Li

We study the data reliability problem for a community of devices forming a mobile cloud storage system. We consider the application of regenerating codes for file maintenance within a geographically-limited area. Such codes require lower…

Networking and Internet Architecture · Computer Science 2017-03-02 Gokhan Calis , Swetha Shivaramaiah , O. Ozan Koyluoglu , Loukas Lazos

In order to accommodate the ever-growing data from various, possibly independent, sources and the dynamic nature of data usage rates in practical applications, modern cloud data storage systems are required to be scalable, flexible, and…

Information Theory · Computer Science 2019-05-08 Siyi Yang , Ahmed Hareedy , Robert Calderbank , Lara Dolecek

Our paper presents solutions that can significantly improve the delay performance of putting and retrieving data in and out of cloud storage. We first focus on measuring the delay performance of a very popular cloud storage service Amazon…

Networking and Internet Architecture · Computer Science 2013-11-04 Guanfeng Liang , Ulas C. Kozat
‹ Prev 1 2 3 10 Next ›