English
Related papers

Related papers: Download time analysis for distributed storage sys…

200 papers

In this paper, we present a comprehensive analysis investigating the reliability of SSD-based I/O caching architectures used in enterprise storage systems under power failure and high-operating temperature. We explore variety of SSDs from…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-04 Saba Ahmadian , Farhad Taheri , Hossein Asadi

Data loading can dominate deep neural network training time on large-scale systems. We present a comprehensive study on accelerating data loading performance in large-scale distributed training. We first identify performance and scalability…

Machine Learning · Computer Science 2020-02-20 Chih-Chieh Yang , Guojing Cong

Distributed storage systems and associated storage codes can efficiently store a large amount of data while ensuring that data is retrievable in case of node failure. The study of such systems, particularly the design of storage codes over…

Information Theory · Computer Science 2014-09-26 David Karpuk , Camilla Hollanti , Amaro Barreal

Centralized coded caching problem is studied for the two-user scenario, considering heterogeneous cache capacities at the users and private channels from the server to the users, in addition to a shared channel. Optimal caching and delivery…

Information Theory · Computer Science 2019-01-07 Daming Cao , Deyao Zhang , Pengyao Chen , Nan Liu , Wei Kang , Deniz Gündüz

Large-scale systems with arrays of solid state disks (SSDs) have become increasingly common in many computing segments. To make such systems resilient, we can adopt erasure coding such as Reed-Solomon (RS) code as an alternative to…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-20 Sungjoon Koh , Jie Zhang , Miryeong Kwon , Jungyeon Yoon , David Donofrio , Namsung Kim , Myoungsoo Jung

Network codes designed specifically for distributed storage systems have the potential to provide dramatically higher storage efficiency for the same availability. One main challenge in the design of such codes is the exact repair problem:…

Information Theory · Computer Science 2011-09-02 Dimitris S. Papailiopoulos , Jianqiang Luo , Alexandros G. Dimakis , Cheng Huang , Jin Li

Maximum distance separable (MDS) array codes are widely employed in modern distributed storage systems to provide high data reliability with small storage overhead. Compared with the data access latency of the entire file, the data access…

Information Theory · Computer Science 2025-01-22 Hao Shi , Zhengyi Jiang , Zhongyi Huang , Linqi Song , Hanxu Hou

Repair operations in distributed storage systems potentially expose the data to malicious acts of passive eavesdroppers or active adversaries, which can be detrimental to the security of the system. This paper presents erasure codes and…

Information Theory · Computer Science 2015-08-18 Nihar B. Shah , K. V. Rashmi , Kannan Ramchandran , P. Vijay Kumar

The reliability of erasure-coded distributed storage systems, as measured by the mean time to data loss (MTTDL), depends on the repair bandwidth of the code. Repair-efficient codes provide reliability values several orders of magnitude…

Information Theory · Computer Science 2017-08-04 Vaneet Aggarwal , Chao Tian , Vinay A. Vaishampayan , Yih-Farn R. Chen

Fragmentation leads to unpredictable and degraded application performance. While these problems have been studied in detail for desktop filesystem workloads, this study examines newer systems such as scalable object stores and multimedia…

Databases · Computer Science 2009-08-21 Russell Sears , Catharine van Ingen

In the current landscape of big data, the reliability and performance of storage systems are essential to the success of various applications and services. as data volumes continue to grow exponentially, the complexity and scale of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-06 Joshua Ludolf , Yesmin Reyna-Hernandez , Matthew Trevino

We investigate in this work the problem of Erasure Combinatorial Batch Codes, in which $n$ files are stored on $m$ servers so that every set of $n-r$ servers allows a client to retrieve at most $k$ distinct files by downloading at most $t$…

Information Theory · Computer Science 2023-10-03 Phuc-Lu Le , Son Hoang Dau , Hy Dinh Ngo , Thuc D. Nguyen

We study the content delivery problem between a transmitter and two receivers through erasure links, when each receiver has access to some random side-information about the files requested by the other user. The random side-information is…

Information Theory · Computer Science 2021-11-18 Alireza Vahid , Shih-Chun Lin , I-Hsiang Wang , Yi-Chun Lai

In this work, we consider a novel distributed data storage/caching scenario in a cellular setting where multiple nodes may fail/depart at the same time. In order to maintain the target reliability, we allow cooperative regeneration of lost…

Information Theory · Computer Science 2021-05-06 Suayb S. Arslan , Massoud Pourmandi , Elif Haytaoglu

The exponential growth of data necessitates distributed storage models, such as peer-to-peer systems and data federations. While distributed storage can reduce costs and increase reliability, the heterogeneity in storage capacity, I/O…

Regenerating codes are a class of codes proposed for providing reliability of data and efficient repair of failed nodes in distributed storage systems. In this paper, we address the fundamental problem of handling errors and erasures during…

Information Theory · Computer Science 2015-03-20 K. V. Rashmi , Nihar B. Shah , Kannan Ramchandran , P. Vijay Kumar

One of the primary objectives of a distributed storage system is to reliably store a large amount $dsize$ of source data for a long duration using a large number $N$ of unreliable storage nodes, each with capacity $nsize$. The storage…

Information Theory · Computer Science 2020-02-20 Michael Luby

We consider a hierarchical network that consists of mobile users, a two-tiered cellular network (namely small cells and macro cells) and central routers, each of which follows a Poisson point process (PPP). In this scenario, small cells…

Information Theory · Computer Science 2016-05-05 Ejder Baştuğ , Marios Kountouris , Mehdi Bennis , Mérouane Debbah

Coded caching has been widely used in the wireless network for shifting the some transmissions during the peak traffic times to the off-peak traffic times. Multi-server coded caching, which can share responsibility for the total amount of…

Information Theory · Computer Science 2018-06-28 Minquan Cheng , Qiaoling Zhang , Jing Jiang , Reizhong Wei

Coded caching utilizes pre-fetching during off-peak hours and multi-casting for delivery in order to balance the traffic load in communication networks. Several works have studied the achievable peak and average rates under different…

Information Theory · Computer Science 2022-01-27 Ciyuan Zhang , Su Wang , Vaneet Aggarwal , Borja Peleato