English
Related papers

Related papers: RapidRAID: Pipelined Erasure Codes for Fast Data A…

200 papers

Array codes have been widely employed in storage systems, such as Redundant Arrays of Inexpensive Disks (RAID). The row-diagonal parity (RDP) codes and EVENODD codes are two popular double-parity array codes. As the capacity of hard disks…

Information Theory · Computer Science 2018-03-12 Hanxu Hou , Yunghsiang S. Han , Kenneth W. Shum , Hui Li

Rekeying refers to an operation of replacing an existing key with a new key for encryption. It renews security protection, so as to protect against key compromise and enable dynamic access control in cryptographic storage. However, it is…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-04-13 Chuan Qin , Jingwei Li , Patrick P. C. Lee

We present a novel distributed computing framework that is robust to slow compute nodes, and is capable of both approximate and exact computation of linear operations. The proposed mechanism integrates the concepts of randomized sketching…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-06 Burak Bartan , Mert Pilanci

Coded caching scheme, which is an effective technique to increase the transmission efficiency during peak traffic times, has recently become quite popular among the coding community. Generally rate can be measured to the transmission in the…

Information Theory · Computer Science 2017-10-03 Minquan Cheng , Qifa Yan , Xiaohu Tang , Jing Jiang

Exact queueing analysis of erasure networks with network coding in a finite buffer regime is an extremely hard problem due to the large number of states in the network. In such networks, packets are lost due to either link erasures or due…

Information Theory · Computer Science 2010-12-14 Nima Torabkhani , Badri N. Vellambi , Faramarz Fekri

We propose a novel application of coded computing to the problem of the nearest neighbor estimation using MatDot Codes [Fahim. et.al. 2017], that are known to be optimal for matrix multiplication in terms of recovery threshold under storage…

Information Theory · Computer Science 2018-11-30 Utsav Sheth , Sanghamitra Dutta , Malhar Chaudhari , Haewon Jeong , Yaoqing Yang , Jukka Kohonen , Teemu Roos , Pulkit Grover

Despite significant progress in the caching literature concerning the worst case and uniform average case regimes, the algorithms for caching with nonuniform demands are still at a basic stage and mostly rely on simple grouping and…

Information Theory · Computer Science 2018-02-01 Pierre Quinton , Saeid Sahraei , Michael Gastpar

Protecting against link failures in communication networks is essential to increase robustness, accessibility, and reliability of data transmission. Recently, network coding has been proposed as a solution to provide agile and cost…

Information Theory · Computer Science 2016-11-17 Salah A. Aly , Ahmed E. Kamal

This paper investigates adaptive streaming codes over a three-node relayed network. In this setting, a source transmits a sequence of message packets through a relay under a delay constraint of $T$ time slots per packet. The source-to-relay…

Information Theory · Computer Science 2024-01-29 Muhammad Ahmad Kaleem , Gustavo Kasper Facenda , Ashish Khisti

We present a new 'piggybacking' framework for designing distributed storage codes that are efficient in data-read and download required during node-repair. We illustrate the power of this framework by constructing classes of explicit codes…

Information Theory · Computer Science 2013-02-26 K. V. Rashmi , Nihar B. Shah , Kannan Ramchandran

In modern distributed computing systems, unpredictable and unreliable infrastructures result in high variability of computing resources. Meanwhile, there is significantly increasing demand for timely and event-driven services with deadline…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-04-12 Chien-Sheng Yang , Ramtin Pedarsani , A. Salman Avestimehr

Regenerating codes are efficient methods for distributed storage in storage networks, where node failures are common. They guarantee low cost data reconstruction and repair through accessing only a predefined number of arbitrarily chosen…

Information Theory · Computer Science 2017-11-09 Kaveh Mahdaviani , Ashish Khisti , Soheil Mohajer

This paper proposes an algorithm to minimize weighted service latency for different classes of tenants (or service classes) in a data center network where erasure-coded files are stored on distributed disks/racks and access requests are…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-03 Yu Xiang , Vaneet Aggarwal , Yih-Farn R. Chen , Tian Lan

Modern large-scale distributed storage systems use erasure codes to protect against node failures with low storage overhead. In practice, the failure rate and other factors of storage devices in the system may vary significantly over time,…

Information Theory · Computer Science 2023-08-15 Xiangliang Kong

With the ever-increasing dataset sizes, several file formats like Parquet, ORC, and Avro have been developed to store data efficiently and to save network and interconnect bandwidth at the price of additional CPU utilization. However, with…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-24 Jayjeet Chakraborty , Ivo Jimenez , Sebastiaan Alvarez Rodriguez , Alexandru Uta , Jeff LeFevre , Carlos Maltzahn

In this paper we study how coding in distributed storage reduces expected download time, in addition to providing reliability against disk failures. The expected download time is reduced because when a content file is encoded to add…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-03-07 Gauri Joshi , Yanpei Liu , Emina Soljanin

Despite their exceptional error-correcting properties, Reed-Solomon codes have been overlooked in distributed storage applications due to the common belief that they have poor repair bandwidth: A naive repair approach would require the…

Information Theory · Computer Science 2020-05-05 Hoang Dau , Iwan Duursma , Han Mao Kiah , Olgica Milenkovic

As storage systems grow in size, device failures happen more frequently than ever before. Given the commodity nature of hard drives employed, a storage system needs to tolerate a certain number of disk failures while maintaining data…

Information Theory · Computer Science 2014-05-20 Yan Wang , Xunrui Yin , Xin Wang

Network transfer and disk read are the most time consuming operations in the repair process for node failures in erasure-code-based distributed storage systems. Recent developments on Reed-Solomon codes, the most widely used erasure codes…

Information Theory · Computer Science 2018-05-10 Hoang Dau , Iwan Duursma , Hien Chu

Edge computing is emerging as a new paradigm to allow processing data at the edge of the network, where data is typically generated and collected, by exploiting multiple devices at the edge collectively. However, exploiting the potential of…

Information Theory · Computer Science 2021-06-17 Elahe Vedadi , Hulya Seferoglu