English
Related papers

Related papers: A Layered Architecture for Erasure-Coded Consisten…

200 papers

This paper presents a novel coding scheme for distributed storage systems containing nodes with adversarial errors. The key challenge in such systems is the propagation of erroneous data from a single corrupted node to the rest of the…

Information Theory · Computer Science 2012-07-17 Natalia Silberstein , Ankit Singh Rawat , Sriram Vishwanath

Computational storage, known as a solution to significantly reduce the latency by moving data-processing down to the data storage, has received wide attention because of its potential to accelerate data-driven devices at the edge. To meet…

Information Theory · Computer Science 2021-03-23 Siyi Yang , Ahmed Hareedy , Robert Calderbank , Lara Dolecek

Large-scale systems with all-flash arrays have become increasingly common in many computing segments. To make such systems resilient, we can adopt erasure coding such as Reed-Solomon (RS) code as an alternative to replication because…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-21 Sungjoon Koh , Jie Zhang , Miryeong Kwon , Jungyeon Yoon , David Donofrio , Nam Sung Kim , Myoungsoo Jung

We consider the problem of constructing an erasure code for storage over a network when the data sources are distributed. Specifically, we assume that there are n storage nodes with limited memory and k<n sources generating the data. We…

Information Theory · Computer Science 2016-11-15 Alexandros G. Dimakis , Vinod Prabhakaran , Kannan Ramchandran

In large scale distributed storage systems (DSS) deployed in cloud computing, correlated failures resulting in simultaneous failure (or, unavailability) of blocks of nodes are common. In such scenarios, the stored data or a content of a…

Information Theory · Computer Science 2017-02-22 Gokhan Calis , O. Ozan Koyluoglu

Current causally consistent data storage algorithms use partial or full replication to ensure data access to clients over a distributed setting. We develop, for the first time, an erasure coding-based algorithm called CausalEC that ensures…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-23 Viveck R. Cadambe , Shihang Lyu

Large language models (LLMs) have shown great potential in natural language processing and content generation. However, current LLMs heavily rely on cloud computing, leading to prolonged latency, high bandwidth cost, and privacy concerns.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-24 Mingjin Zhang , Jiannong Cao , Xiaoming Shen , Zeyang Cui

This initial version of this document was written back in 2014 for the sole purpose of providing fundamentals of reliability theory as well as to identify the theoretical types of machinery for the prediction of durability/availability of…

Performance · Computer Science 2023-01-24 Suayb S. Arslan

We investigate the problem of maintaining an encoded distributed storage system when some nodes contain adversarial errors. Using the error-correction capabilities that are built into the existing redundancy of the system, we propose a…

Cryptography and Security · Computer Science 2015-03-17 Theodoros K. Dikaliotis , Alexandros G. Dimakis , Tracey Ho

Modern distributed storage systems often use erasure codes to protect against disk and node failures to increase reliability, while trying to meet the latency requirements of the applications and clients. Storage systems may have caches at…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-07-24 Vaneet Aggarwal , Yih-Farn R. Chen , Tian Lan , Yu Xiang

Edge computing is an emerging paradigm to enable low-latency applications, like mobile augmented reality, because it takes the computation on processing devices that are closer to the users. On the other hand, the need for highly scalable…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-21 Claudio Cicconetti , Marco Conti , Andrea Passarella

We study the inherent space requirements of shared storage algorithms in asynchronous fault-prone systems. Previous works use codes to achieve a better storage cost than the well-known replication approach. However, a closer look reveals…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-07-21 Alexander Spiegelman , Yuval Cassuto , Gregory Chockler , Idit Keidar

Edge nodes are crucial for detection against multitudes of cyber attacks on Internet-of-Things endpoints and is set to become part of a multi-billion industry. The resource constraints in this novel network infrastructure tier constricts…

Cryptography and Security · Computer Science 2022-07-07 Praneet Singh , Jishnu Jaykumar , Akhil Pankaj , Reshmi Mitra

Edge computing enables data processing and storage closer to where the data are created. Given the largely distributed compute environment and the significantly dispersed data distribution, there are increasing demands of data sharing and…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-05 Zheng Li , Diego Seco , José Fuentes-Sepúlveda

This paper studies the fundamental problem of data persistency for a general family of redundancy schemes in distributed storage systems, called replicated erasure codes. Namely, we analyze two strategies of replicated erasure codes…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-28 Roy Friedman , Rafał Kapelko , Karol Marchwicki

In distributed storage systems that use coding, the issue of minimizing the communication required to rebuild a storage node after a failure arises. We consider the problem of repairing an erased node in a distributed storage system that…

Information Theory · Computer Science 2010-09-20 Zhiying Wang , Alexandros G. Dimakis , Jehoshua Bruck

Erasure codes provide a storage efficient alternative to replication based redundancy in (networked) storage systems. They however entail high communication overhead for maintenance, when some of the encoded fragments are lost and need to…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-11-24 Frederique Oggier , Anwitaman Datta

The paper is devoted to the problem of erasure coding in distributed storage. We consider a model of storage that assumes that nodes are organized into equally sized groups, called racks, that within each group the nodes can communicate…

Information Theory · Computer Science 2019-01-15 Zitan Chen , Alexander Barg

The use of network coding for large scale content distribution improves download time. This is demonstrated in this work by the use of network coded Electronic Health Record Storage System (EHR-SS). An architecture of 4-layer to build the…

Information Theory · Computer Science 2012-11-13 B. Venkatalakshmi , S. Shanmugavel

Erasure codes offer an efficient way to decrease storage and communication costs while implementing atomic memory service in asynchronous distributed storage systems. In this paper, we provide erasure-code-based algorithms having the…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-22 Kishori M. Konwar , N. Prakash , Nancy Lynch , Muriel Medard