English
Related papers

Related papers: Self-Repairing Disk Arrays

200 papers

In this paper, we find the Laplace Stieltjes transform of the probability of data loss for the k-out-of-n distributed storage system with deterministic repair times. We consider two repair models, namely the serial and parallel repair. We…

Information Theory · Computer Science 2016-11-28 Vaneet Aggarwal

This paper studies an online replication problem for distributed data access. The goal is to dynamically create and delete data copies in a multi-server system as time passes to minimize the total storage and network cost of serving access…

Data Structures and Algorithms · Computer Science 2024-04-26 Tianyu Zuo , Xueyan Tang , Bu Sung Lee

In a realistic distributed storage environment, storage nodes are usually placed in racks, a metallic support designed to accommodate electronic equipment. It is known that the communication (bandwidth) cost between nodes within a rack is…

Information Theory · Computer Science 2013-01-09 Bernat Gastón , Jaume Pujol , Mercè Villanueva

A significant fraction of software failures in large-scale Internet systems are cured by rebooting, even when the exact failure causes are unknown. However, rebooting can be expensive, causing nontrivial service disruption or downtime even…

Operating Systems · Computer Science 2007-05-23 George Candea , Shinichi Kawamoto , Yuichi Fujiki , Greg Friedman , Armando Fox

Physical and cloud storage services are well-served by functioning and reliable high-volume storage systems. Recent observations point to hard disk reliability as one of the most pressing reliability issues in data centers containing…

Machine Learning · Computer Science 2021-09-14 Austin Coursey , Gopal Nath , Srikanth Prabhu , Saptarshi Sengupta

MDS codes are erasure-correcting codes that can correct the maximum number of erasures for a given number of redundancy or parity symbols. If an MDS code has $r$ parities and no more than $r$ erasures occur, then by transmitting all the…

Information Theory · Computer Science 2014-11-25 Zhiying Wang , Itzhak Tamo , Jehoshua Bruck

In large-scale LLM pre-training systems with 100k+ GPUs, failures become the norm rather than the exception, and restart costs can dominate wall-clock training time. However, existing fault-tolerance mechanisms are largely unprepared for…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-29 Jin Lee , Zhonghao Chen , Xuhang He , Robert Underwood , Bogdan Nicolae , Franck Cappello , Xiaoyi Lu , Sheng Di , Zheng Zhang

Distributed storage systems for large clusters typically use replication to provide reliability. Recently, erasure codes have been used to reduce the large storage overhead of three-replicated systems. Reed-Solomon codes are the standard…

High-rate minimum storage regenerating (MSR) codes are known to require a large sub-packetization level, which can make meta-data management difficult and hinder implementation in practical systems. A few maximum distance separable (MDS)…

Information Theory · Computer Science 2023-08-29 Jie Li , Yi Liu , Xiaohu Tang , Yunghsiang S. Han , Bo Bai , Gong Zhang

The paper is devoted to the problem of erasure coding in distributed storage. We consider a model of storage that assumes that nodes are organized into equally sized groups, called racks, that within each group the nodes can communicate…

Information Theory · Computer Science 2019-01-15 Zitan Chen , Alexander Barg

In distributed storage systems that employ erasure coding, the issue of minimizing the total {\it communication} required to exactly rebuild a storage node after a failure arises. This repair bandwidth depends on the structure of the…

Information Theory · Computer Science 2011-06-09 Dimitris S. Papailiopoulos , Alexandros G. Dimakis , Viveck R. Cadambe

Motivated by the application of Reed-Solomon codes to recently emerging decentralized storage systems such as Storj and Filebase/Sia, we study the problem of designing compact repair groups for recovering multiple failures in a…

Information Theory · Computer Science 2023-05-12 Thi Xinh Dinh , Serdar Boztas , Son Hoang Dau , Emanuele Viterbo

The reliability of erasure-coded distributed storage systems, as measured by the mean time to data loss (MTTDL), depends on the repair bandwidth of the code. Repair-efficient codes provide reliability values several orders of magnitude…

Information Theory · Computer Science 2017-08-04 Vaneet Aggarwal , Chao Tian , Vinay A. Vaishampayan , Yih-Farn R. Chen

We introduce the Fixed Cluster Repair System (FCRS) as a novel architecture for Distributed Storage Systems (DSS), achieving a small repair bandwidth while guaranteeing a high availability. Specifically we partition the set of servers in a…

Information Theory · Computer Science 2019-03-06 Saeid Sahraei , Michael Gastpar

For a set $P$ of $n$ points in the plane and a value $r > 0$, the unit-disk range reporting problem is to construct a data structure so that given any query disk of radius $r$, all points of $P$ in the disk can be reported efficiently. We…

Computational Geometry · Computer Science 2025-01-03 Haitao Wang , Yiming Zhao

With the widespread deployment of deep neural networks (DNNs), ensuring the reliability of DNN-based systems is of great importance. Serious reliability issues such as system failures can be caused by numerical defects, one of the most…

Software Engineering · Computer Science 2023-04-25 Linyi Li , Yuhao Zhang , Luyao Ren , Yingfei Xiong , Tao Xie

As a special class of array codes, $(n,k,m)$ piggybacking codes are MDS codes (i.e., any $k$ out of $n$ nodes can retrieve all data symbols) that can achieve low repair bandwidth for single-node failure with low sub-packetization $m$. In…

Information Theory · Computer Science 2022-09-21 Hao Shi , Zhengyi Jiang , Zhongyi Huang , Bo Bai , Hanxu Hou

This paper summarizes the idea of Subarray-Level Parallelism (SALP) in DRAM, which was published in ISCA 2012, and examines the work's significance and future potential. Modern DRAMs have multiple banks to serve multiple memory requests in…

Hardware Architecture · Computer Science 2018-05-08 Yoongu Kim , Vivek Seshadri , Donghyuk Lee , Jamie Liu , Onur Mutlu

We consider the following scheduling problem. A system is composed of $n$ processors drawn from a pool of $N$. The processors can become faulty while in operation and faulty processors never recover. A report is issued whenever a fault…

Combinatorics · Mathematics 2009-09-25 Michel Goemans , Nancy Lynch , Isaac Saias

Datasets may include errors, and specifically violations of integrity constraints, for various reasons. Standard techniques for ``minimal-cost'' database repairing resolve these violations by aiming for minimum change in the data, and in…

Databases · Computer Science 2024-10-23 Yuxi Liu , Fangzhu Shen , Kushagra Ghosh , Amir Gilad , Benny Kimelfeld , Sudeepa Roy