English
Related papers

Related papers: Multilinear Algebra for Distributed Storage

200 papers

We consider a communication problem in which an update of the source message needs to be conveyed to one or more distant receivers that are interested in maintaining specific linear functions of the source message. The setting is one in…

Information Theory · Computer Science 2018-08-07 N. Prakash , Muriel Medard

Clustered distributed storage models real data centers where intra- and cross-cluster repair bandwidths are different. In this paper, exact-repair minimum-storage-regenerating (MSR) codes achieving capacity of clustered distributed storage…

Information Theory · Computer Science 2018-01-09 Jy-yong Sohn , Beongjun Choi , Jaekyun Moon

In this work, we introduce maximally recoverable codes with locality and availability. We consider locally repairable codes (LRCs) where certain subsets of $ t $ symbols belong each to $ N $ local repair sets, which are pairwise disjoint…

Information Theory · Computer Science 2026-05-18 Umberto Martínez-Peñas , V. Lalitha

In distributed storage systems, locally repairable codes (LRCs) are designed to reduce disk I/O and repair costs by enabling recovery of each code symbol from a small number of other symbols. To handle multiple node failures,…

Information Theory · Computer Science 2023-07-11 Jing Qiu , Fang-Wei Fu

Modern data-driven and distributed learning frameworks deal with diverse massive data generated by clients spread across heterogeneous environments. Indeed, data heterogeneity is a major bottleneck in scaling up many distributed learning…

Machine Learning · Computer Science 2023-08-23 Amirhossein Reisizadeh , Khashayar Gatmiry , Asuman Ozdaglar

$\epsilon$-Minimum Storage Regenerating ($\epsilon$-MSR) codes form a special class of Maximum Distance Separable (MDS) codes, providing mechanisms for exact regeneration of a single code block in their codewords by downloading slighly…

Information Theory · Computer Science 2018-07-04 Venkatesan Guruswami , Satyanarayana V. Lokam , Sai Vikneshwar Mani Jayaraman

The repair problem in distributed storage addresses recovery of the data encoded using an erasure code, for instance, a Reed-Solomon (RS) code. We consider the problem of repairing a single node or multiple nodes in RS-coded storage systems…

Information Theory · Computer Science 2018-05-07 Itzhak Tamo , Min Ye , Alexander Barg

The coding matrix design plays a fundamental role in the prediction performance of the error correcting output codes (ECOC)-based multi-class task. {In many-class classification problems, e.g., fine-grained categorization, it is difficult…

Machine Learning · Computer Science 2016-03-21 Joey Tianyi Zhou , Ivor W. Tsang , Shen-Shyang Ho , Klaus-Robert Muller

We establish a duality result between linear index coding and Locally Repairable Codes (LRCs). Specifically, we show that a natural extension of LRCs we call Generalized Locally Repairable Codes (GLCRs) are exactly dual to linear index…

Information Theory · Computer Science 2014-02-18 Karthikeyan Shanmugam , Alexandros G. Dimakis

Erasure codes have emerged as an efficient technology for providing data redundancy in distributed storage systems. However, it is a challenging task to repair the failed storage nodes in erasure-coded storage systems, which requires large…

Information Theory · Computer Science 2020-05-15 Bing Zhu , Kenneth W. Shum , Hui Li

An $(n,r,h,a,q)$-Local Reconstruction Code (LRC) is a linear code over $\mathbb{F}_q$ of length $n$, whose codeword symbols are partitioned into $n/r$ local groups each of size $r$. Each local group satisfies `$a$' local parity checks to…

Information Theory · Computer Science 2022-05-20 Sivakanth Gopi , Venkatesan Guruswami

Batch codes, first introduced by Ishai, Kushilevitz, Ostrovsky, and Sahai, mimic a distributed storage of a set of $n$ data items on $m$ servers, in such a way that any batch of $k$ data items can be retrieved by reading at most some $t$…

Discrete Mathematics · Computer Science 2017-01-11 Hui Zhang , Eitan Yaakobi , Natalia Silberstein

We consider a distributed storage system with $n$ nodes, where a user can recover the stored file from any $k$ nodes, and study the problem of repairing $r$ partially failed nodes. We consider \textit{broadcast repair}, that is, $d$…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-16 Nitish Mital , Katina Kralevska , Cong Ling , Deniz Gunduz

Ensemble learning consistently improves the performance of multi-class classification through aggregating a series of base classifiers. To this end, data-independent ensemble methods like Error Correcting Output Codes (ECOC) attract…

Computer Vision and Pattern Recognition · Computer Science 2020-12-16 Hao Zhang , Joey Tianyi Zhou , Tianying Wang , Ivor W. Tsang , Rick Siow Mong Goh

We study the performance of Reed-Solomon (RS) codes for the \em exact repair problem \em in distributed storage. Our main result is that, in some parameter regimes, Reed-Solomon codes are optimal regenerating codes, among MDS codes with…

Information Theory · Computer Science 2016-08-10 Venkatesan Guruswami , Mary Wootters

We derive a lower bound on the amount of information accessed to repair failed nodes within a single rack from any number of helper racks in the rack-aware storage model that allows collective information processing in the nodes that share…

Information Theory · Computer Science 2023-04-19 Jiaojiao Wang , Zitan Chen

Error Correcting Output Codes (ECOC) is a successful technique in multi-class classification, which is a core problem in Pattern Recognition and Machine Learning. A major advantage of ECOC over other methods is that the multi- class problem…

Computer Vision and Pattern Recognition · Computer Science 2016-02-22 Miguel Angel Bautista , Oriol Pujol , Fernando de la Torre , Sergio Escalera

When neural networks (NeuralNets) are implemented in hardware, their weights need to be stored in memory devices. As noise accumulates in the stored weights, the NeuralNet's performance will degrade. This paper studies how to use error…

Information Theory · Computer Science 2020-01-14 Kunping Huang , Paul Siegel , Anxiao , Jiang

Medical coding translates professionally written medical reports into standardized codes, which is an essential part of medical information systems and health insurance reimbursement. Manual coding by trained human coders is time-consuming…

Computation and Language · Computer Science 2021-09-27 Wei Sun , Shaoxiong Ji , Erik Cambria , Pekka Marttinen

We introduce a family of balanced locally repairable codes (BLRCs) $[n, k, d]$ for arbitrary values of $n$, $k$ and $d$. Similar to other locally repairable codes (LRCs), the presented codes are suitable for applications that require a low…

Information Theory · Computer Science 2020-02-14 Katina Kralevska , Danilo Gligoroski , Harald Øverby