English
Related papers

Related papers: Treeplication: An Erasure Code for Distributed Ful…

200 papers

The paper presents a binarization scheme that converts non-binary data into a set of binary strings. At present, there are many binarization algorithms, but they are optimal for only specific probability distributions of the data source.…

Information Theory · Computer Science 2014-08-14 Madhur Srivastava

A $k$-decision tree $t$ (or $k$-tree) is a recursive partition of a matrix (2D-signal) into $k\geq 1$ block matrices (axis-parallel rectangles, leaves) where each rectangle is assigned a real label. Its regression or classification loss to…

Machine Learning · Computer Science 2021-10-08 Ibrahim Jubran , Ernesto Evgeniy Sanches Shayda , Ilan Newman , Dan Feldman

In this paper, we consider the problem of distributed inference in tree based networks. In the framework considered in this paper, distributed nodes make a 1-bit local decision regarding a phenomenon before sending it to the fusion center…

Information Theory · Computer Science 2016-11-17 Bhavya Kailkhura , Aditya Vempaty , Pramod K. Varshney

We consider data transmission over a network where each edge is an erasure channel and where the inner nodes transmit a random linear combination of their incoming information. We distinguish two channel models in this setting, the row and…

Information Theory · Computer Science 2017-10-18 Heide Gluesing-Luerssen , Anna-Lena Horlemann-Trautmann

Despite their exceptional error-correcting properties, Reed-Solomon (RS) codes have been overlooked in distributed storage applications due to the common belief that they have poor repair bandwidth: A naive repair approach would require the…

Information Theory · Computer Science 2017-05-16 Hoang Dau , Iwan Duursma , Han Mao Kiah , Olgica Milenkovic

With distributed machine learning being a prominent technique for large-scale machine learning tasks, communication complexity has become a major bottleneck for speeding up training and scaling up machine numbers. In this paper, we propose…

Machine Learning · Computer Science 2023-09-26 Pengyun Yue , Hanzhen Zhao , Cong Fang , Di He , Liwei Wang , Zhouchen Lin , Song-chun Zhu

Locality enables storage systems to recover failed nodes from small subsets of surviving nodes. The setting where nodes are partitioned into subsets, each allowing for local recovery, is well understood. In this work we consider a…

Information Theory · Computer Science 2021-02-11 Lukas Holzbaur , Sven Puchinger , Eitan Yaakobi , Antonia Wachter-Zeh

In this paper, we propose CodedSketch, as a distributed straggler-resistant scheme to compute an approximation of the multiplication of two massive matrices. The objective is to reduce the recovery threshold, defined as the total number of…

Information Theory · Computer Science 2021-02-15 Tayyebeh Jahani-Nezhad , Mohammad Ali Maddah-Ali

The information-theoretic secure exact-repair regenerating codes for distributed storage systems (DSSs) with parameters $(n,k=d,d,\ell)$ are studied in this paper. We consider distributed storage systems with $n$ nodes, in which the…

Information Theory · Computer Science 2023-01-02 Adel Elmahdy , Michelle Kleckler , Soheil Mohajer

The algorithm analysed by Na\"{i}mi, Trehe and Arnold was the very first distributed algorithm to solve the mutual exclusion problem in complete networks by using a dynamic logical tree structure as its basic distributed data structure,…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Christian Lavault

Repair performance in hierarchical data centers is often bottlenecked by cross-rack network transfer. Recent theoretical results show that the cross-rack repair traffic can be minimized through repair layering, whose idea is to partition a…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-18 Yuchong Hu , Xiaolu Li , Mi Zhang , Patrick P. C. Lee , Xiaoyang Zhang , Pan Zhou , Dan Feng

We consider rate R = k/n causal linear codes that map a sequence of k-dimensional binary vectors {b_t} to a sequence of n-dimensional binary vectors {c_t}, such that each c_t is a function of {b_1,b_2,...,b_t}. Such a code is called anytime…

Information Theory · Computer Science 2011-06-02 Ravi Teja Sukhavasi , Babak Hassibi

This paper presents a novel approach to multiple access control called coded splitting tree protocol. The approach builds on the known tree splitting protocols, code structure and successive interference cancellation (SIC). Several…

Information Theory · Computer Science 2013-01-31 Jesper H. Sørensen , Cedomir Stefanović , Petar Popovski

We propose application-layer coding schemes to recover lost data in delay-sensitive uplink (sensor-to-gateway) communications in the Internet of Things. Built on an approach that combines retransmissions and forward erasure correction, the…

Information Theory · Computer Science 2022-07-26 Vatsalya Chaubey , Siddhartha S. Borkotoky

The majority of works in distributed storage networks assume a simple network model with a collection of identical storage nodes with the same communication cost between the nodes. In this paper, we consider a realistic multi-rack…

Information Theory · Computer Science 2019-03-11 Ali Tebbi , Terence H. Chan , Chi Wan Sung

In a distributed storage system based on erasure coding, an important problem is the \emph{repair problem}: If a node storing a coded piece fails, in order to maintain the same level of reliability, we need to create a new encoded piece and…

Information Theory · Computer Science 2016-11-17 Yunnan Wu

We propose a generic transformation that can convert any nonbinary $(n=k+r,k)$ maximum distance separable (MDS) code into another $(n,k)$ MDS code over the same field such that 1) some arbitrarily chosen $r$ nodes have the optimal repair…

Information Theory · Computer Science 2018-08-24 Jie Li , Xiaohu Tang , Chao Tian

Distributed storage systems need to store data redundantly in order to provide some fault-tolerance and guarantee system reliability. Different coding techniques have been proposed to provide the required redundancy more efficiently than…

Information Theory · Computer Science 2016-11-15 Lluis Pamies-Juarez , Henk D. L. Hollmann , Frédérique Oggier

Erasure codes, such as Reed-Solomon (RS) codes, are being increasingly employed in data centers to combat the cost of reliably storing large amounts of data. Although these codes provide optimal storage efficiency, they require…

Networking and Internet Architecture · Computer Science 2013-09-03 K. V. Rashmi , Nihar B. Shah , Dikang Gu , Hairong Kuang , Dhruba Borthakur , Kannan Ramchandran

In this paper we present a new algorithm, denoted as TEP, to decode low-density parity-check (LDPC) codes over the Binary Erasure Channel (BEC). The TEP decoder is derived applying the expectation propagation (EP) algorithm with a tree-…

Information Theory · Computer Science 2012-01-05 Pablo M. Olmos , Juan José Murillo-Fuentes , Fernando Pérez-Cruz