English
Related papers

Related papers: Exploring Erasure Coding Techniques for High Avail…

200 papers

We define a class of multi--hop erasure networks that approximates a wireless multi--hop network. The network carries unicast flows for multiple users, and each information packet within a flow is required to be decoded at the flow…

Information Theory · Computer Science 2015-03-19 Premkumar Karumbu , Xiaomin Chen , Douglas J. Leith

Maximum-distance-separable (MDS) codes are a class of erasure codes that are widely adopted to enhance the reliability of distributed storage systems (DSS). In (n, k) MDS coded DSS, the original data are stored into n distributed nodes in…

Information Theory · Computer Science 2017-06-16 Sheng Guan , Haibin Kan , Xin Wang

This paper introduces a new approach to proving that a sequence of deterministic linear codes achieves capacity on an erasure channel under maximum a posteriori decoding. Rather than relying on the precise structure of the codes, this…

Information Theory · Computer Science 2015-06-16 Santhosh Kumar , Henry D. Pfister

One of the primary objectives of a distributed storage system is to reliably store large amounts of source data for long durations using a large number $N$ of unreliable storage nodes, each with $c$ bits of storage capacity. Storage nodes…

Information Theory · Computer Science 2021-01-14 Michael Luby , Thomas Richardson

In large-scale distributed storage systems, erasure codes are used to achieve fault tolerance in the face of node failures. Tuning code parameters to observed failure rates has been shown to significantly reduce storage cost. Such tuning of…

Information Theory · Computer Science 2020-06-05 Francisco Maturana , V. S. Chaitanya Mukka , K. V. Rashmi

Current causally consistent data storage algorithms use partial or full replication to ensure data access to clients over a distributed setting. We develop, for the first time, an erasure coding-based algorithm called CausalEC that ensures…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-23 Viveck R. Cadambe , Shihang Lyu

In the current competitive world, industrial companies seek to manufacture products of higher quality which can be achieved by increasing reliability, maintainability and thus the availability of products. On the other hand, improvement in…

Machine Learning · Computer Science 2012-01-31 Golriz Amooee , Behrouz Minaei-Bidgoli , Malihe Bagheri-Dehnavi

Machine learning algorithms are typically run on large scale, distributed compute infrastructure that routinely face a number of unavailabilities such as failures and temporary slowdowns. Adding redundant computations using coding-theoretic…

Machine Learning · Computer Science 2018-06-05 Jack Kosaian , K. V. Rashmi , Shivaram Venkataraman

We propose an approach to utilize idle computational resources of supercomputers. The idea is to maintain an additional queue of low-priority non-parallel jobs and execute them in containers, using container migration tools to break the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-04 Julia Dubenskaya , Stanislav Polyakov

We consider the setting of a master server who possesses confidential data (genomic, medical data, etc.) and wants to run intensive computations on it, as part of a machine learning algorithm for example. The master wants to distribute…

Information Theory · Computer Science 2026-01-01 Rawad Bitar , Parimal Parag , Salim El Rouayheb

In this paper we survey the various erasure codes which had been proposed and patented recently, and along the survey we provide introductory tutorial on many of the essential concepts and readings in erasure and Fountain codes. Packet…

Information Theory · Computer Science 2013-05-07 Jalaluddin Qureshi , Chuan Heng Fohy , Jianfei Cai

In this paper, we propose a novel offloading learning approach to compromise energy consumption and latency in multi-tier network with mobile edge computing. In order to solve this integer programming problem, instead of using conventional…

Information Theory · Computer Science 2019-12-10 Shuhan Zhu , Wei Xu , Lisheng Fan , Kezhi Wang , George K. Karagiannidis

A new run length encoding algorithm for lossless data compression that exploits positional redundancy by representing data in a two-dimensional model of concentric circles is presented. This visual transform enables detection of runs (each…

Data Structures and Algorithms · Computer Science 2021-07-30 Pranav Venkatram

The advent of the Internet of Things (IoT) gives the opportunity to numerous devices to interact with their environment, collect and process data. Data are transferred, in an upwards mode, to the Cloud through the Edge Computing (EC)…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-29 T. Koukaras , K. Kolomvatsos

To deal with the complexity of the new bigger and more complex generation of data, machine learning (ML) techniques are probably the first and foremost used. For ML algorithms to produce results in a reasonable amount of time, they need to…

Machine Learning · Computer Science 2020-01-10 Imen Chakroun , Tom Vander Aa , Thomas J. Ashby

Wireless edge networks in smart industrial environments increasingly operate using advanced sensors and autonomous machines interacting with each other and generating huge amounts of data. Those huge amounts of data are bound to make data…

Networking and Internet Architecture · Computer Science 2025-03-03 Theofanis P. Raptis , Andrea Passarella , Marco Conti

Distributed storage systems introduce redundancy to protect data from node failures. After a storage node fails, the lost data should be regenerated at a replacement storage node as soon as possible to maintain the same level of redundancy.…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-19 Qingyuan Gong , Jiaqi Wang , Yan Wang , Dongsheng Wei , Jin Wang , Xin Wang

This paper investigates an edge computing system where requests are processed by a set of replicated edge servers. We investigate a class of applications where similar queries produce identical results. To reduce processing overhead on the…

Emerging Technologies · Computer Science 2024-05-29 Adrian-Cristian Nicolaescu , Spyridon Mastorakis , Md Washik Al Azad , David Griffin , Miguel Rio

This paper considers packet scheduling over a broadcast channel with packet erasures to multiple receivers with different messages (multiple uni-cast) each with possibly different hard deadline constraints. A novel metric is proposed and…

Networking and Internet Architecture · Computer Science 2018-08-01 Zohreh Ovaisi , Natasha Devroye , Hulya Seferoglu , Besma Smida , Daniela Tuninetti

We assess the practicality of random network coding by illuminating the issue of overhead and considering it in conjunction with increasingly long packets sent over the erasure channel. We show that the transmission of increasingly long…

Information Theory · Computer Science 2007-07-13 Brooke Shrader , Anthony Ephremides