Founsure 1.0: An Erasure Code Library with Efficient Repair and Update Features
Abstract
Founsure is an open-source software library that implements a multi-dimensional graph-based erasure coding entirely based on fast exclusive OR (XOR) logic. Its implementation utilizes compiler optimizations and multi-threading to generate the right assembly code for the given multi-core CPU architecture with vector processing capabilities. Founsure possesses important features that shall find various applications in modern data storage, communication, and networked computer systems, in which the data needs protection against device, hardware, and node failures. As data size reached unprecedented levels, these systems have become hungry for network bandwidth, computational resources, and average consumed power. To address that, the proposed library provides a three-dimensional design space that trades off the computational complexity, coding overhead, and data/node repair bandwidth to meet different requirements of modern distributed data storage and processing systems. Founsure library enables efficient encoding, decoding, repairs/rebuilds, and updates while all the required data storage and computations are distributed across the network nodes.
Cite
@article{arxiv.1702.07409,
title = {Founsure 1.0: An Erasure Code Library with Efficient Repair and Update Features},
author = {Şuayb Ş. Arslan},
journal= {arXiv preprint arXiv:1702.07409},
year = {2021}
}
Comments
Accepted to Elsevier SoftwareX, 2021