Lessons Learned from a Bare-metal Evaluation of Erasure Coding Algorithms in P2P Networks

We have built a bare-metal testbed in order to perform large-scale, reproducible evaluations of erasure coding algorithms. Our testbed supports at least 1000 Ethereum Swarm peers running on 30 machines. Running experimental evaluation is time-consuming and challenging. Researchers must consider the experimental software's limitations and artifacts. If not controlled, the network behavior may cause inaccurate measurements. This paper shares the lessons learned from a bare-metal evaluation of erasure coding algorithms and how to create a controlled-environment in a cluster consisting of 1000 Ethereum Swarm peers.