English

Hydra: Resilient and Highly Available Remote Memory

Distributed, Parallel, and Cluster Computing 2023-05-30 v3 Networking and Internet Architecture

Abstract

We present Hydra, a low-latency, low-overhead, and highly available resilience mechanism for remote memory. Hydra can access erasure-coded remote memory within a single-digit microsecond read/write latency, significantly improving the performance-efficiency trade-off over the state-of-the-art -- it performs similar to in-memory replication with 1.6X lower memory overhead. We also propose CodingSets, a novel coding group placement algorithm for erasure-coded data, that provides load balancing while reducing the probability of data loss under correlated failures by an order of magnitude. With Hydra, even when only 50% of memory is local, unmodified memory-intensive applications achieve performance close to that of the fully in-memory case in the presence of remote failures and outperform the state-of-the-art solutions by up to 4.35X.

Keywords

Cite

@article{arxiv.1910.09727,
  title  = {Hydra: Resilient and Highly Available Remote Memory},
  author = {Youngmoon Lee and Hasan Al Maruf and Mosharaf Chowdhury and Asaf Cidon and Kang G. Shin},
  journal= {arXiv preprint arXiv:1910.09727},
  year   = {2023}
}
R2 v1 2026-06-23T11:50:44.232Z