English

SwitchDelta: Asynchronous Metadata Updating for Distributed Storage with In-Network Data Visibility

Distributed, Parallel, and Cluster Computing 2025-11-26 v1 Databases

Abstract

Distributed storage systems typically maintain strong consistency between data nodes and metadata nodes by adopting ordered writes: 1) first installing data; 2) then updating metadata to make data visible.We propose SwitchDelta to accelerate ordered writes by moving metadata updates out of the critical path. It buffers in-flight metadata updates in programmable switches to enable data visibility in the network and retain strong consistency. SwitchDelta uses a best-effort data plane design to overcome the resource limitation of switches and designs a novel metadata update protocol to exploit the benefits of in-network data visibility. We evaluate SwitchDelta in three distributed in-memory storage systems: log-structured key-value stores, file systems, and secondary indexes. The evaluation shows that SwitchDelta reduces the latency of write operations by up to 52.4% and boosts the throughput by up to 126.9% under write-heavy workloads.

Keywords

Cite

@article{arxiv.2511.19978,
  title  = {SwitchDelta: Asynchronous Metadata Updating for Distributed Storage with In-Network Data Visibility},
  author = {Junru Li and Qing Wang and Zhe Yang and Shuo Liu and Jiwu Shu and Youyou Lu},
  journal= {arXiv preprint arXiv:2511.19978},
  year   = {2025}
}

Comments

12 pages, accepted by ICDE'26

R2 v1 2026-07-01T07:53:40.349Z