English

A Unified Theory of Sparsification

Data Structures and Algorithms 2026-07-17 v1

Abstract

We study the sparsifiability of \emph{real-valued codes}, a unifying abstraction that generalizes both combinatorial and continuous notions of sparsification, including spectral sparsification. In our setting, a code CR0mC \subseteq \mathbb{R}_{\geq 0}^m is simply a collection of nonnegative real-valued vectors, and for a parameter ϵ>0\epsilon > 0, a \emph{(1±ϵ)(1 \pm \epsilon)-sparsifier} of CC is a subset T[m]T \subseteq [m], together with weights wR0Tw \in \mathbb{R}_{\geq 0}^T, such that, for every cCc \in C, iTwici(1±ϵ)i=1mci\sum_{i \in T} w_i c_i \in (1 \pm \epsilon)\sum_{i=1}^m c_i. When C{0,1}mC \subseteq \{0,1\}^m, this specializes to code sparsification, and hence captures CSP sparsification, as studied by Khanna--Putterman--Sudan (SODA 2024, STOC 2025) and Brakensiek--Guruswami (STOC 2025). Similarly, for a graph G=(V,E)G=(V,E), if one defines C={c(x):xRV}R0EC=\{c^{(x)}:x\in\mathbb R^V\}\subseteq\mathbb R_{\geq 0}^E by c(u,v)(x)=(xuxv)2c^{(x)}_{(u,v)}=(x_u-x_v)^2, then sparsifying CC is exactly spectral graph sparsification, as studied by Spielman--Teng (SICOMP 2011). Although the techniques driving combinatorial and continuous sparsification have traditionally been largely disjoint, our main result is a single structural theorem governing the sparsifiability of arbitrary real-valued codes CR0mC\subseteq\mathbb{R}_{\geq 0}^m. The central parameter is \emph{continuous-valued non-redundancy} (CVNRD\mathrm{CVNRD}), a real-valued analogue of non-redundancy that captures the largest approximately block-diagonal obstruction contained in CC. Our theorem gives sparsifiers of size nearly-linear in CVNRD\mathrm{CVNRD}, and shows that CVNRD\mathrm{CVNRD} is also a lower-bound obstruction for the broad class of coordinate-wise unbiased randomized sparsification schemes.

Keywords

Cite

@article{arxiv.2607.16126,
  title  = {A Unified Theory of Sparsification},
  author = {Sanjeev Khanna and Aaron Putterman and Madhu Sudan},
  journal= {arXiv preprint arXiv:2607.16126},
  year   = {2026}
}