English

Explicit correlation amplifiers for finding outlier correlations in deterministic subquadratic time

Data Structures and Algorithms 2016-11-09 v2

Abstract

We derandomize G. Valiant's [J. ACM 62 (2015) Art. 13] subquadratic-time algorithm for finding outlier correlations in binary data. Our derandomized algorithm gives deterministic subquadratic scaling essentially for the same parameter range as Valiant's randomized algorithm, but the precise constants we save over quadratic scaling are more modest. Our main technical tool for derandomization is an explicit family of correlation amplifiers built via a family of zigzag-product expanders in Reingold, Vadhan, and Wigderson [Ann. of Math. 155 (2002) 157--187]. We say that a function f:{1,1}d{1,1}Df:\{-1,1\}^d\rightarrow\{-1,1\}^D is a correlation amplifier with threshold 0τ10\leq\tau\leq 1, error γ1\gamma\geq 1, and strength pp an even positive integer if for all pairs of vectors x,y{1,1}dx,y\in\{-1,1\}^d it holds that (i) x,y<τd|\langle x,y\rangle|<\tau d implies f(x),f(y)(τγ)pD|\langle f(x),f(y)\rangle|\leq(\tau\gamma)^pD; and (ii) x,yτd|\langle x,y\rangle|\geq\tau d implies (x,yγd)pDf(x),f(y)(γx,yd)pD\bigl(\frac{\langle x,y\rangle}{\gamma d}\bigr)^pD \leq\langle f(x),f(y)\rangle\leq \bigl(\frac{\gamma\langle x,y\rangle}{d}\bigr)^pD.

Keywords

Cite

@article{arxiv.1606.05608,
  title  = {Explicit correlation amplifiers for finding outlier correlations in deterministic subquadratic time},
  author = {Matti Karppa and Petteri Kaski and Jukka Kohonen and Padraig Ó Catháin},
  journal= {arXiv preprint arXiv:1606.05608},
  year   = {2016}
}
R2 v1 2026-06-22T14:28:09.157Z