English

SPRIGHT: A Fast and Robust Framework for Sparse Walsh-Hadamard Transform

Information Theory 2015-08-27 v1 Machine Learning math.IT

Abstract

We consider the problem of computing the Walsh-Hadamard Transform (WHT) of some NN-length input vector in the presence of noise, where the NN-point Walsh spectrum is KK-sparse with K=O(Nδ)K = {O}(N^{\delta}) scaling sub-linearly in the input dimension NN for some 0<δ<10<\delta<1. Over the past decade, there has been a resurgence in research related to the computation of Discrete Fourier Transform (DFT) for some length-NN input signal that has a KK-sparse Fourier spectrum. In particular, through a sparse-graph code design, our earlier work on the Fast Fourier Aliasing-based Sparse Transform (FFAST) algorithm computes the KK-sparse DFT in time O(KlogK){O}(K\log K) by taking O(K){O}(K) noiseless samples. Inspired by the coding-theoretic design framework, Scheibler et al. proposed the Sparse Fast Hadamard Transform (SparseFHT) algorithm that elegantly computes the KK-sparse WHT in the absence of noise using O(KlogN){O}(K\log N) samples in time O(Klog2N){O}(K\log^2 N). However, the SparseFHT algorithm explicitly exploits the noiseless nature of the problem, and is not equipped to deal with scenarios where the observations are corrupted by noise. Therefore, a question of critical interest is whether this coding-theoretic framework can be made robust to noise. Further, if the answer is yes, what is the extra price that needs to be paid for being robust to noise? In this paper, we show, quite interestingly, that there is {\it no extra price} that needs to be paid for being robust to noise other than a constant factor. In other words, we can maintain the same sample complexity O(KlogN){O}(K\log N) and the computational complexity O(Klog2N){O}(K\log^2 N) as those of the noiseless case, using our SParse Robust Iterative Graph-based Hadamard Transform (SPRIGHT) algorithm.

Keywords

Cite

@article{arxiv.1508.06336,
  title  = {SPRIGHT: A Fast and Robust Framework for Sparse Walsh-Hadamard Transform},
  author = {Xiao Li and Joseph K. Bradley and Sameer Pawar and Kannan Ramchandran},
  journal= {arXiv preprint arXiv:1508.06336},
  year   = {2015}
}

Comments

Part of our results was reported in ISIT 2014, titled "The SPRIGHT algorithm for robust sparse Hadamard Transforms."

R2 v1 2026-06-22T10:41:34.096Z