The Lawson-Hanson Algorithm with Deviation Maximization: Finite Convergence and Sparse Recovery

In this work we apply the "deviation maximization", a new column selection strategy, to the Lawson-Hanson algorithm for the solution of NonNegative Least Squares (NNLS), devising a new algorithm we call Lawson-Hanson with Deviation Maximization (LHDM). This algorithm allows to exploit BLAS-3 operations, leading to higher performances. We show the finite convergence of this algorithm and explore the sparse recovery ability of LHDM. The results are presented with an extensive campaign of experiments, where we compare its performance against several $\ell_1$-minimization solvers. An implementation of the proposed algorithm is available on a public repository.