English

Effect of global shrinkage parameter of horseshoe prior in compressed sensing

Disordered Systems and Neural Networks 2025-03-04 v1

Abstract

In sparse signal processing, this study investigates the effect of the global shrinkage parameter τ\tau of a horseshoe prior, one of the global-local shrinkage prior, on the linear regression. Statistical mechanics methods are employed to examine the accuracy of signal estimation. A phase diagram of successful and failure of signal recovery in noise-less compressed sensing with varying τ\tau is discussed from the viewpoint of dynamic characterization of the approximate message passing as a solving algorithm and static characterization of the free-energy landscape. It is found that there exists a parameter region where the approximate message passing algorithm can hardly recover the true signal, even though the true signal is locally stable. The analysis of the free-energy landscape also provides important insight into the optimal choice of τ\tau.

Keywords

Cite

@article{arxiv.2306.02607,
  title  = {Effect of global shrinkage parameter of horseshoe prior in compressed sensing},
  author = {Yasushi Nagano and Koji Hukushima},
  journal= {arXiv preprint arXiv:2306.02607},
  year   = {2025}
}

Comments

13 pages, 15 figures