English

Sparse model selection in the highly under-sampled regime

Machine Learning 2017-01-03 v2 Disordered Systems and Neural Networks

Abstract

We propose a method for recovering the structure of a sparse undirected graphical model when very few samples are available. The method decides about the presence or absence of bonds between pairs of variable by considering one pair at a time and using a closed form formula, analytically derived by calculating the posterior probability for every possible model explaining a two body system using Jeffreys prior. The approach does not rely on the optimisation of any cost functions and consequently is much faster than existing algorithms. Despite this time and computational advantage, numerical results show that for several sparse topologies the algorithm is comparable to the best existing algorithms, and is more accurate in the presence of hidden variables. We apply this approach to the analysis of US stock market data and to neural data, in order to show its efficiency in recovering robust statistical dependencies in real data with non stationary correlations in time and space.

Keywords

Cite

@article{arxiv.1603.00952,
  title  = {Sparse model selection in the highly under-sampled regime},
  author = {Nicola Bulso and Matteo Marsili and Yasser Roudi},
  journal= {arXiv preprint arXiv:1603.00952},
  year   = {2017}
}

Comments

54 pages, 26 figures

R2 v1 2026-06-22T13:02:45.050Z