English

Scalable sparse covariance estimation via self-concordance

Machine Learning 2014-05-14 v1 Information Theory math.IT Optimization and Control

Abstract

We consider the class of convex minimization problems, composed of a self-concordant function, such as the logdet\log\det metric, a convex data fidelity term h()h(\cdot) and, a regularizing -- possibly non-smooth -- function g()g(\cdot). This type of problems have recently attracted a great deal of interest, mainly due to their omnipresence in top-notch applications. Under this \emph{locally} Lipschitz continuous gradient setting, we analyze the convergence behavior of proximal Newton schemes with the added twist of a probable presence of inexact evaluations. We prove attractive convergence rate guarantees and enhance state-of-the-art optimization schemes to accommodate such developments. Experimental results on sparse covariance estimation show the merits of our algorithm, both in terms of recovery efficiency and complexity.

Keywords

Cite

@article{arxiv.1405.3263,
  title  = {Scalable sparse covariance estimation via self-concordance},
  author = {Anastasios Kyrillidis and Rabeeh Karimi Mahabadi and Quoc Tran-Dinh and Volkan Cevher},
  journal= {arXiv preprint arXiv:1405.3263},
  year   = {2014}
}

Comments

7 pages, 1 figure, Accepted at AAAI-14

R2 v1 2026-06-22T04:13:16.258Z