English
Related papers

Related papers: High-dimensional Precision Matrix Estimation with …

200 papers

We study the problem of estimating from data, a sparse approximation to the inverse covariance matrix. Estimating a sparsity constrained inverse covariance matrix is a key component in Gaussian graphical model learning, but one that is…

Machine Learning · Statistics 2011-06-28 Suvrit Sra , Dongmin Kim

Distributed estimation methods have recently been used to compute the maximum likelihood estimate of the precision matrix for large graphical Gaussian models. Our aim, in this paper, is to give a Bayesian estimate of the precision matrix…

Methodology · Statistics 2016-05-30 Qiong Li , Xin Gao , Helene Massam

We consider the problem of jointly estimating multiple inverse covariance matrices from high-dimensional data consisting of distinct classes. An $\ell_2$-penalized maximum likelihood approach is employed. The suggested approach is flexible…

The problem of finding the missing values of a matrix given a few of its entries, called matrix completion, has gathered a lot of attention in the recent years. Although the problem under the standard low rank assumption is NP-hard,…

Machine Learning · Computer Science 2014-12-01 Vassilis Kalofolias , Xavier Bresson , Michael Bronstein , Pierre Vandergheynst

This paper considers the problem of estimating multiple related Gaussian graphical models from a $p$-dimensional dataset consisting of different classes. Our work is based upon the formulation of this problem as group graphical lasso. This…

Machine Learning · Computer Science 2015-06-19 Qingming Tang , Chao Yang , Jian Peng , Jinbo Xu

Graphical models describe associations between variables through the notion of conditional independence. Gaussian graphical models are a widely used class of such models where the relationships are formalized by non-null entries of the…

Methodology · Statistics 2023-08-08 Sagnik Bhadury , Riten Mitra , Jeremy T. Gaskins

The topological (or graph) structures of real-world networks are known to be predictive of multiple dynamic properties of the networks. Conventionally, a graph structure is represented using an adjacency matrix or a set of hand-crafted…

Social and Information Networks · Computer Science 2016-10-21 Cheng Li , Xiaoxiao Guo , Qiaozhu Mei

We propose methodology for estimation of sparse precision matrices and statistical inference for their low-dimensional parameters in a high-dimensional setting where the number of parameters $p$ can be much larger than the sample size. We…

Statistics Theory · Mathematics 2016-07-21 Jana Janková , Sara van de Geer

We consider the problem of estimating the covariance structure of a random vector $Y\in \mathbb R^d$ from a sample $Y_1,\ldots,Y_n$. We are interested in the situation when $d$ is large compared to $n$ but the covariance matrix $\Sigma$ of…

Statistics Theory · Mathematics 2024-10-08 Stanislav Minsker , Lang Wang

High dimensional data analysis is known to be as a challenging problem. In this article, we give a theoretical analysis of high dimensional classification of Gaussian data which relies on a geometrical analysis of the error measure. It…

Statistics Theory · Mathematics 2008-07-10 Robin Girard

Variational approximation methods have proven to be useful for scaling Bayesian computations to large data sets and highly parametrized models. Applying variational methods involves solving an optimization problem, and recent research in…

Methodology · Statistics 2017-01-13 Victor M. -H. Ong , David J. Nott , Michael S. Smith

Estimation and hypothesis tests for the covariance matrix in high dimensions is a challenging problem as the traditional multivariate asymptotic theory is no longer valid. When the dimension is larger than or increasing with the sample…

Methodology · Statistics 2020-11-18 Deepak Nag Ayyala , Santu Ghosh , Daniel F. Linder

We propose a second-order accurate method to estimate the eigenvectors of extremely large matrices thereby addressing a problem of relevance to statisticians working in the analysis of very large datasets. More specifically, we show that…

Numerical Analysis · Mathematics 2010-02-05 Noureddine El Karoui , Alexandre d'Aspremont

Graphical models are widely used to model stochastic dependences among large collections of variables. We introduce a new method of estimating undirected conditional independence graphs based on the score matching loss, introduced by…

Methodology · Statistics 2016-03-24 Lina Lin , Mathias Drton , Ali Shojaie

Regularization has become a primary tool for developing reliable estimators of the covariance matrix in high-dimensional settings. To curb the curse of dimensionality, numerous methods assume that the population covariance (or inverse…

Methodology · Statistics 2018-02-19 Jacob Bien

Matrices are typically considered over fields or rings. Motivated by applications in parametric differential equations and data-driven modeling, we suggest to study matrices with entries from a Hilbert space and present an elementary theory…

Numerical Analysis · Mathematics 2025-05-09 Stanislav Budzinskiy

The estimation of large covariance matrices has a high dimensional bias. Correcting for this bias can be reformulated via the tool of Free Probability Theory as a free deconvolution. The goal of this work is a computational and statistical…

Probability · Mathematics 2023-05-10 Reda Chhaibi , Fabrice Gamboa , Slim Kammoun , Mauricio Velasco

This paper is concerned with the problem of exact MAP inference in general higher-order graphical models by means of a traditional linear programming relaxation approach. In fact, the proof that we have developed in this paper is a rather…

Optimization and Control · Mathematics 2026-03-23 Ikhlef Bechar

We introduce differentiable indirection -- a novel learned primitive that employs differentiable multi-scale lookup tables as an effective substitute for traditional compute and data operations across the graphics pipeline. We demonstrate…

Graphics · Computer Science 2023-11-21 Sayantan Datta , Carl Marshall , Derek Nowrouzezahrai , Zhao Dong , Zhengqin Li

Matrix completion is about recovering a matrix from its partial revealed entries, and it can often be achieved by exploiting the inherent simplicity or low dimensional structure of the target matrix. For instance, a typical notion of matrix…

Information Theory · Computer Science 2019-10-08 Jinchi Chen , Weiguo Gao , Ke Wei