English
Related papers

Related papers: A new approach to Cholesky-based covariance regula…

200 papers

Compressive covariance estimation has arisen as a class of techniques whose aim is to obtain second-order statistics of stochastic processes from compressive measurements. Recently, these methods have been used in various image processing…

Image and Video Processing · Electrical Eng. & Systems 2022-07-27 Jonathan Monsalve , Juan Ramirez , Iñaki Esnaola , Henry Arguello

Kotlarski's identity has been widely used in applied economic research. However, how to conduct inference based on this popular identification approach has been an open question for two decades. This paper addresses this open problem by…

Econometrics · Economics 2019-09-10 Kengo Kato , Yuya Sasaki , Takuya Ura

Linear discriminant analysis (LDA) is a widely used technique for data classification. The method offers adequate performance in many classification problems, but it becomes inefficient when the data covariance matrix is ill-conditioned.…

Machine Learning · Statistics 2024-02-08 Maaz Mahadi , Tarig Ballal , Muhammad Moinuddin , Tareq Y. Al-Naffouri , Ubaid M. Al-Saggaf

We consider the maximum likelihood estimation of sparse inverse covariance matrices. We demonstrate that current heuristic approaches primarily encourage robustness, instead of the desired sparsity. We give a novel approach that solves the…

Machine Learning · Statistics 2021-11-08 Dimitris Bertsimas , Jourdain Lamperski , Jean Pauphilet

In this paper, we study the trace regression when a matrix of parameters B* is estimated via the convex relaxation of a rank-regularized regression or via regularized non-convex optimization. It is known that these estimators satisfy…

Machine Learning · Computer Science 2023-08-31 Nima Hamidi , Mohsen Bayati

We derive a maximum a posteriori estimator for the linear observation model, where the signal and noise covariance matrices are both uncertain. The uncertainties are treated probabilistically by modeling the covariance matrices with prior…

Statistics Theory · Mathematics 2014-03-12 Dave Zachariah , Nafiseh Shariati , Mats Bengtsson , Magnus Jansson , Saikat Chatterjee

We introduce an estimation method of covariance matrices in a high-dimensional setting, i.e., when the dimension of the matrix, , is larger than the sample size . Specifically, we propose an orthogonally equivariant estimator. The…

Statistics Theory · Mathematics 2020-12-04 Samprit Banerjee , Stefano Monni

Covariance estimation becomes challenging in the regime where the number p of variables outstrips the number n of samples available to construct the estimate. One way to circumvent this problem is to assume that the covariance matrix is…

Probability · Mathematics 2012-06-14 Richard Y. Chen , Alex Gittens , Joel A. Tropp

This paper investigates the high-dimensional linear regression with highly correlated covariates. In this setup, the traditional sparsity assumption on the regression coefficients often fails to hold, and consequently many model selection…

Methodology · Statistics 2019-03-26 Jianqing Fan , Bai Jiang , Qiang Sun

Large datasets are often affected by cell-wise outliers in the form of missing or erroneous data. However, discarding any samples containing outliers may result in a dataset that is too small to accurately estimate the covariance matrix.…

Statistics Theory · Mathematics 2023-11-13 Karim Lounici , Grégoire Pacreau

We consider the problem of estimating the covariance matrix of a random signal observed through unknown translations (modeled by cyclic shifts) and corrupted by noise. Solving this problem allows to discover low-rank structures masked by…

Statistics Theory · Mathematics 2020-11-11 Boris Landa , Yoel Shkolnisky

We consider the problem of estimation of a covariance matrix for Gaussian data in a high dimensional setting. Existing approaches include maximum likelihood estimation under a pre-specified sparsity pattern, l_1-penalized loglikelihood…

Methodology · Statistics 2024-10-04 Luca Cibinel , Alberto Roverato , Veronica Vinciotti

This paper tackles the problem of robust covariance matrix estimation when the data is incomplete. Classical statistical estimation methodologies are usually built upon the Gaussian assumption, whereas existing robust estimation ones assume…

Statistical causal inference from observational studies often requires adjustment for a possibly multi-dimensional variable, where dimension reduction is crucial. The propensity score, first introduced by Rosenbaum and Rubin, is a popular…

Statistics Theory · Mathematics 2020-04-28 Hui Guo , Philip Dawid , Giovanni Berzuini

Factor modeling is an essential tool for exploring intrinsic dependence structures among high-dimensional random variables. Much progress has been made for estimating the covariance matrix from a high-dimensional factor model. However, the…

Statistics Theory · Mathematics 2016-10-26 Quefeng Li , Guang Cheng , Jianqing Fan , Yuyan Wang

Inverse optimization refers to the inference of unknown parameters of an optimization problem based on knowledge of its optimal solutions. This paper considers inverse optimization in the setting where measurements of the optimal solutions…

Optimization and Control · Mathematics 2017-12-27 Anil Aswani , Zuo-Jun Max Shen , Auyon Siddiq

Interior-point methods for linear programming problems require the repeated solution of a linear system of equations. Solving these linear systems is non-trivial due to the severe ill-conditioning of the matrices towards convergence. This…

Optimization and Control · Mathematics 2021-05-05 Jeffrey Cornelis , Wim Vanroose

Estimation of a precision matrix (i.e., inverse covariance matrix) is widely used to exploit conditional independence among continuous variables. The influence of abnormal observations is exacerbated in a high dimensional setting as the…

Methodology · Statistics 2021-05-17 Peng Tang , Huijing Jiang , Heeyoung Kim , Xinwei Deng

For highly skewed or fat-tailed distributions, mean or median-based methods often fail to capture the central tendencies in the data. Despite being a viable alternative, estimating the conditional mode given certain covariates (or mode…

Econometrics · Economics 2024-12-10 Eduardo Schirmer Finn , Eduardo Horta

Factor analysis is a flexible technique for assessment of multivariate dependence and codependence. Besides being an exploratory tool used to reduce the dimensionality of multivariate data, it allows estimation of common factors that often…

Methodology · Statistics 2020-02-19 Kelly C. M. Gonçalves , Afonso C. B. Silva