English
Related papers

Related papers: New Methods for Handling Singular Sample Covarianc…

200 papers

Support vector machine (SVM) is a well-known statistical technique for classification problems in machine learning and other fields. An important question for SVM is the selection of covariates (or features) for the model. Many studies have…

Methodology · Statistics 2022-02-22 Jiahui Zou , Chaoxia Yuan , Xinyu Zhang , Guohua Zou , Alan T. K. Wan

This work considers Maximum Likelihood Estimation (MLE) of a Toeplitz structured covariance matrix. In this regard, an equivalent reformulation of the MLE problem is introduced and two iterative algorithms are proposed for the optimization…

Signal Processing · Electrical Eng. & Systems 2025-05-13 Augusto Aubry , Prabhu Babu , Antonio De Maio , Massimo Rosamilia

We consider high-dimensional measurement errors with high-frequency data. Our objective is on recovering the high-dimensional cross-sectional covariance matrix of the random errors with optimality. In this problem, not all components of the…

Statistics Theory · Mathematics 2024-04-03 Jinyuan Chang , Qiao Hu , Cheng Liu , Cheng Yong Tang

Randomization, as a key technique in clinical trials, can eliminate sources of bias and produce comparable treatment groups. In randomized experiments, the treatment effect is a parameter of general interest. Researchers have explored the…

Methodology · Statistics 2023-12-05 Fuyi Tu , Wei Ma , Hanzhong Liu

In massive multiple-input multiple-output (MIMO) systems, the knowledge of the users' channel covariance matrix is crucial for minimum mean square error (MMSE) channel estimation in the uplink as well as it plays an important role in…

Information Theory · Computer Science 2022-06-07 Tianyu Yang , Mahdi Barzegar Khalilsarai , Saeid Haghighatshoar , Giuseppe Caire

This paper introduces a new method to estimate the spectral distribution of a population covariance matrix from high-dimensional data. The method is founded on a meaningful generalization of the seminal Marcenko-Pastur equation, originally…

Methodology · Statistics 2013-02-05 Weiming Li , Jiaqi Chen , Yingli Qin , Jianfeng Yao , Zhidong Bai

As one of the most commonly seen data challenges, missing data, in particular, multiple, non-monotone missing patterns, complicates estimation and inference due to the fact that missingness mechanisms are often not missing at random, and…

Methodology · Statistics 2025-04-21 Jianing Dong , Raymond K. W. Wong , Kwun Chuen Gary Chan

We consider applying stochastic approximation (SA) methods to solve nonsmooth variational inclusion problems. Existing studies have shown that the averaged iterates of SA methods exhibit asymptotic normality, with an optimal limiting…

Machine Learning · Statistics 2025-08-13 Liwei Jiang , Abhishek Roy , Krishna Balasubramanian , Damek Davis , Dmitriy Drusvyatskiy , Sen Na

In portfolio risk minimization, the inverse covariance matrix of returns is often unknown and has to be estimated in practice. This inverse covariance matrix also prescribes the hedge trades in which a stock is hedged by all the other…

Portfolio Management · Quantitative Finance 2024-07-15 Lim Hao Shen Keith

A new nonparametric estimator for Toeplitz covariance matrices is proposed. This estimator is based on a data transformation that translates the problem of Toeplitz covariance matrix estimation to the problem of mean estimation in an…

Statistics Theory · Mathematics 2024-01-08 Karolina Klockmann , Tatyana Krivobokova

In distributed systems, communication is a major concern due to issues such as its vulnerability or efficiency. In this paper, we are interested in estimating sparse inverse covariance matrices when samples are distributed into different…

Methodology · Statistics 2016-10-04 Jesús Arroyo , Elizabeth Hou

In this paper we propose a perturbative method for the reconstruction of the covariance matrix of a multinormal distribution, under the assumption that the only available information amounts to the covariance matrix of a spherically…

Statistics Theory · Mathematics 2019-07-19 Filippo Palombi , Simona Toti

Kernel methods are successful approaches for different machine learning problems. This success is mainly rooted in using feature maps and kernel matrices. Some methods rely on the eigenvalues/eigenvectors of the kernel matrix, while for…

Machine Learning · Computer Science 2012-02-20 Nima Reyhani , Hideitsu Hino , Ricardo Vigario

A constrained multivariate linear model is a multivariate linear model with the columns of its coefficient matrix constrained to lie in a known subspace. This class of models includes those typically used to study growth curves and…

Methodology · Statistics 2021-01-05 Dennis Cook , Liliana Forzani , Lan Liu

We propose a framework for the statistical evaluation of variational auto-encoders (VAEs) and test two instances of this framework in the context of modelling images of handwritten digits and a corpus of English text. Our take on evaluation…

Machine Learning · Computer Science 2022-04-08 Claartje Barkhof , Wilker Aziz

Covariance estimation is ubiquitous in functional data analysis. Yet, the case of functional observations over multidimensional domains introduces computational and statistical challenges, rendering the standard methods effectively…

Methodology · Statistics 2022-11-02 Soham Sarkar , Victor M. Panaretos

We develop an algorithm for sampling from the unitary invariant random matrix ensembles. The algorithm is based on the representation of their eigenvalues as a determinantal point process whose kernel is given in terms of orthogonal…

Mathematical Physics · Physics 2014-04-02 Sheehan Olver , Raj Rao Nadakuditi , Thomas Trogdon

We consider a generalization of the Ewens measure for the symmetric group, calculating moments of the characteristic polynomial and similar multiplicative statistics. In addition, we study the asymptotic behavior of linear statistics (such…

Probability · Mathematics 2013-03-14 Christopher Hughes , Joseph Najnudel , Ashkan Nikeghbali , Dirk Zeindler

This paper studies the problem of estimating a large coefficient matrix in a multiple response linear regression model when the coefficient matrix could be both of low rank and sparse in the sense that most nonzero entries concentrate on a…

Methodology · Statistics 2016-03-18 Zhuang Ma , Zongming Ma , Tingni Sun

Covariance matrix estimation and principal component analysis (PCA) are two cornerstones of multivariate analysis. Classic textbook solutions perform poorly when the dimension of the data is of a magnitude similar to the sample size, or…

Statistics Theory · Mathematics 2014-06-25 Olivier Ledoit , Michael Wolf
‹ Prev 1 3 4 5 6 7 10 Next ›