English
Related papers

Related papers: Minimum Eigenvalue Based Covariance Matrix Estimat…

200 papers

Machine learning models traditionally assume that training and test data are independently and identically distributed. However, in real-world applications, the test distribution often differs from training. This problem, known as…

Machine Learning · Computer Science 2024-06-19 Kotaro Yoshida , Hiroki Naganuma

Covariance matrix estimation, a classical statistical topic, poses significant challenges when the sample size is comparable to or smaller than the number of features. In this paper, we frame covariance matrix estimation as a compound…

Methodology · Statistics 2025-03-04 Huqin Xin , Sihai Dave Zhao

This paper establishes bounds on the predictive performance of empirical risk minimization for principal component regression. Our analysis is nonparametric, in the sense that the relation between the prediction target and the predictors is…

Econometrics · Economics 2024-09-18 Christian Brownlees , Guðmundur Stefán Guðmundsson , Yaping Wang

The application of machine learning models can be significantly impeded by the occurrence of distributional shifts, as the assumption of homogeneity between the population of training and testing samples in machine learning and statistics…

Machine Learning · Statistics 2023-06-06 Wenlu Tang , Zicheng Liu

In the last years, the success of kernel-based regularisation techniques in solving impulse response modelling tasks has revived the interest on linear system identification. In this work, an alternative perspective on the same problem is…

Systems and Control · Computer Science 2016-10-25 Anna Marconato , Maarten Schoukens , Johan Schoukens

The radiative transfer equation models various physical processes ranging from plasma simulations to radiation therapy. In practice, these phenomena are often subject to uncertainties. Modeling and propagating these uncertainties requires…

Numerical Analysis · Mathematics 2025-06-02 Chinmay Patwardhan , Pia Stammer , Emil Løvbak , Jonas Kusch , Sebastian Krumscheid

We determine the capacity-achieving input covariance matrices for coherent block-fading correlated MIMO Rician channels. In contrast with the Rayleigh and uncorrelated Rician cases, no closed-form expressions for the eigenvectors of the…

Information Theory · Computer Science 2007-07-13 Julien Dumont , Philippe Loubaton , Samson Lasaulce

The performance of machine learning models can be impacted by changes in data over time. A promising approach to address this challenge is invariant learning, with a particular focus on a method known as invariant risk minimization (IRM).…

Machine Learning · Computer Science 2024-04-09 Wenlu Tang , Zicheng Liu

Estimation of the mean vector and covariance matrix is of central importance in the analysis of multivariate data. In the framework of generalized linear models, usually the variances are certain functions of the means with the normal…

Methodology · Statistics 2023-01-25 Anupam Kundu , Mohsen Pourahmadi

Estimating a high-dimensional sparse covariance matrix from a limited number of samples is a fundamental problem in contemporary data analysis. Most proposals to date, however, are not robust to outliers or heavy tails. Towards bridging…

Statistics Theory · Mathematics 2020-08-04 John Goes , Gilad Lerman , Boaz Nadler

An admissible estimator of the eigenvalues of the variance-covariance matrix is given for multivariate normal distributions with respect to the scale-invariant squared error loss.

Statistics Theory · Mathematics 2011-01-14 Yo Sheena , Akimichi Takemura

We study the basic problem of robust subspace recovery. That is, we assume a data set that some of its points are sampled around a fixed subspace and the rest of them are spread in the whole ambient space, and we aim to recover the fixed…

Machine Learning · Statistics 2015-03-19 Teng Zhang , Gilad Lerman

Radar systems typically employ well-designed deterministic signals for target sensing. In contrast to that, integrated sensing and communications (ISAC) systems have to use random signals to convey useful information, potentially causing…

Signal Processing · Electrical Eng. & Systems 2024-01-17 Shihang Lu , Fan Liu , Fuwang Dong , Yifeng Xiong , Jie Xu , Ya-Feng Liu

Individualized treatment regimes (ITRs) aim to improve clinical outcomes by assigning treatment based on patient-specific characteristics. However, existing methods often struggle with high-dimensional covariates, limiting accuracy,…

Machine Learning · Statistics 2026-01-13 Sungtaek Son , Eardi Lila , Kwun Chuen Gary Chan

There is a great need for robust techniques in data mining and machine learning contexts where many standard techniques such as principal component analysis and linear discriminant analysis are inherently susceptible to outliers.…

Methodology · Statistics 2015-09-28 Garth Tarr , Samuel Müller , Neville C. Weber

The use of sparse precision (inverse covariance) matrices has become popular because they allow for efficient algorithms for joint inference in high-dimensional models. Many applications require the computation of certain elements of the…

Computation · Statistics 2017-12-06 Per Sidén , Finn Lindgren , David Bolin , Mattias Villani

We develop an iterative refinement method that improves the accuracy of a user-chosen subset of $k$ eigenvectors ($k\ll n$) of an $n\times n$ real symmetric matrix. Using an orthogonal matrix represented in compact WY form, the method…

Numerical Analysis · Mathematics 2026-03-02 Takeshi Terao , Katsuhisa Ozaki , Toshiyuki Imamura , Takeshi Ogita

Analytic evaluation of heteroskedasticity consistent covariance matrix estimates (HCCME) is difficult because of the complexity of the formulae currently available. We obtain new analytic formulae for the bias of a class of estimators of…

Methodology · Statistics 2014-05-06 Mumtaz Ahmed , Asad Zaman

In this paper, we address the problem of robust adaptive beamforming of signals received by a linear array. The challenge associated with the beamforming problem is twofold. Firstly, the process requires the inversion of the usually…

Information Theory · Computer Science 2016-11-22 Mohamed Suliman , Tarig Ballal , Tareq Y. Al-Naffouri

This paper considers the problem of estimating the covariance of roto-translations computed by the Iterative Closest Point (ICP) algorithm. The problem is relevant for localization of mobile robots and vehicles equipped with depth-sensing…

Computer Vision and Pattern Recognition · Computer Science 2016-03-18 Silvère Bonnabel , Martin Barczyk , François Goulette