English
Related papers

Related papers: Minimum Eigenvalue Based Covariance Matrix Estimat…

200 papers

One of the goals in scaling sequential machine learning methods pertains to dealing with high-dimensional data spaces. A key related challenge is that many methods heavily depend on obtaining the inverse covariance matrix of the data. It is…

Computation · Statistics 2017-07-28 Tomer Lancewicki

We consider high-dimensional measurement errors with high-frequency data. Our objective is on recovering the high-dimensional cross-sectional covariance matrix of the random errors with optimality. In this problem, not all components of the…

Statistics Theory · Mathematics 2024-04-03 Jinyuan Chang , Qiao Hu , Cheng Liu , Cheng Yong Tang

High dimensional error covariance matrices and their inverses are used to weight the contribution of observation and background information in data assimilation procedures. As observation error covariance matrices are often obtained by…

Optimization and Control · Mathematics 2019-10-02 Jemima M. Tabeart , Sarah L. Dance , Amos S. Lawless , Nancy K. Nichols , Joanne A. Waller

In a wireless system with Intelligent Reflective Surfaces (IRS) containing many passive elements, we consider the problem of channel estimation. All the links from the transmitter to the receiver via each IRS elements (or groups) are…

Signal Processing · Electrical Eng. & Systems 2019-11-25 Tobias Lindstrøm Jensen , Elisabeth De Carvalho

We consider the problem of joint estimation of structured covariance matrices. Assuming the structure is unknown, estimation is achieved using heterogeneous training sets. Namely, given groups of measurements coming from centered…

Statistics Theory · Mathematics 2016-04-20 Ilya Soloveychik , Ami Wiesel

This paper considers the problem of estimating a high-dimensional (HD) covariance matrix when the sample size is smaller, or not much larger, than the dimensionality of the data, which could potentially be very large. We develop a…

Methodology · Statistics 2019-05-22 Esa Ollila , Elias Raninen

The use of improved covariance matrix estimators as an alternative to the sample estimator is considered an important approach for enhancing portfolio optimization. Here we empirically compare the performance of 9 improved covariance…

Portfolio Management · Quantitative Finance 2010-04-27 Ester Pantaleo , Michele Tumminello , Fabrizio Lillo , Rosario N. Mantegna

We derive tight lower bounds on the smallest eigenvalue of a sample covariance matrix of a centred isotropic random vector under weak or no assumptions on its components.

Probability · Mathematics 2014-12-17 Pavel Yaskov

This paper deals with the problem of estimating the covariance matrix of a series of independent multivariate observations, in the case where the dimension of each observation is of the same order as the number of observations. Although…

Information Theory · Computer Science 2015-06-03 Jianfeng Yao , Abla Kammoun , Jamal Najim

For data-driven iterative learning control (ILC) methods, both the model estimation and controller design problems are converted to parameter estimation problems for some chosen model structures. It is well-known that if the model order is…

Systems and Control · Electrical Eng. & Systems 2023-03-08 Xian Yu , Xiaozhu Fang , Biqiang Mu , Tianshi Chen

The Minimum Covariance Determinant (MCD) approach robustly estimates the location and scatter matrix using the subset of given size with lowest sample covariance determinant. Its main drawback is that it cannot be applied when the dimension…

Methodology · Statistics 2021-01-13 Kris Boudt , Peter J. Rousseeuw , Steven Vanduffel , Tim Verdonck

It has been proposed that complex populations, such as those that arise in genomics studies, may exhibit dependencies among observations as well as among variables. This gives rise to the challenging problem of analyzing unreplicated…

Machine Learning · Statistics 2018-06-08 Michael Hornstein , Roger Fan , Kerby Shedden , Shuheng Zhou

We consider estimation of the covariance matrix of a multivariate random vector under the constraint that certain covariances are zero. We first present an algorithm, which we call Iterative Conditional Fitting, for computing the maximum…

Statistics Theory · Mathematics 2010-03-04 Sanjay Chaudhuri , Mathias Drton , Thomas S. Richardson

An important problem in cognitive radar is to enhance the estimation performance of the system by a joint design of its probing signal and receive filter using the a priori information on interference. In such cases, the knowledge of…

Signal Processing · Electrical Eng. & Systems 2022-08-10 Arindam Bose , Aria Ameri , Mojtaba Soltanalian

Low-rank matrix approximations are often used to help scale standard machine learning algorithms to large-scale problems. Recently, matrix coherence has been used to characterize the ability to extract global information from a subset of…

Machine Learning · Statistics 2010-09-07 Mehryar Mohri , Ameet Talwalkar

In massive multiple-input multiple-output (MIMO) systems, the knowledge of the users' channel covariance matrix is crucial for minimum mean square error (MMSE) channel estimation in the uplink as well as it plays an important role in…

Information Theory · Computer Science 2022-06-07 Tianyu Yang , Mahdi Barzegar Khalilsarai , Saeid Haghighatshoar , Giuseppe Caire

In precision medicine, one of the most important problems is estimating the optimal individualized treatment rules (ITR), which typically involves recommending treatment decisions based on fully observed individual characteristics of…

Methodology · Statistics 2025-10-15 Yue Zhang , Shanshan Luo , Zhi Geng , Yangbo He

We introduce Invariant Risk Minimization (IRM), a learning paradigm to estimate invariant correlations across multiple training distributions. To achieve this goal, IRM learns a data representation such that the optimal classifier, on top…

Machine Learning · Statistics 2020-03-31 Martin Arjovsky , Léon Bottou , Ishaan Gulrajani , David Lopez-Paz

The rectangular multiparameter eigenvalue problem (RMEP) involves rectangular coefficient matrices (usually with more rows than columns) and may potentially have no solution in its original form. A minimal perturbation framework is proposed…

Numerical Analysis · Mathematics 2025-08-11 Shanheng Han , Lei-Hong Zhang , Ren-Cang Li

Estimating the disturbance or clutter covariance is a centrally important problem in radar space time adaptive processing (STAP). The disturbance covariance matrix should be inferred from training sample observations in practice. Large…

Applications · Statistics 2016-02-22 Bosung Kang