English
Related papers

Related papers: Minimum Eigenvalue Based Covariance Matrix Estimat…

200 papers

Machine learning models often generalize poorly to out-of-distribution (OOD) data as a result of relying on features that are spuriously correlated with the label during training. Recently, the technique of Invariant Risk Minimization (IRM)…

Machine Learning · Computer Science 2023-01-18 Dongsung Huh , Avinash Baidya

Estimation of covariance matrices or their inverses plays a central role in many statistical methods. For these methods to work reliably, estimated matrices must not only be invertible but also well-conditioned. In this paper we present an…

Methodology · Statistics 2014-08-06 Eric C. Chi , Kenneth Lange

The Invariant Risk Minimization (IRM) principle was first proposed by Arjovsky et al. [2019] to address the domain generalization problem by leveraging data heterogeneity from differing experimental conditions. Specifically, IRM seeks to…

Machine Learning · Computer Science 2021-06-21 Kia Khezeli , Arno Blaas , Frank Soboczenski , Nicholas Chia , John Kalantari

This paper studies the optimal state estimation problem for interconnected systems. Each subsystem can obtain its own measurement in real time, while, the measurements transmitted between the subsystems suffer from random delay. The optimal…

Systems and Control · Electrical Eng. & Systems 2023-05-03 Yan Wang , Junlin Xiong , Zaiyue Yang , Rong Su

This work provides a unified analysis of the properties of the sample covariance matrix $\Sigma_n$ over the class of $p\times p$ population covariance matrices $\Sigma$ of reduced effective rank $r_e(\Sigma)$. This class includes scaled…

Statistics Theory · Mathematics 2015-06-02 Florentina Bunea , Luo Xiao

We consider reduced-rank modeling of the white noise covariance matrix in a large dimensional vector autoregressive (VAR) model. We first propose the reduced-rank covariance estimator under the setting where independent observations are…

Applications · Statistics 2014-12-09 Richard A. Davis , Pengfei Zang , Tian Zheng

Recent exploration of optimal individualized decision rules (IDRs) for patients in precision medicine has attracted a lot of attention due to the heterogeneous responses of patients to different treatments. In the existing literature of…

Optimization and Control · Mathematics 2019-08-29 Zhengling Qi , Ying Cui , Yufeng Liu , Jong-Shi Pang

Interval-valued data are one of the most common symbolic data types, which enables the preservation of the underlying variability of the data. The interval mean and covariance matrix can be estimated using the barycenter approach based on…

Methodology · Statistics 2026-04-30 Catarina P. Loureiro , M. Rosário Oliveira , Paula Brito , Lina Oliveira

Estimating the eigenvalues of a population covariance matrix from a sample covariance matrix is a problem of fundamental importance in multivariate statistics; the eigenvalues of covariance matrices play a key role in many widely…

Statistics Theory · Mathematics 2007-06-13 Noureddine El Karoui

We develop a new method to fit the multivariate response linear regression model that exploits a parametric link between the regression coefficient matrix and the error covariance matrix. Specifically, we assume that the correlations…

Methodology · Statistics 2021-12-09 Aaron J. Molstad , Guangwei Weng , Charles R. Doss , Adam J. Rothman

We revisit the problem of computing submatrices of the Cram\'er-Rao bound (CRB), which lower bounds the variance of any unbiased estimator of a vector parameter $\vth$. We explore iterative methods that avoid direct inversion of the Fisher…

Information Theory · Computer Science 2015-06-04 Paul Tune

In this paper, we investigate a reconfigurable intelligent surface (RIS)-assisted integrated sensing and communications (ISAC) framework equipped with multiple Rydberg atomic receiver (RAR)-aided users. By leveraging the reference-assisted…

Signal Processing · Electrical Eng. & Systems 2026-01-13 Hong-Bae Jeon , Chan-Byoung Chae

We propose new simultaneous inference methods for diagnostic trials with elaborate factorial designs. Instead of the commonly used total area under the receiver operating characteristic (ROC) curve, our parameters of interest are partial…

Statistics Theory · Mathematics 2023-02-22 Maximilian Wechsung , Frank Konietschke

We study the problem of estimating the leading eigenvectors of a high-dimensional population covariance matrix based on independent Gaussian observations. We establish a lower bound on the minimax risk of estimators under the $l_2$ loss, in…

Statistics Theory · Mathematics 2012-03-06 Aharon Birnbaum , Iain M. Johnstone , Boaz Nadler , Debashis Paul

Integrated sensing and communication (ISAC) have been widely recognized as a key enabler for future wireless networks, where the Cram\'er-Rao bound (CRB) plays a central role in quantifying sensing accuracy.In this paper, we present the…

Information Theory · Computer Science 2026-01-26 Qian Zhang , Yufei Zhao , Jiancheng An , Zheng Dong , Yong Liang Guan , Ju Liu , Chau Yuen

In distributed systems, communication is a major concern due to issues such as its vulnerability or efficiency. In this paper, we are interested in estimating sparse inverse covariance matrices when samples are distributed into different…

Methodology · Statistics 2016-10-04 Jesús Arroyo , Elizabeth Hou

Monte Carlo integration with variance reduction by means of control variates can be implemented by the ordinary least squares estimator for the intercept in a multiple linear regression model with the integrand as response and the control…

Statistics Theory · Mathematics 2021-04-02 Rémi Leluc , François Portier , Johan Segers

This paper presents reduced-rank linearly constrained minimum variance (LCMV) beamforming algorithms based on joint iterative optimization of filters. The proposed reduced-rank scheme is based on a constrained joint iterative optimization…

Other Computer Science · Computer Science 2012-05-22 R. C. de Lamare , L. Wang , R. Fa

We show that the Invariant Risk Minimization (IRM) formulation of Arjovsky et al. (2019) can fail to capture "natural" invariances, at least when used in its practical "linear" form, and even on very simple problems which directly follow…

Machine Learning · Statistics 2021-03-02 Pritish Kamath , Akilesh Tangella , Danica J. Sutherland , Nathan Srebro

In this article, we establish a limiting distribution for eigenvalues of a class of auto-covariance matrices. The same distribution has been found in the literature for a regularized version of these auto-covariance matrices. The original…

Probability · Mathematics 2021-03-23 Jianfeng Yao , Wangjun Yuan