English
Related papers

Related papers: A unified approach for covariance matrix estimatio…

200 papers

We propose a Stein characterization of the Kummer distribution on (0, $\infty$). This result follows from our observation that the density of the Kummer distribution satisfies a certain differential equation, leading to a solution of the…

Probability · Mathematics 2018-08-07 Essomanda Konzou , Angelo Koudou

In many practical situations we would like to estimate the covariance matrix of a set of variables from an insufficient amount of data. More specifically, if we have a set of $N$ independent, identically distributed measurements of an $M$…

Probability · Mathematics 2010-10-05 Thomas L. Marzetta , Gabriel H. Tucci , Steven H. Simon

Stochastic inverse problems considered in this article consist of estimating the probability distributions of intrinsically random inputs of computer models. These estimations are based on observable outputs affected by model noise, and…

Statistics Theory · Mathematics 2025-03-17 Nicolas Bousquet , Mélanie Blazère , Thomas Cerbelaud

In applications of Gaussian processes where quantification of uncertainty is of primary interest, it is necessary to accurately characterize the posterior distribution over covariance parameters. This paper proposes an adaptation of the…

Methodology · Statistics 2015-09-04 Maurizio Filippone , Raphael Engler

This paper tackles the problem of robust covariance matrix estimation when the data is incomplete. Classical statistical estimation methodologies are usually built upon the Gaussian assumption, whereas existing robust estimation ones assume…

Covariate shift occurs prevalently in practice, where the input distributions of the source and target data are substantially different. Despite its practical importance in various learning problems, most of the existing methods only focus…

Machine Learning · Statistics 2023-10-20 Xingdong Feng , Xin He , Caixing Wang , Chao Wang , Jingnan Zhang

This paper studies the problem of interacting multiple model (IMM) estimation for jump Markov linear systems with unknown measurement noise covariance. The system state and the unknown covariance are jointly estimated in the framework of…

Systems and Control · Computer Science 2014-11-06 Wenling Li , Yingmin Jia

Generalised Bayesian inference updates prior beliefs using a loss function, rather than a likelihood, and can therefore be used to confer robustness against possible mis-specification of the likelihood. Here we consider generalised Bayesian…

Methodology · Statistics 2022-01-12 Takuo Matsubara , Jeremias Knoblauch , François-Xavier Briol , Chris. J. Oates

In minimum trace (MinT) forecast reconciliation, the covariance matrix of the base forecasts errors plays a crucial role. Typically, this matrix is estimated and then treated as known. This can lead to underestimation of the variance of the…

Methodology · Statistics 2026-05-11 Chiara Carrara , Dario Azzimonti , Giorgio Corani , Lorenzo Zambon

The problem of simultaneous estimation of order restricted location parameters $\theta_1$ and $\theta_2$ ($-\infty<\theta_1\leq \theta_2<\infty$) of a bivariate location symmetric distribution, under a general loss function, is being…

Statistics Theory · Mathematics 2023-09-26 Naresh Garg , Neeraj Misra

Estimation of the covariance matrix of asset returns is crucial to portfolio construction. As suggested by economic theories, the correlation structure among assets differs between emerging markets and developed countries. It is therefore…

Methodology · Statistics 2021-09-28 Xin Chen , Dan Yang , Yan Xu , Yin Xia , Dong Wang , Haipeng Shen

We study the problem of high-dimensional covariance estimation under the constraint that the partial correlations are nonnegative. The sign constraints dramatically simplify estimation: the Gaussian maximum likelihood estimator is well…

Statistics Theory · Mathematics 2020-07-31 Jake A. Soloff , Adityanand Guntuboyina , Michael I. Jordan

We propose a new general version of Stein's method for univariate distributions. In particular we propose a canonical definition of the Stein operator of a probability distribution {which is based on a linear difference or differential-type…

Probability · Mathematics 2016-03-28 Christophe Ley , Gesine Reinert , Yvik Swan

We develop a method for estimating well-conditioned and sparse covariance and inverse covariance matrices from a sample of vectors drawn from a sub-gaussian distribution in high dimensional setting. The proposed estimators are obtained by…

Statistics Theory · Mathematics 2016-11-21 Ashwini Maurya

We consider component-wise equivariant estimation of order restricted location/scale parameters of a general bivariate distribution under quite general conditions on underlying distributions and the loss function. This paper unifies various…

Statistics Theory · Mathematics 2022-07-05 Naresh Garg , Neeraj Misra

Estimation of the covariance matrix has attracted a lot of attention of the statistical research community over the years, partially due to important applications such as Principal Component Analysis. However, frequently used empirical…

Statistics Theory · Mathematics 2018-06-19 Stanislav Minsker

As a classical problem, covariance estimation has drawn much attention from the statistical community for decades. Much work has been done under the frequentist and the Bayesian frameworks. Aiming to quantify the uncertainty of the…

Methodology · Statistics 2017-08-17 W. Jenny Shi , Jan Hannig , Randy C. S. Lai , Thomas C. M. Lee

Reliable uncertainty estimates are an important tool for helping autonomous agents or human decision makers understand and leverage predictive models. However, existing approaches to estimating uncertainty largely ignore the possibility of…

Machine Learning · Computer Science 2020-05-22 Sangdon Park , Osbert Bastani , James Weimer , Insup Lee

Estimation of the mean vector and covariance matrix is of central importance in the analysis of multivariate data. In the framework of generalized linear models, usually the variances are certain functions of the means with the normal…

Methodology · Statistics 2023-01-25 Anupam Kundu , Mohsen Pourahmadi

A hierarchical Bayesian approach that permits simultaneous inference for the regression coefficient matrix and the error precision (inverse covariance) matrix in the multivariate linear model is proposed. Assuming a natural ordering of the…

Methodology · Statistics 2024-10-29 Christina Zhao , Ding Xiang , Galin L. Jones , Adam J. Rothman