English
Related papers

Related papers: Shrinkage Estimation for the Diagonal Multivariate…

200 papers

In numerous instances, the generalized exponential distribution can be used as an alternative to the most widely used non-regular family of distributions: Weibull, gamma, lognormal with three-parameters when analyzing lifetime or any skewed…

Methodology · Statistics 2026-03-03 Kiran Prajapat , Sharmishtha Mitra , Debasis Kundu

We study general singular value shrinkage estimators in high-dimensional regression and classification, when the number of features and the sample size both grow proportionally to infinity. We allow models with general covariance matrices…

Statistics Theory · Mathematics 2020-04-01 Panagiotis Lolas

This paper focuses on investigating Stein's invariant shrinkage estimators for large sample covariance matrices and precision matrices in high-dimensional settings. We consider models that have nearly arbitrary population covariance…

Statistics Theory · Mathematics 2024-04-24 Xiucai Ding , Yun Li , Fan Yang

Many statistical applications require an estimate of a covariance matrix and/or its inverse. When the matrix dimension is large compared to the sample size, which happens frequently, the sample covariance matrix is known to perform poorly…

Statistics Theory · Mathematics 2012-07-24 Olivier Ledoit , Michael Wolf

Estimating a covariance matrix is an important task in applications where the number of variables is larger than the number of observations. Shrinkage approaches for estimating a high-dimensional covariance matrix are often employed to…

Methodology · Statistics 2015-06-18 Anestis Touloumis

In this paper, a shrinkage estimator for the population mean is proposed under known quadratic loss functions with unknown covariance matrices. The new estimator is non-parametric in the sense that it does not assume a specific parametric…

Methodology · Statistics 2014-11-07 Cheng Wang , Tiejun Tong , Longbing Cao , Baiqi Miao

Shrinkage estimators have profound impacts in statistics and in scientific and engineering applications. In this article, we consider shrinkage estimation in the presence of linear predictors. We formulate two heteroscedastic hierarchical…

Methodology · Statistics 2024-06-21 Samuel Kou , Justin J. Yang

The state-of-the-art methods for estimating high-dimensional covariance matrices all shrink the eigenvalues of the sample covariance matrix towards a data-insensitive shrinkage target. The underlying shrinkage transformation is either…

Machine Learning · Statistics 2025-11-25 Man-Chung Yue , Yves Rychener , Daniel Kuhn , Viet Anh Nguyen

We study estimation of the covariance matrix under relative condition number loss $\kappa(\Sigma^{-1/2} \hat{\Sigma} \Sigma^{-1/2})$, where $\kappa(\Delta)$ is the condition number of matrix $\Delta$, and $\hat{\Sigma}$ and $\Sigma$ are the…

Statistics Theory · Mathematics 2018-10-18 David L. Donoho , Behrooz Ghorbani

In this paper, we consider simultaneous estimation of Poisson parameters in situations where we can use side information in aggregated data. We use standardized squared error and entropy loss functions. Bayesian shrinkage estimators are…

Statistics Theory · Mathematics 2023-11-06 Yasuyuki Hamura

This manuscript presents an approach to perform generalized linear regression with multiple high dimensional covariance matrices as the outcome. Model parameters are proposed to be estimated by maximizing a pseudo-likelihood. When the data…

Methodology · Statistics 2020-07-28 Yi Zhao , Brian S. Caffo , Xi Luo

This paper is devoted to the multivariate estimation of a vector of Poisson means. A novel loss function that penalises bad estimates of each of the parameters and the sum (or equivalently the mean) of the parameters is introduced. Under…

Statistics Theory · Mathematics 2019-04-25 Emil Aas Stoltenberg , Nils Lid Hjort

In this paper we propose a family of multivariate asymmetric distributions over an arbitrary subset of set of real numbers which is defined in terms of the well-known elliptically symmetric distributions. We explore essential properties,…

Methodology · Statistics 2024-09-02 Roberto Vila , Helton Saulo , Leonardo Santos , João Monteiros , Felipe Quintino

We address high dimensional covariance estimation for elliptical distributed samples, which are also known as spherically invariant random vectors (SIRV) or compound-Gaussian processes. Specifically we consider shrinkage methods that are…

Methodology · Statistics 2015-05-20 Yilun Chen , Ami Wiesel , Alfred O. Hero

Shrinkage estimation usually reduces variance at the cost of bias. But when we care only about some parameters of a model, I show that we can reduce variance without incurring bias if we have additional information about the distribution of…

Statistics Theory · Mathematics 2017-11-01 Jann Spiess

In this paper we investigate the performance of periodogram based estimators of the spectral density matrix of possibly high-dimensional time series. We suggest and study shrinkage as a remedy against numerical instabilities due to…

Statistics Theory · Mathematics 2008-08-13 Hilmar Böhm , Rainer von Sachs

We consider in this paper the semiparametric mixture of two distributions equal up to a shift parameter. The model is said to be semiparametric in the sense that the mixed distribution is not supposed to belong to a parametric family. In…

Statistics Theory · Mathematics 2011-11-10 Cristina Butucea , Pierre Vandekerkhove

We study the consistency of sample mean-variance portfolios of arbitrarily high dimension that are based on Bayesian or shrinkage estimation of the input parameters as well as weighted sampling. In an asymptotic setting where the number of…

Portfolio Management · Quantitative Finance 2015-05-30 Francisco Rubio , Xavier Mestre , Daniel P. Palomar

In this paper, we are basically discussing on a class of Baranchik type shrinkage estimators of the vector parameter in a location model, with errors belonging to a sub-class of elliptically contoured distributions. We derive conditions…

Statistics Theory · Mathematics 2012-03-07 Mohammad Arashi

Shrinkage estimators of covariance are an important tool in modern applied and theoretical statistics. They play a key role in regularized estimation problems, such as ridge regression (aka Tykhonov regularization), regularized discriminant…

Statistics Theory · Mathematics 2011-05-10 Noureddine El Karoui , Holger Koesters