English
Related papers

Related papers: Estimation of mean vector in elliptical models

200 papers

In this paper a new family of minimum divergence estimators based on the Bregman divergence is proposed, where the defining convex function has an exponential nature. These estimators avoid the necessity of using an intermediate kernel…

Methodology · Statistics 2019-11-25 Taranga Mukherjee , Abhijit Mandal , Ayanendranath Basu

Shrinkage estimators of covariance are an important tool in modern applied and theoretical statistics. They play a key role in regularized estimation problems, such as ridge regression (aka Tykhonov regularization), regularized discriminant…

Statistics Theory · Mathematics 2011-05-10 Noureddine El Karoui , Holger Koesters

A popular regularized (shrinkage) covariance estimator is the shrinkage sample covariance matrix (SCM) which shares the same set of eigenvectors as the SCM but shrinks its eigenvalues toward its grand mean. In this paper, a more general…

Methodology · Statistics 2020-02-13 Esa Ollila , Daniel P. Palomar , Frederic Pascal

We introduce a distributionally robust maximum likelihood estimation model with a Wasserstein ambiguity set to infer the inverse covariance matrix of a $p$-dimensional Gaussian random vector from $n$ independent samples. The proposed model…

Optimization and Control · Mathematics 2018-05-21 Viet Anh Nguyen , Daniel Kuhn , Peyman Mohajerin Esfahani

The estimation of parameters in a linear model is considered under the hypothesis that the noise, with finite second order statistics, can be represented in a given deterministic basis by random coefficients. An extended underdetermined…

Statistics Theory · Mathematics 2014-05-06 Piero Barone , Isabella Lari

The state-of-the-art methods for estimating high-dimensional covariance matrices all shrink the eigenvalues of the sample covariance matrix towards a data-insensitive shrinkage target. The underlying shrinkage transformation is either…

Machine Learning · Statistics 2025-11-25 Man-Chung Yue , Yves Rychener , Daniel Kuhn , Viet Anh Nguyen

In this paper, a new ridge-type shrinkage estimator for the precision matrix has been proposed. The asymptotic optimal shrinkage coefficients and the theoretical loss were derived. Data-driven estimators for the shrinkage coefficients were…

Methodology · Statistics 2019-09-04 Cheng Wang , Guangming Pan , Longbing Cao

We propose a distributionally robust formulation for simultaneously estimating the covariance matrix and the precision matrix of a random vector.The proposed model minimizes the worst-case weighted sum of the Frobenius loss of the…

Machine Learning · Statistics 2025-11-19 Renjie Chen , Viet Anh Nguyen , Huifu Xu

Beta regression model is useful in the analysis of bounded continuous outcomes such as proportions. It is well known that for any regression model, the presence of multicollinearity leads to poor performance of the maximum likelihood…

Methodology · Statistics 2021-11-30 Ejaz Ahmed , Reza Arabi Belaghi , Yasin Asar , Abdulkhadir Hussein

We consider shrinkage estimation of higher order Hilbert space valued Bochner integrals in a non-parametric setting. We propose estimators that shrink the $U$-statistic estimator of the Bochner integral towards a pre-specified target…

Statistics Theory · Mathematics 2022-07-22 Saiteja Utpala , Bharath K. Sriperumbudur

The problem of reducing the bias of maximum likelihood estimator in a general multivariate elliptical regression model is considered. The model is very flexible and allows the mean vector and the dispersion matrix to have parameters in…

Statistics Theory · Mathematics 2016-02-01 Tatiane F. N. Melo , Silvia L. P. Ferrari , Alexandre G. Patriota

The beta regression model is a useful framework to model response variables that are rates or proportions, that is to say, response variables which are continuous and restricted to the interval (0,1). As with any other regression model,…

Methodology · Statistics 2024-06-27 Luis Firinguetti , Manuel González-Navarrete , Romer Machaca-Aguilar

This paper proposes minimum sliced distance estimation in structural econometric models with possibly parameter-dependent supports. In contrast to likelihood-based estimation, we show that under mild regularity conditions, the minimum…

Econometrics · Economics 2024-12-10 Yanqin Fan , Hyeonseok Park

The negative multinomial distribution is a multivariate generalization of the negative binomial distribution. In this paper, we consider the problem of estimating an unknown matrix of probabilities on the basis of observations of negative…

Statistics Theory · Mathematics 2020-10-30 Yasuyuki Hamura , Tatsuya Kubokawa

We propose a flexible class of models based on scale mixture of uniform distributions to construct shrinkage priors for covariance matrix estimation. This new class of priors enjoys a number of advantages over the traditional scale mixture…

Methodology · Statistics 2011-10-07 Hao Wang , Natesh S. Pillai

In this article we provide some nonnegative and positive estimators of the mean squared errors(MSEs) for shrinkage estimators of multivariate normal means. Proposed estimators are shown to improve on the uniformly minimum variance unbiased…

Statistics Theory · Mathematics 2007-10-08 Hisayuki Hara

In this paper, we propose some estimators for the parameters of a statistical model based on Kullback-Leibler divergence of the survival function in continuous setting. We prove that the proposed estimators are subclass of "generalized…

Statistics Theory · Mathematics 2016-07-01 Yaser Mehrali , Majid Asadi

Shrinkage methods are frequently used to improve the precision of least squares estimators of fixed effects. However, widely used shrinkage estimators guarantee improved precision only under strong distributional assumptions. I develop an…

Econometrics · Economics 2025-09-09 Soonwoo Kwon

We consider the estimation of the $p$-variate normal mean of $X\sim N_p(\theta,I)$ under the quadratic loss function. We investigate the decision theoretic properties of debiased shrinkage estimator, the estimator which shrinks towards the…

Statistics Theory · Mathematics 2023-06-08 Yuzo Maruyama , Akimichi Takemura

This paper considers the problem of estimating a high-dimensional vector of parameters $\boldsymbol{\theta} \in \mathbb{R}^n$ from a noisy observation. The noise vector is i.i.d. Gaussian with known variance. For a squared-error loss…

Information Theory · Computer Science 2018-03-19 K. Pavan Srinath , Ramji Venkataramanan