English
Related papers

Related papers: Optimal Shrinkage Estimation of Fixed Effects in L…

200 papers

In regression models involving economic variables such as income, log transformation is typically taken to achieve approximate normality and stabilize the variance. However, often the interest is predicting individual values or means of the…

Statistics Theory · Mathematics 2016-10-25 Nirian Martin , Isabel Molina

In all areas of human knowledge, datasets are increasing in both size and complexity, creating the need for richer statistical models. This trend is also true for economic data, where high-dimensional and nonlinear/nonparametric inference…

Econometrics · Economics 2021-12-23 Dimitris Korobilis , Kenichi Shimizu

We propose employing a high-dimensional generalized method of moments (GMM) estimator, regularized for dimension reduction and subsequently debiased to correct for shrinkage bias (referred to as a debiased-regularized estimator), for…

Econometrics · Economics 2025-07-03 Victor Chernozhukov , Chen Huang , Weining Wang

Linear mixed models are widely used to analyze non-independent data, but inference for fixed effects can be unreliable under misspecification of the random-effects distribution, inaccurate Fisher information estimation, or convergence…

Methodology · Statistics 2026-05-01 Angela Andreella , Livio Finos

We consider the problem of constructing optimal designs for population pharmacokinetics which use random effect models. It is common practice in the design of experiments in such studies to assume uncorrelated errors for each subject. In…

Applications · Statistics 2010-11-16 Holger Dette , Andrey Pepelyshev , Tim Holland-Letz

One of the goals in scaling sequential machine learning methods pertains to dealing with high-dimensional data spaces. A key related challenge is that many methods heavily depend on obtaining the inverse covariance matrix of the data. It is…

Computation · Statistics 2017-07-28 Tomer Lancewicki

This paper considers the regularized Tyler's scatter estimator for elliptical distributions, which has received considerable attention recently. Various types of shrinkage Tyler's estimators have been proposed in the literature and proved…

Methodology · Statistics 2015-06-22 Ying Sun , Prabhu Babu , Daniel P. Palomar

For the problem of high-dimensional sparse linear regression, it is known that an $\ell_0$-based estimator can achieve a $1/n$ "fast" rate on the prediction error without any conditions on the design matrix, whereas in absence of…

Statistics Theory · Mathematics 2015-12-01 Yuchen Zhang , Martin J. Wainwright , Michael I. Jordan

Comparison data arises in many important contexts, e.g. shopping, web clicks, or sports competitions. Typically we are given a dataset of comparisons and wish to train a model to make predictions about the outcome of unseen comparisons. In…

Machine Learning · Statistics 2018-07-25 Stephen Ragain , Alexander Peysakhovich , Johan Ugander

When fitting generalized linear mixed models (GLMMs), one important decision to make relates to the choice of the random effects distribution. As the random effects are unobserved, misspecification of this distribution is a real…

Methodology · Statistics 2024-12-02 Quan Vu , Francis K. C. Hui , Samuel Muller , A. H. Welsh

It is important to estimate the local average treatment effect (LATE) when compliance with a treatment assignment is incomplete. The previously proposed methods for LATE estimation required all relevant variables to be jointly observed in a…

Machine Learning · Statistics 2022-03-22 Kazuhiko Shinoda , Takahiro Hoshino

Regularization in fitting regression models has been a highly active topic of research in the past few decades, but most of the existing methods are designed for particular situations, e.g. for the case of a sparse coefficient vector. We…

Methodology · Statistics 2025-05-15 Asaf Weinstein , Jonas Wallin , Daniel Yekutieli , Małgorzata Bogdan

Shrinkage can effectively improve the condition number and accuracy of covariance matrix estimation, especially for low-sample-support applications with the number of training samples smaller than the dimensionality. This paper investigates…

Information Theory · Computer Science 2018-10-22 Jun Tong , Rui Hu , Jiangtao Xi , Zhitao Xiao , Qinghua Guo , Yanguang Yu

In this paper we investigate the performance of periodogram based estimators of the spectral density matrix of possibly high-dimensional time series. We suggest and study shrinkage as a remedy against numerical instabilities due to…

Statistics Theory · Mathematics 2008-08-13 Hilmar Böhm , Rainer von Sachs

Variable selection naturally arises as a useful subject when faced with data with massive predictor space. In addition to the massive dimensionality, the data may be characterized by intra-subject correlation, and cure fraction, which are…

Methodology · Statistics 2025-12-24 Richard Tawiah , Shu Kay Ng , Geoffrey J. McLachlan

Portfolio optimization requires sophisticated covariance estimators that are able to filter out estimation noise. Non-linear shrinkage is a popular estimator based on how the Oracle eigenvalues can be computed using only data from the…

Portfolio Management · Quantitative Finance 2022-10-14 Christian Bongiorno , Damien Challet

This paper considers the problem of estimating a high-dimensional (HD) covariance matrix when the sample size is smaller, or not much larger, than the dimensionality of the data, which could potentially be very large. We develop a…

Methodology · Statistics 2019-05-22 Esa Ollila , Elias Raninen

The estimation of the mean matrix of the multivariate normal distribution is addressed in the high dimensional setting. Efron-Morris-type linear shrinkage estimators based on ridge estimators for the precision matrix instead of the…

Statistics Theory · Mathematics 2020-07-07 Ryota Yuasa , Tatsuya Kubokawa

The tuning parameter selection strategy for penalized estimation is crucial to identify a model that is both interpretable and predictive. However, popular strategies (e.g., minimizing average squared prediction error via cross-validation)…

Methodology · Statistics 2022-11-10 Julia Holter , Jonathan Stallrich

We address a classical problem in statistics: adding two-way interaction terms to a regression model. As the covariate dimension increases quadratically, we develop an estimator that adapts well to this increase, while providing accurate…

Methodology · Statistics 2023-09-26 Mark A. van de Wiel , Matteo Amestoy , Jeroen Hoogland