English
Related papers

Related papers: What Estimators Are Unbiased For Linear Models?

200 papers

We consider large non-Hermitian random matrices $X$ with complex, independent, identically distributed centred entries and show that the linear statistics of their eigenvalues are asymptotically Gaussian for test functions having…

Probability · Mathematics 2023-10-16 Giorgio Cipolloni , László Erdős , Dominik Schröder

Nonlinear panel data models with fixed individual effects provide an important set of tools for describing microeconometric data. In a large class of such models (including probit, proportional hazard and quantile regression to name just a…

Econometrics · Economics 2020-02-07 Antonio F. Galvao , Jiaying Gu , Stanislav Volgushev

Efficient estimation under bias sampling, censoring or truncation is a difficult question which has been partially answered and the usual estimators are not always consistent. Several biased designs are considered for models with variables…

Statistics Theory · Mathematics 2007-10-22 Odile Pons

In this paper, we consider the usual linear regression model in the case where the error process is assumed strictly stationary. We use a result from Hannan, who proved a Central Limit Theorem for the usual least squares estimator under…

Statistics Theory · Mathematics 2019-06-18 Emmanuel Caron , Sophie Dede

Inferring causal relationships or related associations from observational data can be invalidated by the existence of hidden confounding. We focus on a high-dimensional linear regression setting, where the measured covariates are affected…

Methodology · Statistics 2021-07-22 Zijian Guo , Domagoj Ćevid , Peter Bühlmann

Kalisch and B\"{u}hlmann (2007) showed that for linear Gaussian models, under the Causal Markov Assumption, the Strong Causal Faithfulness Assumption, and the assumption of causal sufficiency, the PC algorithm is a uniformly consistent…

Machine Learning · Statistics 2021-08-03 Shuyan Wang , Peter Spirtes

A Bayes factor is proposed for testing whether the effect of a key predictor variable on the dependent variable is linear or nonlinear, possibly while controlling for certain covariates. The test can be used (i) when one is interested in…

Methodology · Statistics 2021-09-16 Joris Mulder

Regression models that ignore measurement error in predictors may produce highly biased estimates leading to erroneous inferences. It is well known that it is extremely difficult to take measurement error into account in Gaussian…

Methodology · Statistics 2023-02-03 Mohammad W. Hattab , David Ruppert

In this article, we consider computing expectations w.r.t. probability measures which are subject to discretization error. Examples include partially observed diffusion processes or inverse problems, where one may have to discretize time…

Computation · Statistics 2021-02-25 Jeremy Heng , Ajay Jasra , Kody J. H. Law , Alexander Tarakanov

We present multivariate unbiased estimators for second, third, and fourth order cumulants $C_2(x,y)$, $C_3(x,y,z)$, and $C_4(x,y,z,w)$. Many relevant new estimators are derived for cases where some variables are average-free or pairs of…

Statistics Theory · Mathematics 2019-04-30 Fabian Schefczik , Daniel Hägele

Asymptotically unbiased priors, introduced by Hartigan (1965), are designed to achieve second-order unbiasedness of Bayes estimators. This paper extends Hartigan's framework to non-i.i.d. models by deriving a system of partial differential…

Statistics Theory · Mathematics 2026-01-15 Mana Sakai , Takeru Matsuda , Tatsuya Kubokawa

We consider the problem of efficient statistical inference for comparing two regression curves estimated from two samples of dependent measurements. Based on a representation of the best pair of linear unbiased estimators in continuous time…

Methodology · Statistics 2016-01-29 Holger Dette , Kirsten Schorning , Maria Konstantinou

Discrimination measures such as the concordance index and the cumulative-dynamic time-dependent area under the ROC-curve (AUC) are widely used in the medical literature for evaluating the predictive accuracy of a scoring rule which relates…

Methodology · Statistics 2025-08-12 Marie Skov Breum , Torben Martinussen

In this work we consider the unbiased estimation of expectations w.r.t.~probability measures that have non-negative Lebesgue density, and which are known point-wise up-to a normalizing constant. We focus upon developing an unbiased method…

Computation · Statistics 2023-08-17 Hamza Ruzayqat , Neil K. Chada , Ajay Jasra

A simple characterization of uniformly minimum variance unbiased estimators (UMVUEs) is provided (in the case when the sample space is finite) in terms of a linear independence condition on the likelihood functions corresponding to the…

Statistics Theory · Mathematics 2015-09-15 Iosif Pinelis

In P\"otscher and Preinerstorfer (2022) and in the abridged version P\"otscher and Preinerstorfer (2024, published in Econometrica) we have tried to clear up the confusion introduced in Hansen (2022a) and in the earlier versions Hansen…

Econometrics · Economics 2024-06-10 Benedikt M. Pötscher

In high-dimensional statistical inference in which the number of parameters to be estimated is larger than that of the holding data, regularized linear estimation techniques are widely used. These techniques have, however, some drawbacks.…

Methodology · Statistics 2025-08-06 Takashi Takahashi , Yoshiyuki Kabashima

Univariate and multivariate general linear regression models, subject to linear inequality constraints, arise in many scientific applications. The linear inequality restrictions on model parameters are often available from phenomenological…

Methodology · Statistics 2021-12-07 Solmaz Seifollahi , Kaniav Kamary , Hossein Bevrani

This paper derives closed-form unbiased estimators of central moments in multilevel random-effects models with unbalanced group sizes. In a two-level model, we provide unbiased estimators for the second, third, and fourth central moments…

Econometrics · Economics 2026-04-01 Dan Ben-Moshe , David Genesove

We provide a unified approach to a method of estimation of the regression parameter in balanced linear models with a structured covariance matrix that combines a high breakdown point and bounded influence with high asymptotic efficiency at…

Statistics Theory · Mathematics 2023-03-22 Hendrik Paul Lopuhaä