English
Related papers

Related papers: Building Unbiased Estimators from Non-Gaussian Lik…

200 papers

We consider the linear regression model with observation error in the design. In this setting, we allow the number of covariates to be much larger than the sample size. Several new estimation methods have been recently introduced for this…

Statistics Theory · Mathematics 2016-07-05 Alexandre Belloni , Mathieu Rosenbaum , Alexandre Tsybakov

We combine the unbiased estimators in Rhee and Glynn (Operations Research: 63(5), 1026-1043, 2015) and the Heston model with stochastic interest rates. Specifically, we first develop a semi-exact log-Euler scheme for the Heston model with…

Computational Finance · Quantitative Finance 2025-11-14 Chao Zheng , Jiangtao Pan

We consider unbiased estimation of a sparse nonrandom vector corrupted by additive white Gaussian noise. We show that while there are infinitely many unbiased estimators for this problem, none of them has uniformly minimum variance.…

Statistics Theory · Mathematics 2010-06-02 Alexander Jung , Zvika Ben-Haim , Franz Hlawatsch , Yonina C. Eldar

In empirical research, when we have multiple estimators for the same parameter of interest, a central question arises: how do we combine unbiased but less precise estimators with biased but more precise ones to improve the inference? Under…

Methodology · Statistics 2026-02-19 Zhexiao Lin , Peter J. Bickel , Peng Ding

In this paper we have proposed an almost unbiased estimator using known value of some population parameter(s) with known population proportion of an auxiliary variable. A class of estimators is defined which includes [1], [2] and [3]…

Applications · Statistics 2014-06-04 Sachin Malik , Rajesh Singh , SB Gupta

An effective two-stage method for an estimation of parameters of the linear regression is considered. For this purpose we introduce a certain quasi-estimator that, in contrast to usual estimator, produces two alternative estimates. It is…

Statistics Theory · Mathematics 2010-10-06 Anatoly Gordinsky

Noisy matrix completion aims at estimating a low-rank matrix given only partial and corrupted entries. Despite substantial progress in designing efficient estimation algorithms, it remains largely unclear how to assess the uncertainty of…

Machine Learning · Statistics 2019-11-15 Yuxin Chen , Jianqing Fan , Cong Ma , Yuling Yan

This note studies a method for the efficient estimation of a finite number of unknown parameters from linear equations, which are perturbed by Gaussian noise. In case the unknown parameters have only few nonzero entries, the proposed…

Systems and Control · Computer Science 2014-05-27 Liang Dai , Kristiaan Pelckmans

This paper presents a new and efficient method for the construction of optimal designs for regression models with dependent error processes. In contrast to most of the work in this field, which starts with a model for a finite number of…

Methodology · Statistics 2015-11-06 Holger Dette , Maria Konstantinou , Anatoly Zhigljavsky

For one-parameter continuous exponential families, we identify an unbiased estimator of the inverse of the natural parameter $\theta$ for cases where $\theta > 0$, extending an earlier result of \cite{voinov1985unbiased} applicable to a…

Statistics Theory · Mathematics 2025-07-25 Pankaj Bhagwat , Eric Marchand

In this paper, we develop {finite-time horizon} causal filters using the nonanticipative rate distortion theory. We apply the {developed} theory to {design optimal filters for} time-varying multidimensional Gauss-Markov processes, subject…

Information Theory · Computer Science 2017-02-13 Photios A. Stavrou , Themistoklis Charalambous , Charalambos D. Charalambous , Sergey Loyka

Estimating linear regression using least squares and reporting robust standard errors is very common in financial economics, and indeed, much of the social sciences and elsewhere. For thick tailed predictors under heteroskedasticity this…

Methodology · Statistics 2020-08-17 Neil Shephard

We extend the Bayesian model fitting shape measurement method presented in Miller et al. (2007) and use the method to estimate the shear from the Shear TEsting Programme simulations (STEP). The method uses a fast model fitting algorithm…

Astrophysics · Physics 2009-11-13 T. D. Kitching , L. Miller , C. E. Heymans , L. van Waerbeke , A. F. Heavens

We construct an unbiased estimator for function value evaluated at the solution of a partial differential equation with random coefficients. We show that the variance and expected computational cost of our estimator are finite and our…

Probability · Mathematics 2019-04-23 Jose Blanchet , Fengpei Li , Xiaoou Li

This paper proposes novel noise-free Bayesian optimization strategies that rely on a random exploration step to enhance the accuracy of Gaussian process surrogate models. The new algorithms retain the ease of implementation of the classical…

Machine Learning · Computer Science 2024-07-18 Hwanwoo Kim , Daniel Sanz-Alonso

A popular technique for selecting and tuning machine learning estimators is cross-validation. Cross-validation evaluates overall model fit, usually in terms of predictive accuracy. In causal inference, the optimal choice of estimator…

Methodology · Statistics 2021-07-07 Dominik Rothenhäusler

Standard practice obtains an unbiased variance estimator by dividing by $N-1$ rather than $N$. Yet if only half the data are used to compute the mean, dividing by $N$ can still yield an unbiased estimator. We show that an alternative mean…

Statistics Theory · Mathematics 2025-04-10 Dai Akita

Weak gravitational lensing analyses are fundamentally limited by the intrinsic, non-Gaussian distribution of galaxy shapes. We explore alternative statistics for samples of ellipticity measurements that are unbiased, efficient, and robust.…

Cosmology and Nongalactic Astrophysics · Physics 2018-01-31 Merijn Smit , Konrad Kuijken

The main goal in this paper is to propose a new method for deriving oracle inequalities related to the exponential weighting method. For the sake of simplicity we focus on recovering an unknown vector from noisy data with the help of a…

Statistics Theory · Mathematics 2012-11-20 Elena Chernousova , Yuri Golubev , Katerina Krymova

We consider minimization of a smooth nonconvex function with inexact oracle access to gradient and Hessian (without assuming access to the function value) to achieve approximate second-order optimality. A novel feature of our method is that…

Optimization and Control · Mathematics 2024-03-27 Shuyao Li , Stephen J. Wright