English
Related papers

Related papers: Unbiased Estimation Equation under $f$-Separable B…

200 papers

Value function learning plays a central role in many state-of-the-art reinforcement-learning algorithms. Many popular algorithms like Q-learning do not optimize any objective function, but are fixed-point iterations of some variant of…

Machine Learning · Computer Science 2020-01-10 Yihao Feng , Lihong Li , Qiang Liu

In this paper several related estimation problems are addressed from a Bayesian point of view and optimal estimators are obtained for each of them when some natural loss functions are considered. Namely, we are interested in estimating a…

Statistics Theory · Mathematics 2021-10-27 A. G. Nogales

This paper introduces a general framework for estimating variance components in the linear mixed models via general unbiased estimating equations, which include some well-used estimators such as the restricted maximum likelihood estimator.…

Methodology · Statistics 2021-05-18 Tatsuya Kubokawa , Shonosuke Sugasawa , Hiromasa Tamae , Sanjay Chaudhuri

The exact expression is derived for the expected value, $< {p_i}> $, for the parameter for any bin $i$ of a histogram following a multinomial distribution derived by sorting $N$ observations into bins of $B$ classes, if $n_i$ of the…

Statistics Theory · Mathematics 2013-03-18 Jonathan M. Friedman

The ill-posedness of the inverse problem of recovering a regression function in a nonparametric instrumental variable model leads to estimators that may suffer from a very slow, logarithmic rate of convergence. In this paper, we show that…

Applications · Statistics 2017-09-27 Denis Chetverikov , Daniel Wilhelm

We analyze fully implicit and linearly implicit backward difference formula (BDF) methods for quasilinear parabolic equations, without making any assumptions on the growth or decay of the coefficient functions. We combine maximal parabolic…

Numerical Analysis · Mathematics 2016-06-14 Georgios Akrivis , Buyang Li , Christian Lubich

We study the non-parametric estimation of an unknown density f with support on R+^d based on an i.i.d. sample with multiplicative measurement errors. The proposed fully-data driven procedure is based on the estimation of the Mellin…

Statistics Theory · Mathematics 2022-03-03 Sergio Brenner Miguel

We develop the first general-purpose estimator for infinite-horizon dynamic discrete choice models whose estimation problem, after pre-computation, is unencumbered by large systems of linear equations -- either imposed as constraints, or…

Econometrics · Economics 2026-04-14 Ecenur Oguz , Robert L. Bray

In an influential critique of empirical practice, Freedman (2008) showed that the linear regression estimator was biased for the analysis of randomized controlled trials under the randomization model. Under Freedman's assumptions, we derive…

Methodology · Statistics 2021-10-26 Haoge Chang , Joel Middleton , P. M. Aronow

In this paper, we explicitly derive unbiased estimators for various functions of the rate parameter of the exponential distribution in the absence of a location parameter, including powers of the rate parameter, the $q$th quantile, the…

Statistics Theory · Mathematics 2025-07-28 Roberto Vila , Eduardo Yoshio Nakano

We develop a Bayesian inference method for diffusions observed discretely and with noise, which is free of discretisation bias. Unlike existing unbiased inference methods, our method does not rely on exact simulation techniques. Instead,…

Methodology · Statistics 2021-03-10 Neil K. Chada , Jordan Franks , Ajay Jasra , Kody J. H. Law , Matti Vihola

We introduce a novel Bayesian estimator for the class proportion in an unlabeled dataset, based on the targeted learning framework. Our procedure requires the specification of a prior (and outputs a posterior) only for the target of…

Methodology · Statistics 2019-11-26 Iván Díaz , Oleksander Savenkov , Hooman Kamel

Estimation and inference on causal parameters is typically reduced to a generalized method of moments problem, which involves auxiliary functions that correspond to solutions to a regression or classification problem. Recent line of work on…

Econometrics · Economics 2022-11-16 Qizhao Chen , Vasilis Syrgkanis , Morgane Austern

Infinite-order U-statistics (IOUS) has been used extensively on subbagging ensemble learning algorithms such as random forests to quantify its uncertainty. While normality results of IOUS have been studied extensively, its variance…

Machine Learning · Statistics 2023-02-16 Tianning Xu , Ruoqing Zhu , Xiaofeng Shao

Estimation of a deterministic quantity observed in non-Gaussian additive noise is explored via order statistics approach. More specifically, we study the estimation problem when measurement noises either have positive supports or follow a…

Signal Processing · Electrical Eng. & Systems 2020-07-15 Kamiar Radnosrati , Gustaf Hendeby , Fredrik Gustafsson

Estimating the ratio of two probability densities from a finite number of observations is a central machine learning problem. A common approach is to construct estimators using binary classifiers that distinguish observations from the two…

Machine Learning · Computer Science 2025-01-28 Werner Zellinger

This paper considers fixed effects estimation and inference in linear and nonlinear panel data models with random coefficients and endogenous regressors. The quantities of interest -- means, variances, and other moments of the random…

Methodology · Statistics 2018-01-16 Ivan Fernandez-Val , Joonhwah Lee

Assuming squared error loss, we show that finding unbiased estimators and Bayes estimators can be treated as using a pair of linear operators that operate between two Hilbert spaces. We note that these integral operators are adjoint and…

Statistics Theory · Mathematics 2015-12-14 Siamak Noorbaloochi , Glen Meeden

Many real-world optimization problems contain parameters that are unknown before deployment time, either due to stochasticity or to lack of information (e.g., demand or travel times in delivery problems). A common strategy in such cases is…

Learning models that can handle distribution shifts is a key challenge in domain generalization. Invariance learning, an approach that focuses on identifying features invariant across environments, improves model generalization by capturing…

Machine Learning · Statistics 2026-05-11 Yiran Jia , Jelena Bradic