English
Related papers

Related papers: Unbiased variance reduction in randomized experime…

200 papers

Locally adapted parameterizations of a model (such as locally weighted regression) are expressive but often suffer from high variance. We describe an approach for reducing the variance, based on the idea of estimating simultaneously a…

Machine Learning · Computer Science 2012-07-03 Doina Precup , Philip Bachman

The state-of-the-art methods for estimating high-dimensional covariance matrices all shrink the eigenvalues of the sample covariance matrix towards a data-insensitive shrinkage target. The underlying shrinkage transformation is either…

Machine Learning · Statistics 2025-11-25 Man-Chung Yue , Yves Rychener , Daniel Kuhn , Viet Anh Nguyen

We consider the estimation problem in a regression setting where the outcome variable is subject to nonignorable missingness and identifiability is ensured by the shadow variable approach. We propose a versatile estimation procedure where…

Methodology · Statistics 2019-07-09 Jiwei Zhao , Yanyuan Ma

In the era of Model-as-a-Service, organizations increasingly rely on third-party AI models for rapid deployment. However, the dynamic nature of emerging AI applications, the continual introduction of new datasets, and the growing number of…

Machine Learning · Computer Science 2026-02-10 Zihan Zhu , Yanqiu Wu , Qiongkai Xu

This study introduces a debiasing method for regression estimators, including high-dimensional and nonparametric regression estimators. For example, nonparametric regression methods allow for the estimation of regression functions in a…

Machine Learning · Statistics 2024-11-27 Masahiro Kato

Monte Carlo estimation in plays a crucial role in stochastic reaction networks. However, reducing the statistical uncertainty of the corresponding estimators requires sampling a large number of trajectories. We propose control variates…

Methodology · Statistics 2021-10-19 Michael Backenköhler , Luca Bortolussi , Verena Wolf

We consider estimation and inference for a regression coefficient in panels with interactive fixed effects (i.e., with a factor structure). We demonstrate that existing estimators and confidence intervals (CIs) can be heavily biased and…

Econometrics · Economics 2025-05-13 Timothy B. Armstrong , Martin Weidner , Andrei Zeleneev

Variance estimation is important for statistical inference. It becomes non-trivial when observations are masked by serial dependence structures and time-varying mean structures. Existing methods either ignore or sub-optimally handle these…

Methodology · Statistics 2022-01-03 Kin Wai Chan

A bias-reduced estimator is proposed for the mean absolute deviation parameter of a median regression model. A workaround is devised for the lack of smoothness in the sense conventionally required in general bias-reduced estimation. A local…

Methodology · Statistics 2023-05-04 Michele Lambardi di San Miniato

We derive convenient uniform concentration bounds and finite sample multivariate normal approximation results for quadratic forms, then describe some applications involving variance components estimation in linear random-effects models.…

Statistics Theory · Mathematics 2015-09-16 Lee H. Dicker , Murat A. Erdogdu

In all applications in digital communications, it is crucial for an estimator to be unbiased. Although so-called soft feedback is widely employed in many different fields of engineering, typically the biased estimate is used. In this paper,…

Information Theory · Computer Science 2018-02-21 Susanne Sparrer , Robert F. H. Fischer

Managers, employers, policymakers, and others often seek to understand whether decisions are biased against certain groups. One popular analytic strategy is to estimate disparities after adjusting for observed covariates, typically with a…

Applications · Statistics 2024-01-29 Jongbin Jung , Sam Corbett-Davies , Johann D. Gaebler , Ravi Shroff , Sharad Goel

In most practical applications such as recommendation systems, display advertising, and so forth, the collected data often contains missing values and those missing values are generally missing-not-at-random, which deteriorates the…

Machine Learning · Computer Science 2024-05-27 Mingming Ha , Xuewen Tao , Wenfang Lin , Qionxu Ma , Wujiang Xu , Linxun Chen

We construct an unbiased estimator for function value evaluated at the solution of a partial differential equation with random coefficients. We show that the variance and expected computational cost of our estimator are finite and our…

Probability · Mathematics 2019-04-23 Jose Blanchet , Fengpei Li , Xiaoou Li

Cluster-randomized experiments are increasingly used to evaluate interventions in routine practice conditions, and researchers often adopt model-based methods with covariate adjustment in the statistical analyses. However, the validity of…

Methodology · Statistics 2023-12-08 Bingkai Wang , Chan Park , Dylan S. Small , Fan Li

This work is concerned with the estimation of multidimensional regression and the asymptotic behaviour of the test involved in selecting models. The main problem with such models is that we need to know the covariance matrix of the noise to…

Statistics Theory · Mathematics 2008-02-20 Joseph Rynkiewicz

Reinforcement learning methods for robotics are increasingly successful due to the constant development of better policy gradient techniques. A precise (low variance) and accurate (low bias) gradient estimator is crucial to face…

Machine Learning · Computer Science 2022-03-09 Joao Carvalho , Jan Peters

A new gradient-based adaptive sampling method is proposed for design of experiments applications which balances space filling, local refinement, and error minimization objectives while reducing reliance on delicate tuning parameters. High…

Methodology · Statistics 2024-05-09 Lucas Caparini , Gwynn J. Elfring , Mauricio Ponga

A procedure for asymptotic bias reduction of maximum likelihood estimates of generic estimands is developed. The estimator is realized as a plug-in estimator, where the parameter maximizes the penalized likelihood with a penalty function…

Statistics Theory · Mathematics 2024-03-26 Masayo Y. Hirose , Shuhei Mano

Exposure measurement error is a ubiquitous but often overlooked challenge in causal inference with observational data. Existing methods accounting for exposure measurement error largely rely on restrictive parametric assumptions, while…