English
Related papers

Related papers: Estimating prediction error for complex samples

200 papers

Distributed systems have been widely used in practice to accomplish data analysis tasks of huge scales. In this work, we target on the estimation problem of generalized linear models on a distributed system with nonrandomly distributed…

Methodology · Statistics 2020-04-07 Feifei Wang , Danyang Huang , Yingqiu Zhu , Hansheng Wang

Covariate adjustment is a ubiquitous method used to estimate the average treatment effect (ATE) from observational data. Assuming a known graphical structure of the data generating model, recent results give graphical criteria for optimal…

Statistics Theory · Mathematics 2025-12-08 Alexander Mangulad Christgau , Anton Rask Lundborg , Niels Richard Hansen

Dealing with biased data samples is a common task across many statistical fields. In survey sampling, bias often occurs due to unrepresentative samples. In causal studies with observational data, the treated versus untreated group…

Computation · Statistics 2019-07-29 Xiaojing Wang , Jingang Miao , Yunting Sun

Uncertainty in probabilistic classifiers predictions is a key concern when models are used to support human decision making, in broader probabilistic pipelines or when sensitive automatic decisions have to be taken. Studies have shown that…

Machine Learning · Computer Science 2021-09-09 Nicolas Posocco , Antoine Bonnefoy

Many proposals have emerged as alternatives to the Heckman selection model, mainly to address the non-robustness of its normal assumption. The 2001 Medical Expenditure Panel Survey data is often used to illustrate this non-robustness of the…

Methodology · Statistics 2021-04-02 Fernando de S. Bastos , Wagner Barreto-Souza , Marc G. Genton

This paper investigates estimation and inference for average treatment effects in completely randomized experiments when researchers observe potentially many covariates. Within Neyman's (1923) design-based framework, allowing the number of…

Econometrics · Economics 2025-11-20 Harold D Chiang , Yukitoshi Matsushita , Taisuke Otsu

The increasing availability of individual-level data has led to numerous applications of individualized (or personalized) treatment rules (ITRs). Policy makers often wish to empirically evaluate ITRs and compare their relative performance…

Applications · Statistics 2021-05-06 Kosuke Imai , Michael Lingzhi Li

This paper presents an inference method for the local average treatment effect (LATE) in the presence of high-dimensional covariates, regardless of the strength of identification. We propose an orthogonalized Anderson-Rubin test statistic…

Econometrics · Economics 2025-11-11 Yukun Ma

Higher-Order Influence Functions (HOIF), developed in a series of papers over the past twenty years, are a fundamental theoretical device for constructing rate-optimal causal-effect estimators from observational studies. However, the value…

Methodology · Statistics 2025-11-19 Sihui Zhao , Xinbo Wang , Lin Liu , Xin Zhang

Estimating predictive uncertainty is crucial for many computer vision tasks, from image classification to autonomous driving systems. Hamiltonian Monte Carlo (HMC) is an sampling method for performing Bayesian inference. On the other hand,…

Machine Learning · Computer Science 2019-07-03 Diego Vergara , Sergio Hernández , Matias Valdenegro-Toro , Felipe Jorquera

We consider inference from non-random samples in data-rich settings where high-dimensional auxiliary information is available both in the sample and the target population, with survey inference being a special case. We propose a regularized…

Methodology · Statistics 2021-04-13 Yutao Liu , Andrew Gelman , Qixuan Chen

Recently, Efron and Tibshirani (Annals of Statistics, 1996) proposed a semiparametric density estimator, which works by multiplying an initial kernel type estimate with a parametric exponential type correction factor, chosen so as to match…

Statistics Theory · Mathematics 2026-03-17 Nils Lid Hjort

We consider the problem of estimating the average treatment effect (ATE) in a semi-supervised learning setting, where a very small proportion of the entire set of observations are labeled with the true outcome but features predictive of the…

Methodology · Statistics 2020-10-27 David Cheng , Ashwin Ananthakrishnan , Tianxi Cai

Non-probability samples become increasingly popular in survey statistics but may suffer from selection biases that limit the generalizability of results to the target population. We consider integrating a non-probability sample with a…

Methodology · Statistics 2019-08-26 Shu Yang , Jae Kwang Kim , Rui Song

Statisticians often face the choice between using probability models or a paradigm defined by minimising a loss function. Both approaches are useful and, if the loss can be re-cast into a proper probability model, there are many tools to…

Methodology · Statistics 2022-03-29 Jack Jewson , David Rossell

Model-assisted estimation with complex survey data is an important practical problem in survey sampling. When there are many auxiliary variables, selecting significant variables associated with the study variable would be necessary to…

Methodology · Statistics 2020-04-01 Shonosuke Sugasawa , Jae Kwang Kim

In order to estimate the population mean in the presence of both non-response and measurement errors that are uncorrelated, the paper presents some novel estimators employing ranked set sampling by utilizing auxiliary information.Up to the…

Methodology · Statistics 2023-11-06 Rajesh Singh , Anamika Kumari

Generalizing causal estimates in randomized experiments to a broader target population is essential for guiding decisions by policymakers and practitioners in the social and biomedical sciences. While recent papers developed various…

Methodology · Statistics 2021-11-03 Melody Huang , Naoki Egami , Erin Hartman , Luke Miratrix

This paper develops a variance estimation framework for matching estimators that enables valid population inference for treatment effects. We provide theoretical analysis of a variance estimator that addresses key limitations in the…

Methodology · Statistics 2025-06-16 Xiang Meng , Aaron Smith , Luke Miratrix

We propose a doubly robust estimator for the average treatment effect in high dimensional low sample size observational studies, where contamination and model misspecification pose serious inferential challenges. The estimator combines…

Methodology · Statistics 2025-11-04 Byeonghee Lee , Sangwook Kang , Ju-Hyun Park , Saebom Jeon , Joonsung Kang