English
Related papers

Related papers: Estimating prediction error for complex samples

200 papers

Causal inference with observational studies often relies on the assumptions of unconfoundedness and overlap of covariate distributions in different treatment groups. The overlap assumption is violated when some units have propensity scores…

Methodology · Statistics 2022-07-19 Shu Yang , Peng Ding

We study the benign overfitting theory in the prediction of the conditional average treatment effect (CATE), with linear regression models. As the development of machine learning for causal inference, a wide range of large-scale models for…

Econometrics · Economics 2022-02-17 Masahiro Kato , Masaaki Imaizumi

Covariance matrix estimation is a fundamental statistical task in many applications, but the sample covariance matrix is sub-optimal when the sample size is comparable to or less than the number of features. Such high-dimensional settings…

Methodology · Statistics 2022-06-06 Huiqin Xin , Sihai Dave Zhao

Bayesian graphical models have been shown to be a powerful tool for discovering uncertainty and causal structure from real-world data in many application fields. Current inference methods primarily follow different kinds of trade-offs…

Machine Learning · Computer Science 2018-02-20 Daniel Rugeles , Zhen Hai , Gao Cong , Manoranjan Dash

Conformal inference is a statistical method used to construct prediction sets for point predictors, providing reliable uncertainty quantification with probability guarantees. This method utilizes historical labeled data to estimate the…

Machine Learning · Computer Science 2024-11-05 Xiaoyi Su , Zhixin Zhou , Rui Luo

In this paper, we introduce a class of improved estimators for the mean parameter matrix of a multivariate normal distribution with an unknown variance-covariance matrix. In particular, the main results of [D.Ch\'etelat and M. T.…

Statistics Theory · Mathematics 2024-06-25 Arash A. Foroushani , Severien Nkurunziza

Reward models trained on aggregate preferences often fail to capture individual users' values, but existing adaptation methods such as fine-tuning or long-context conditioning are too costly for real-time personalization. We propose…

Machine Learning · Computer Science 2026-04-21 Yoonho Lee , Jonathan Williams , Henrik Marklund , Archit Sharma , Eric Mitchell , Anikait Singh , Chelsea Finn

We propose Horvitz-Thompson-like and Hajek-like estimators of the total and mean of the values of a variable of interest associated with the elements of a hard-to-reach population sampled by the variant of link-tracing sampling proposed by…

Methodology · Statistics 2020-05-25 Martín Humberto Félix Medina

In practice, there often exist unobserved variables, also termed hidden variables, associated with both the response and covariates. Existing works in the literature mostly focus on linear regression with hidden variables. However, when the…

Methodology · Statistics 2025-09-03 Inbeom Lee , Yang Ning

Individualized treatment rules aim to identify if, when, which, and to whom treatment should be applied. A globally aging population, rising healthcare costs, and increased access to patient-level data have created an urgent need for…

Methodology · Statistics 2019-01-04 Ying-Qi Zhao , Eric B. Laber , Yang Ning , Sumona Saha , Bruce Sands

Random samples are lossy summaries which allow queries posed over the data to be approximated by applying an appropriate estimator to the sample. The effectiveness of sampling, however, hinges on estimator selection. The choice of…

Statistics Theory · Mathematics 2014-04-10 Edith Cohen

We consider the class of inverse probability weight (IPW) estimators, including the popular Horvitz-Thompson and Hajek estimators used routinely in survey sampling, causal inference and evidence estimation for Bayesian computation. We focus…

Methodology · Statistics 2025-04-15 Jyotishka Datta , Nicholas Polson

We observe a random measure $N$ and aim at estimating its intensity $s$. This statistical framework allows to deal simultaneously with the problems of estimating a density, the marginals of a multivariate distribution, the mean of a random…

Statistics Theory · Mathematics 2009-05-12 Yannick Baraud

We study average treatment effect (ATE) estimation under complete randomization with many covariates in a design-based, finite-population framework. In randomized experiments, regression adjustment can improve precision of estimators using…

Statistics Theory · Mathematics 2025-11-12 Dogyoon Song

With the recently increased interest in probabilistic models, the efficiency of an underlying sampler becomes a crucial consideration. Hamiltonian Monte Carlo (HMC) is one popular option for models of this kind. Performance of the method,…

Unbiased assessment of the predictivity of models learnt by supervised machine-learning methods requires knowledge of the learned function over a reserved test set (not used by the learning algorithm). The quality of the assessment depends,…

Statistics Theory · Mathematics 2022-07-11 Elias Fekhari , Bertrand Iooss , Joseph Muré , Luc Pronzato , Maria-João Rendas

One of the most significant challenges in Conditional Average Treatment Effect (CATE) estimation is the statistical discrepancy between distinct treatment groups. To address this issue, we propose a model-agnostic data augmentation method…

Machine Learning · Computer Science 2025-06-17 Ahmed Aloui , Juncheng Dong , Cat P. Le , Vahid Tarokh

For fixed size sampling designs with high entropy it is well known that the variance of the Horvitz-Thompson estimator can be approximated by the H\'ajek formula. The interest of this asymptotic variance approximation is that it only…

Statistics Theory · Mathematics 2013-07-01 Hervé Cardot , Camelia Goga , Pauline Lardin

Efficient Bayesian model selection relies on the model evidence or marginal likelihood, whose computation often requires evaluating an intractable integral. The harmonic mean estimator (HME) has long been a standard method of approximating…

Computation · Statistics 2025-12-23 Dana Naderi , Christian P Robert , Kaniav Kamary , Darren Wraith

A central goal of causal inference is to detect and estimate the treatment effects of a given treatment or intervention on an outcome variable of interest, where a member known as the heterogeneous treatment effect (HTE) is of growing…

Statistics Theory · Mathematics 2020-10-27 Zijun Gao , Yanjun Han