English
Related papers

Related papers: Label Shift Estimators for Non-Ignorable Missing D…

200 papers

When data are incomplete, a random vector Y for the data process together with a binary random vector R for the process that causes missing data, are modelled jointly. We review conditions under which R can be ignored for drawing likelihood…

Methodology · Statistics 2019-04-01 John C Galati

Large-scale population-level datasets, such as the UK Biobank and the All of Us Research Program, often lack covariates needed for a specific analysis, such as genetic or lifestyle measures, while related studies measure them. This creates…

Methodology · Statistics 2026-05-07 Huali Zhao , Tianying Wang

This paper proposes a general multiple imputation approach for analyzing large-scale data with missing values. An imputation model is derived from a joint distribution induced by a latent variable model, which can flexibly capture…

Methodology · Statistics 2025-09-26 Siliang Zhang , Yunxiao Chen , Jouni Kuha

The assumption that response and predictor belong to the same statistical unit may be violated in practice. Unbiased estimation and recovery of true label ordering based on unlabeled data are challenging tasks and have attracted increasing…

Methodology · Statistics 2022-06-24 Guanhua Fang , Ping Li

Doubly protected estimators are widely used for estimating the population mean of an outcome Y from a sample where the response is missing in some individuals. To compensate for the missing responses, a vector X of covariates is observed at…

Methodology · Statistics 2017-11-07 Julieta Molina , Mariela Sued , Marina Valdora , Víctor Yohai

Complete randomization allows for consistent estimation of the average treatment effect based on the difference in means of the outcomes without strong modeling assumptions on the outcome-generating process. Appropriate use of the…

Methodology · Statistics 2021-08-03 Anqi Zhao , Peng Ding

In this paper, we propose an empirical likelihood-based weighted estimator of regression parameter in quantile regression model with nonignorable missing covariates. The proposed estimator is computationally simple and achieves…

Methodology · Statistics 2017-10-10 Xiaohui Yuan , Xiaogang Dong

Advancements in data collection techniques and the heterogeneity of data resources can yield high percentages of missing observations on variables, such as block-wise missing data. Under missing-data scenarios, traditional methods such as…

Methodology · Statistics 2022-05-17 Wei Lan , Xuerong Chen , Tao Zou , Chih-Ling Tsai

We present an approach to inform decisions about nonresponse follow-up sampling. The basic idea is (i) to create completed samples by imputing nonrespondents' data under various assumptions about the nonresponse mechanisms, (ii) take…

Methodology · Statistics 2022-09-16 Thais Paiva , Jerry Reiter

We consider identification and inference about mean functionals of observed covariates and an outcome variable subject to nonignorable missingness. By leveraging a shadow variable, we establish a necessary and sufficient condition for…

Statistics Theory · Mathematics 2022-04-07 Wei Li , Wang Miao , Eric Tchetgen Tchetgen

We study the identification and estimation of statistical functionals of multivariate data missing non-monotonically and not-at-random, taking a semiparametric approach. Specifically, we assume that the missingness mechanism satisfies what…

Methodology · Statistics 2022-12-26 Daniel Malinsky , Ilya Shpitser , Eric J Tchetgen Tchetgen

We investigate model based classification with partially labelled training data. In many biostatistical applications, labels are manually assigned by experts, who may leave some observations unlabelled due to class uncertainty. We analyse…

Methodology · Statistics 2019-04-08 Daniel Ahfock , Geoffrey J. McLachlan

We consider a semi-supervised classification problem with non-stationary label-shift in which we observe a labelled data set followed by a sequence of unlabelled covariate vectors in which the marginal probabilities of the class labels may…

Statistics Theory · Mathematics 2024-05-29 Henry W J Reeve

We introduce a self-censoring model for multivariate nonignorable nonmonotone missing data, where the missingness process of each outcome is affected by its own value and is associated with missingness indicators of other outcomes, while…

Methodology · Statistics 2022-10-03 Yilin Li , Wang Miao , Ilya Shpitser , Eric J. Tchetgen Tchetgen

Missing data occur frequently in empirical studies in health and social sciences, often compromising our ability to make accurate inferences. An outcome is said to be missing not at random (MNAR) if, conditional on the observed variables,…

Methodology · Statistics 2019-01-23 BaoLuo Sun , Lan Liu , Wang Miao , Kathleen Wirth , James Robins , Eric Tchetgen Tchetgen

We outline a framework for multiple imputation of nonignorable item nonresponse when the marginal distributions of some of the variables with missing values are known. In particular, our framework ensures that (i) the completed datasets…

Methodology · Statistics 2020-11-12 Olanrewaju Akande , Jerome P. Reiter

We present an approach for modeling and imputation of nonignorable missing data. Our approach uses Bayesian data integration to combine (1) a Gaussian copula model for all study variables and missingness indicators, which allows arbitrary…

Methodology · Statistics 2024-11-19 Joseph Feldman , Jerome P. Reiter , Daniel R. Kowal

Current methods for covariate-shift adaptation use unlabelled data to compute importance weights or domain-invariant features, while the final model is trained on labelled data only. Here, we consider a particular case of covariate shift…

Machine Learning · Statistics 2019-02-28 Julius von Kügelgen , Alexander Mey , Marco Loog

This paper develops the inferential theory for latent factor models estimated from large dimensional panel data with missing observations. We propose an easy-to-use all-purpose estimator for a latent factor model by applying principal…

Econometrics · Economics 2022-01-11 Ruoxuan Xiong , Markus Pelger

Covariate-adaptive randomization is widely used in clinical trials to balance prognostic factors, and regression adjustments are often adopted to further enhance the estimation and inference efficiency. In practice, the covariates may…

Methodology · Statistics 2025-08-15 Wanjia Fu , Yingying Ma , Hanzhong Liu