English
Related papers

Related papers: Estimation beyond Missing (Completely) at Random

200 papers

Researchers regularly perform conditional prediction using imputed values of missing data. However, applications of imputation often lack a firm foundation in statistical theory. This paper originated when we were unable to find analysis…

Econometrics · Economics 2021-02-24 Charles F Manski , Michael Gmeiner , Anat Tamburc

We introduce a self-censoring model for multivariate nonignorable nonmonotone missing data, where the missingness process of each outcome is affected by its own value and is associated with missingness indicators of other outcomes, while…

Methodology · Statistics 2022-10-03 Yilin Li , Wang Miao , Ilya Shpitser , Eric J. Tchetgen Tchetgen

Missing values challenge data analysis because many supervised and unsupervised learning methods cannot be applied directly to incomplete data. Matrix completion based on low-rank assumptions are very powerful solution for dealing with…

Machine Learning · Statistics 2020-01-30 Aude Sportisse , Claire Boyer , Julie Josse

The presence of missing values makes supervised learning much more challenging. Indeed, previous work has shown that even when the response is a linear function of the complete data, the optimal predictor is a complex function of the…

Machine Learning · Computer Science 2020-11-05 Marine Le Morvan , Julie Josse , Thomas Moreau , Erwan Scornet , Gaël Varoquaux

This research deals with the estimation and imputation of missing data in longitudinal models with a Poisson response variable inflated with zeros. A methodology is proposed that is based on the use of maximum likelihood, assuming that data…

Methodology · Statistics 2024-09-18 D. S. Martinez-Lobo , O. O. Melo , N. A. Cruz

Efficient estimation methods for simultaneous autoregressive (SAR) models with missing data in the response variable have been well-explored in the literature. A common practice is to introduce measurement error into SAR models to separate…

Methodology · Statistics 2024-10-10 Anjana Wijayawardhana , Thomas Suesse , David Gunawan

The standard quantile regression model assumes a linear relationship at the quantile of interest and that all variables are observed. We relax these assumptions by considering a partial linear model while allowing for missing linear…

Methodology · Statistics 2016-06-07 Ben Sherwood

Randomization inference is a widely-used and appealing approach for analyzing treatment effects in randomized experiments, as it is finite-sample valid and does not require any distributional assumptions. However, naive application of…

Econometrics · Economics 2026-05-12 Xinran Li , Peizan Sheng , Zeyang Yu

We consider the problem of estimating the missing mass, partition function or evidence and its probability distribution in the case that for each sample point in the discrete sample space its (unnormalized) probability mass is revealed.…

Statistics Theory · Mathematics 2026-03-16 Bastiaan J. Braams

This paper considers binary and multilabel classification problems in a setting where labels are missing independently and with a known rate. Missing labels are a ubiquitous phenomenon in extreme multi-label classification (XMC) tasks, such…

Machine Learning · Computer Science 2021-09-24 Erik Schultheis , Rohit Babbar

We introduce a new method for estimating the mean of an outcome variable within groups when researchers only observe the average of the outcome and group indicators across a set of aggregation units, such as geographical areas. Existing…

Methodology · Statistics 2026-05-01 Cory McCartan , Shiro Kuriwaki

We describe the Bedside Patient Rescue (BPR) project, the goal of which is risk prediction of adverse events for non-ICU patients using ~200 variables (vitals, lab results, assessments, ...). There are several missing predictor values for…

Random effects model can account for the lack of fitting a regression model and increase precision of estimating area-level means. However, in case that the synthetic mean provides accurate estimates, the prior distribution may inflate an…

Methodology · Statistics 2016-12-05 Shonosuke Sugasawa , Tatsuya Kubokawa , Kota Ogasawara

We develop a general theory of omitted variable bias for a wide range of common causal parameters, including (but not limited to) averages of potential outcomes, average treatment effects, average causal derivatives, and policy effects from…

Econometrics · Economics 2024-05-28 Victor Chernozhukov , Carlos Cinelli , Whitney Newey , Amit Sharma , Vasilis Syrgkanis

We study the problem of conditional predictive inference on multiple outcomes missing at random (MAR) -- or equivalently, under covariate shift. While the weighted conformal prediction offers a tool for inference under covariate shift with…

Methodology · Statistics 2025-08-01 Yonghoon Lee , Edgar Dobriban , Eric Tchetgen Tchetgen

Envelope method was recently proposed as a method to reduce the dimension of responses in multivariate regressions. However, when there exists missing data, the envelope method using the complete case observations may lead to biased and…

Methodology · Statistics 2021-03-25 Linquan Ma , Lan Liu , Wei Yang

We consider learning methods based on the regularization of a convex empirical risk by a squared Hilbertian norm, a setting that includes linear predictors and non-linear predictors through positive-definite kernels. In order to go beyond…

Machine Learning · Computer Science 2019-06-19 Ulysse Marteau-Ferey , Dmitrii Ostrovskii , Francis Bach , Alessandro Rudi

In causality, estimating the effect of a treatment without confounding inference remains a major issue because requires to assess the outcome in both case with and without treatment. Not being able to observe simultaneously both of them,…

Machine Learning · Computer Science 2021-12-09 Celine Beji , Florian Yger , Jamal Atif

The effect of measurement errors in discriminant analysis is investigated. Given observations $Z=X+\epsilon$, where $\epsilon$ denotes a random noise, the goal is to predict the density of $X$ among two possible candidates $f$ and $g$. We…

Statistics Theory · Mathematics 2015-05-13 Sébastien Loustau , Clément Marteau

In their fundamental paper on cubic variance functions, Letac and Mora (The Annals of Statistics,1990) presented a systematic, rigorous and comprehensive study of natural exponential families on the real line, their characterization through…

Statistics Theory · Mathematics 2021-02-05 Shaul K. Bar-Lev , Ad Ridder