English
Related papers

Related papers: Developing robust methods to handle missing data i…

200 papers

Machine learning algorithms permeate the day-to-day aspects of our lives and therefore studying the fairness of these algorithms before implementation is crucial. One way in which bias can manifest in a dataset is through missing values.…

Machine Learning · Statistics 2026-02-23 Aeysha Bhatti , Trudie Sandrock , Johane Nienkemper-Swanepoel

Estimating population quantities such as mean outcomes from user feedback is fundamental to platform evaluation and social science, yet feedback is often missing not at random (MNAR): users with stronger opinions are more likely to respond,…

Machine Learning · Statistics 2026-02-19 Hongyu Chen , David Simchi-Levi , Ruoxuan Xiong

An efficient monotone data augmentation (MDA) algorithm is proposed for missing data imputation for incomplete multivariate nonnormal data that may contain variables of different types, and are modeled by a sequence of regression models…

Methodology · Statistics 2018-11-21 Yongqiang Tang

To analyze unstructured data (text, images, audio, video), economists typically first extract low-dimensional structured features with a neural network. Neural networks do not make generically unbiased predictions, and biases will propagate…

Econometrics · Economics 2026-02-20 Jacob Carlson , Melissa Dell

The problem of nonparametric functional data classification and bandwidth selection is considered when the response variable, also called the class label, might be missing but not at random (MNAR). This setup is broadly acknowledged to be…

Methodology · Statistics 2025-09-12 Majid Mojirsheibani

Automated incident management is critical for microservice reliability. While recent unified frameworks leverage multimodal data for joint optimization, they unrealistically assume perfect data completeness. In practice, network…

Machine Learning · Computer Science 2026-03-30 Wenzhuo Qian , Hailiang Zhao , Ziqi Wang , Zhipeng Gao , Jiayi Chen , Zhiwei Ling , Shuiguang Deng

The presence of missing values makes supervised learning much more challenging. Indeed, previous work has shown that even when the response is a linear function of the complete data, the optimal predictor is a complex function of the…

Machine Learning · Computer Science 2020-11-05 Marine Le Morvan , Julie Josse , Thomas Moreau , Erwan Scornet , Gaël Varoquaux

We consider studies where multiple measures on an outcome variable are collected over time, but some subjects drop out before the end of follow up. Analyses of such data often proceed under either a 'last observation carried forward' or…

Methodology · Statistics 2022-07-26 Oliver Dukes , David Richardson , Eric Tchetgen Tchetgen

Objective: Many low-severity crashes are not reported due to sampling criteria, introducing missing not at random (MNAR) bias. If not addressed, MNAR bias can lead to inaccurate safety analyses. This paper illustrates a statistical method…

Applications · Statistics 2025-03-10 Alberto Morando

Exploring missing data in attributed graphs introduces unique challenges beyond those found in tabular datasets. In this work, we extend the taxonomy for missing data mechanisms to attributed graphs by proposing GAMM (Graph Attributes…

Machine Learning · Computer Science 2026-02-10 Richard Serrano , Baptiste Jeudy , Charlotte Laclau , Christine Largeron

We propose an l1-regularized likelihood method for estimating the inverse covariance matrix in the high-dimensional multivariate normal model in presence of missing data. Our method is based on the assumption that the data are missing at…

Methodology · Statistics 2012-02-28 Nicolas Städler , Peter Bühlmann

During the past few decades, missing-data problems have been studied extensively, with a focus on the ignorable missing case, where the missing probability depends only on observable quantities. By contrast, research into non-ignorable…

Methodology · Statistics 2019-08-06 Yukun Liu , Pengfei Li , Jing Qin

Mobile technology (e.g., mobile phones and wearable devices) provides scalable methods for collecting physiological and behavioral biomarkers in patients' naturalistic settings, as well as opportunities for therapeutic advancements and…

Dealing with missing data is an important problem in statistical analysis that is often addressed with imputation procedures. The performance and validity of such methods are of great importance for their application in empirical studies.…

Applications · Statistics 2024-01-19 Jakob Schwerter , Ketevan Gurtskaia , Andrés Romero , Birgit Zeyer-Gliozzo , Markus Pauly

Missing data is an universal problem in statistics. We develop a unified framework for estimating parameters defined by general estimating equations under a missing-at-random (MAR) mechanism, based on generalized entropy calibration…

Methodology · Statistics 2026-03-31 Mst Moushumi Pervin , Hengfang Wang , Jae Kwang Kim

Two major ideas in the analysis of missing data are (a) the EM algorithm [Dempster, Laird and Rubin, J. Roy. Statist. Soc. Ser. B 39 (1977) 1--38] for maximum likelihood (ML) estimation, and (b) the formulation of models for the joint…

Methodology · Statistics 2011-04-14 Yan Zhou , Roderick J. A. Little , John D. Kalbfleisch

Human activity recognition (HAR) ideally relies on data from wearable or environment-instrumented sensors sampled at regular intervals, enabling standard neural network models optimized for consistent time-series data as input. However,…

Signal Processing · Electrical Eng. & Systems 2025-01-28 Mengxi Liu , Daniel Geißler , Sizhen Bian , Bo Zhou , Paul Lukowicz

Missing data are present in most real world problems and need careful handling to preserve the prediction accuracy and statistical consistency in the downstream analysis. As the gold standard of handling missing data, multiple imputation…

Machine Learning · Computer Science 2021-12-23 Zongyu Dai , Zhiqi Bu , Qi Long

Multimodal electronic health record (EHR) data are widely used in clinical applications. Conventional methods usually assume that each sample (patient) is associated with the unified observed modalities, and all modalities are available for…

Machine Learning · Computer Science 2022-11-01 Chaohe Zhang , Xu Chu , Liantao Ma , Yinghao Zhu , Yasha Wang , Jiangtao Wang , Junfeng Zhao

Causal learning is a fundamental problem in statistics and science, offering insights into predicting the effects of unseen treatments on a system. Despite recent advances in this topic, most existing causal discovery algorithms operate…

Machine Learning · Statistics 2024-02-27 Muralikrishnna G. Sethuraman , Faramarz Fekri