English
Related papers

Related papers: Correcting for non-ignorable missingness in smokin…

200 papers

This paper develops an inferential framework for matrix completion when missing is not at random and without the requirement of strong signals. Our development is based on the observation that if the number of missing entries is small…

Methodology · Statistics 2023-08-07 Jungjun Choi , Ming Yuan

There is a growing trend among statistical agencies to explore non-probability data sources for producing more timely and detailed statistics, while reducing costs and respondent burden. Coverage and measurement error are two issues that…

Methodology · Statistics 2024-09-19 Lyndon Ang , Robert Clark , Bronwyn Loong , Anders Holmberg

Using firm-level survey- and register-data for both Sweden and Denmark we show systematic mis-measurement in both vacancy measures. While the register-based measure on the aggregate constitutes a quarter of the survey-based measure, the…

General Economics · Economics 2021-03-04 Niels-Jakob Harbo Hansen , Hans Henrik Sievertsen

Clinical notes contain rich patient information, such as diagnoses or medications, making them valuable for patient representation learning. Recent advances in large language models have further improved the ability to extract meaningful…

Machine Learning · Computer Science 2025-09-23 Zihan Liang , Ziwen Pan , Ruoxuan Xiong

Introduction: Accounting for missing data by imputing or weighting conditional on covariates relies on the variable with missingness being observed at least some of the time for all unique covariate values. This requirement is referred to…

Applications · Statistics 2025-10-16 Paul N Zivich , Bonnie E Shook-Sa , Stephen R Cole , Eric T Lofgren , Jessie K Edwards

Accurate inference on population dynamics, such as migration and changes in population size, is essential for policymaking, resource allocation and demographic research. Traditional censuses are expensive, infrequent and not timely, leading…

Applications · Statistics 2026-03-27 Lucy Y Brown , Eleni Matechou , Bruno Santos , Eleonora Mussino

BACKGROUND: As databases grow larger, it becomes harder to fully control their collection, and they frequently come with missing values: incomplete observations. These large databases are well suited to train machine-learning models, for…

Machine Learning · Computer Science 2022-02-23 Alexandre Perez-Lebel , Gaël Varoquaux , Marine Le Morvan , Julie Josse , Jean-Baptiste Poline

We study the effects of missingness on the estimation of population parameters. Moving beyond restrictive missing completely at random (MCAR) assumptions, we first formulate a missing data analogue of Huber's arbitrary…

Statistics Theory · Mathematics 2026-04-28 Tianyi Ma , Kabir A. Verchand , Thomas B. Berrett , Tengyao Wang , Richard J. Samworth

We consider the problem of detecting an epidemic in a population where individual diagnoses are extremely noisy. The motivation for this problem is the plethora of examples (influenza strains in humans, or computer viruses in smartphones,…

Social and Information Networks · Computer Science 2014-02-07 Eli A. Meirom , Chris Milling , Constantine Caramanis , Shie Mannor , Ariel Orda , Sanjay Shakkottai

Many datasets describing contacts in a population suffer from incompleteness due to population sampling and underreporting of contacts. Data-driven simulations of spreading processes using such incomplete data lead to an underestimation of…

Physics and Society · Physics 2017-09-07 Julie Fournet , Alain Barrat

End-stage renal disease has many adverse complications associated with it leading to 20-50% higher mortality rates in people than those without the disease. This makes it one of the leading causes of death in the United States. This article…

Applications · Statistics 2023-09-13 Supraja Malladi , Indranil Sahoo , QiQi Lu

In a variety of settings, limitations of sensing technologies or other sampling mechanisms result in missing labels, where the likelihood of a missing label in the training set is an unknown function of the data. For example, satellites…

Machine Learning · Statistics 2021-03-26 Hyebin Song , Garvesh Raskutti , Rebecca Willett

The interplay between missing data and model uncertainty -- two classic statistical problems -- leads to primary questions that we formally address from an objective Bayesian perspective. For the general regression problem, we discuss the…

Electronic health records (EHR) often contain varying levels of missing data. This study compared different imputation strategies to identify the most suitable approach for predicting central line-associated bloodstream infection (CLABSI)…

In observational surveys, post-stratification is used to reduce bias resulting from differences between the survey population and the population under investigation. However, this can lead to inflated post-stratification weights and,…

Applications · Statistics 2016-06-24 Yannick Vandendijck , Christel Faes , Niel Hens

Missing values in electronic health record (EHR) data pose a significant challenge for epidemiologic research. Traditional methods for handling missing data, like mean imputation, may introduce bias. Multiple imputation (MI) offers a…

We introduce the Markov missing graph (MMG), a novel framework that imputes missing data based on undirected graphs. MMG leverages conditional independence relationships to locally decompose the imputation model. To establish the…

Methodology · Statistics 2025-09-04 Yanjiao Yang , Yen-Chi Chen

Trial-based economic evaluations are typically performed on cross-sectional variables, derived from the responses for only the completers in the study, using methods that ignore the complexities of utility and cost data (e.g. skewness and…

Methodology · Statistics 2018-05-21 Andrea Gabrio , Michael J. Daniels , Gianluca Baio

Models for analyzing multivariate data sets with missing values require strong, often unassessable, assumptions. The most common of these is that the mechanism that created the missing data is ignorable - a twofold assumption dependent on…

Applications · Statistics 2020-02-17 Iavor Bojinov , Natesh Pillai , Donald Rubin

An approach to amputation, the process of introducing missing values to a complete dataset, is presented. It allows to construct missingness indicators in a flexible and principled way via copulas and Bernoulli margins and to incorporate…

Applications · Statistics 2025-07-28 Marius Hofert , James Jackson , Niels Hagenbuch
‹ Prev 1 8 9 10 Next ›