中文
相关论文

相关论文: Data Integration by combining big data and survey …

200 篇论文

Modern datasets commonly feature both substantial missingness and many variables of mixed data types, which present significant challenges for estimation and inference. Complete case analysis, which proceeds using only the observations with…

统计方法学 · 统计学 2023-04-10 Joseph Feldman , Daniel R. Kowal

Data subsampling has become widely recognized as a tool to overcome computational and economic bottlenecks in analyzing massive datasets. We contribute to the development of adaptive design for estimation of finite population…

统计方法学 · 统计学 2024-07-08 Henrik Imberg , Xiaomi Yang , Carol Flannagan , Jonas Bärgman

Pattern-mixture models provide a transparent approach for handling missing data, where the full-data distribution is factorized in a way that explicitly shows the parts that can be estimated from observed data alone, and the parts that…

统计方法学 · 统计学 2019-04-26 Yen-Chi Chen , Mauricio Sadinle

Several statistical models are given in the form of unnormalized densities, and calculation of the normalization constant is intractable. We propose estimation methods for such unnormalized models with missing data. The key concept is to…

机器学习 · 统计学 2020-06-11 Masatoshi Uehara , Takeru Matsuda , Jae Kwang Kim

In this paper, we propose a new statistical inference method for massive data sets, which is very simple and efficient by combining divide-and-conquer method and empirical likelihood. Compared with two popular methods (the bag of little…

统计方法学 · 统计学 2020-04-21 Xuejun Ma , Shaochen Wang , Wang Zhou

Data values in a dataset can be missing or anomalous due to mishandling or human error. Analysing data with missing values can create bias and affect the inferences. Several analysis methods, such as principle components analysis or…

人工智能 · 计算机科学 2022-05-11 Sandeep Hans , Diptikalyan Saha , Aniya Aggarwal

Big data analytics has opened new avenues in economic research, but the challenge of analyzing datasets with tens of millions of observations is substantial. Conventional econometric methods based on extreme estimators require large amounts…

计量经济学 · 经济学 2023-11-02 Sokbae Lee , Yuan Liao , Myung Hwan Seo , Youngki Shin

Large-scale population-level datasets, such as the UK Biobank and the All of Us Research Program, often lack covariates needed for a specific analysis, such as genetic or lifestyle measures, while related studies measure them. This creates…

统计方法学 · 统计学 2026-05-07 Huali Zhao , Tianying Wang

Multiple imputation provides an effective way to handle missing data. When several possible models are under consideration for the data, the multiple imputation is typically performed under a single-best model selected from the candidate…

统计方法学 · 统计学 2018-11-30 Gyuhyeong Goh , Jae Kwang Kim

We consider the challenges that arise when fitting complex ecological models to 'large' data sets. In particular, we focus on random effect models which are commonly used to describe individual heterogeneity, often present in ecological…

统计方法学 · 统计学 2022-05-17 Ruth King , Blanca Sarzo , Víctor Elvira

It has historically been a challenge to perform Bayesian inference in a design-based survey context. The present paper develops a Bayesian model for sampling inference in the presence of inverse-probability weights. We use a hierarchical…

统计方法学 · 统计学 2020-06-24 Yajuan Si , Natesh S. Pillai , Andrew Gelman

We present an approach to inform decisions about nonresponse follow-up sampling. The basic idea is (i) to create completed samples by imputing nonrespondents' data under various assumptions about the nonresponse mechanisms, (ii) take…

统计方法学 · 统计学 2022-09-16 Thais Paiva , Jerry Reiter

Statistical matching is an effective method for estimating causal effects in which treated units are paired with control units with ``similar'' values of confounding covariates prior to performing estimation. In this way, matching helps…

统计方法学 · 统计学 2023-09-13 Sanjeewani Weerasingha , Michael J. Higgins

Doubly robust estimators combine an inverse probability weighting estimator and a mass imputation estimator. Several doubly robust estimators for estimating the population mean (or prevalence) of an outcome have been proposed for…

统计方法学 · 统计学 2025-08-11 Shaun R Seaman , Tommy Nyberg , Anne M Presanis

A balanced sampling design should always be the adopted strategies if auxiliary information is available. Besides, integrating a stratified structure of the population in the sampling process can considerably reduce the variance of the…

统计方法学 · 统计学 2022-06-03 Raphaël Jauslin , Esther Eustache , Yves Tillé

Extraordinary amounts of data are being produced in many branches of science. Proven statistical methods are no longer applicable with extraordinary large data sets due to computational limitations. A critical step in big data analysis is…

统计方法学 · 统计学 2019-06-27 HaiYing Wang , Min Yang , John Stufken

This paper develops a variance estimation framework for matching estimators that enables valid population inference for treatment effects. We provide theoretical analysis of a variance estimator that addresses key limitations in the…

统计方法学 · 统计学 2025-06-16 Xiang Meng , Aaron Smith , Luke Miratrix

Network surveys of key populations at risk for HIV are an essential part of the effort to understand how the epidemic spreads and how it can be prevented. Estimation of population values from the sample data has been probematical, however,…

应用统计 · 统计学 2019-09-12 Steve Thompson

Nonparametric regression imputation is commonly used in missing data analysis. However, it suffers from the ``curse of dimension". The problem can be alleviated by the explosive sample size in the era of big data, while the large-scale data…

统计方法学 · 统计学 2023-09-26 Ruoyu Wang , Miaomiao Su , Qihua Wang

Gaussian Mixture models (GMMs) are a powerful tool for clustering, classification and density estimation when clustering structures are embedded in the data. The presence of missing values can largely impact the GMMs estimation process,…

机器学习 · 统计学 2020-06-05 Alessio Serafini , Thomas Brendan Murphy , Luca Scrucca