中文
相关论文

相关论文: Data Integration by combining big data and survey …

200 篇论文

Non-representative surveys are commonly used and widely available but suffer from selection bias that generally cannot be entirely eliminated using weighting techniques. Instead, we propose a Bayesian method to synthesize longitudinal…

统计方法学 · 统计学 2024-07-08 Nathaniel Dyrkton , Paul Gustafson , Harlan Campbell

This paper considers the two-dataset problem, where data are collected from two potentially different populations sharing common aspects. This problem arises when data are collected by two different types of researchers or from two…

统计方法学 · 统计学 2022-09-27 Steven N. MacEachern , Koji Miyawaki

We study the problem of imputing missing values in a dataset, which has important applications in many domains. The key to missing value imputation is to capture the data distribution with incomplete samples and impute the missing values…

机器学习 · 计算机科学 2023-06-26 He Zhao , Ke Sun , Amir Dezfouli , Edwin Bonilla

We introduce a novel approach to estimation problems in settings with missing data. Our proposal -- the Correlation-Assisted Missing data (CAM) estimator -- works by exploiting the relationship between the observations with missing features…

统计方法学 · 统计学 2020-03-02 Timothy I. Cannings , Yingying Fan

We address one of the important problems in Big Data, namely how to combine estimators from different subsamples by robust fusion procedures, when we are unable to deal with the whole sample. We propose a general framework based on the…

统计理论 · 数学 2018-04-06 Catherine Aaron , Alejandro Cholaquidis , Ricardo Fraiman , Badih Ghattas

Multiple imputation has become one of the standard methods in drawing inferences in many incomplete data applications. Applications of multiple imputation in relatively more complex settings, such as high-dimensional clustered data, require…

统计方法学 · 统计学 2025-04-08 Qiushuang Li , Recai Yucel

Multivariate time series data for real-world applications typically contain a significant amount of missing values. The dominant approach for classification with such missing values is to impute them heuristically with specific values…

机器学习 · 计算机科学 2023-08-15 SeungHyun Kim , Hyunsu Kim , EungGu Yun , Hwangrae Lee , Jaehun Lee , Juho Lee

Missing data theory deals with the statistical methods in the occurrence of missing data. Missing data occurs when some values are not stored or observed for variables of interest. However, most of the statistical theory assumes that data…

统计方法学 · 统计学 2021-10-26 Luis Alejandro Masmela-Caita , Thais Paiva Galletti , Marcos Oliveira Prates

Missing data is a common concern in health datasets, and its impact on good decision-making processes is well documented. Our study's contribution is a methodology for tackling missing data problems using a combination of synthetic dataset…

机器学习 · 计算机科学 2022-11-08 Gift Khangamwa , Terence L. van Zyl , Clint J. van Alten

Missing data arises when certain values are not recorded or observed for variables of interest. However, most of the statistical theory assume complete data availability. To address incomplete databases, one approach is to fill the gaps…

统计方法学 · 统计学 2023-08-15 Luis Alejandro Masmela-Caita , Thais Paiva Galletti , Marcos Oliveira Prates

Advancements in data collection techniques and the heterogeneity of data resources can yield high percentages of missing observations on variables, such as block-wise missing data. Under missing-data scenarios, traditional methods such as…

统计方法学 · 统计学 2022-05-17 Wei Lan , Xuerong Chen , Tao Zou , Chih-Ling Tsai

In Big data era, information integration often requires abundant data extracted from massive data sources. Due to a large number of data sources, data source selection plays a crucial role in information integration, since it is costly and…

数据库 · 计算机科学 2016-11-01 Yiming Lin , Hongzhi Wang , Jianzhong Li , Hong Gao

The problem of estimating the size of a population based on a subset of individuals observed across multiple data sources is often referred to as capture-recapture or multiple-systems estimation. This is fundamentally a missing data…

统计方法学 · 统计学 2022-06-22 Serge Aleshin-Guendel , Mauricio Sadinle , Jon Wakefield

Surveys usually suffer from non-response, which decreases the effective sample size. Item non-response is typically handled by means of some form of random imputation if we wish to preserve the distribution of the imputed variable. This…

统计方法学 · 统计学 2017-08-04 Guillaume Chauvet , Wilfried Do Paco

In many applications, different populations are compared using data that are sampled in a biased manner. Under sampling biases, standard methods that estimate the difference between the population means yield unreliable inferences. Here we…

统计理论 · 数学 2019-11-12 Dave Zachariah , Petre Stoica

The era of big data has witnessed an increasing availability of multiple data sources for statistical analyses. We consider estimation of causal effects combining big main data with unmeasured confounders and smaller validation data with…

统计方法学 · 统计学 2021-08-24 Shu Yang , Peng Ding

When outcomes are missing for reasons beyond an investigator's control, there are two different ways to adjust a parameter estimate for covariates that may be related both to the outcome and to missingness. One approach is to model the…

统计方法学 · 统计学 2008-12-18 Joseph D. Y. Kang , Joseph L. Schafer

Methods to handle missing data have been extensively explored in the context of estimation and descriptive studies, with multiple imputation being the most widely used method in clinical research. However, in the context of clinical risk…

统计方法学 · 统计学 2024-11-25 Junhui Mi , Rahul D. Tendulkar , Sarah M. C. Sittenfeld , Sujata Patil , Emily C. Zabor

Big data is ubiquitous in practices, and it has also led to heavy computation burden. To reduce the calculation cost and ensure the effectiveness of parameter estimators, an optimal subset sampling method is proposed to estimate the…

统计方法学 · 统计学 2023-11-16 Haohui Han , Liya Fu

The increased availability of massive data sets provides a unique opportunity to discover subtle patterns in their distributions, but also imposes overwhelming computational challenges. To fully utilize the information contained in big…

统计理论 · 数学 2018-04-12 Stanislav Volgushev , Shih-Kang Chao , Guang Cheng