English
Related papers

Related papers: Combining Data from Surveys and Related Sources

200 papers

The integration of data from multiple sources is increasingly used to achieve larger sample sizes and enhance population diversity. Our previous work established that, under random sampling from the same underlying population, integrating…

Methodology · Statistics 2026-01-01 Farimah Shamsi , Andriy Derkach

Online data has the potential to transform how researchers and companies produce election forecasts. Social media surveys, online panels and even comments scraped from the internet can offer valuable insights into political preferences.…

Applications · Statistics 2025-03-20 Alberto Arletti , Maria Letizia Tanturri , Omar Paccagnella

Data analysis based on information from several sources is common in economic and biomedical studies. This setting is often referred to as the data fusion problem, which differs from traditional missing data problems since no complete data…

Methodology · Statistics 2022-04-07 Wei Li , Shanshan Luo , Wangli Xu

Forecast combination integrates information from various sources by consolidating multiple forecast results from the target time series. Instead of the need to select a single optimal forecasting model, this paper introduces a deep learning…

Machine Learning · Computer Science 2023-11-27 Yinuo Ren , Feng Li , Yanfei Kang , Jue Wang

We consider the problem of analyzing the heterogeneity of clustering distributions for multiple groups of observed data, each of which is indexed by a covariate value, and inferring global clusters arising from observations aggregated over…

Methodology · Statistics 2012-12-06 XuanLong Nguyen

Estimating the prevalence of a disease is necessary for evaluating and mitigating risks of its transmission within or between populations. Estimates that consider how prevalence changes with time provide more information about these risks…

Applications · Statistics 2021-11-12 Braden Scherting , Alison Peel , Raina Plowright , Andrew Hoegh

This paper presents theoretical results on combining non-probability and probability survey samples through mass imputation, an approach originally proposed by Rivers (2007) as sample matching without rigorous theoretical justification.…

Methodology · Statistics 2020-11-24 Jae Kwang Kim , Seho Park , Yilin Chen , Changbao Wu

We consider inference from non-random samples in data-rich settings where high-dimensional auxiliary information is available both in the sample and the target population, with survey inference being a special case. We propose a regularized…

Methodology · Statistics 2021-04-13 Yutao Liu , Andrew Gelman , Qixuan Chen

A case is made that researchers are interested in studying processes. Often the inferences they are interested in making are about the process and its associated population. On other occasions, a researcher may be interested in making an…

Other Statistics · Statistics 2022-06-20 Charles W. Champ , Andrew V. Sills

Combining evidence from different sources can be achieved with Bayesian or Dempster-Shafer methods. The first requires an estimate of the priors and likelihoods while the second only needs an estimate of the posterior probabilities and…

Machine Learning · Computer Science 2021-04-16 Fabrice Daniel

Statistical estimates can often be improved by fusion of data from several different sources. One example is so-called ensemble methods which have been successfully applied in areas such as machine learning for classification and…

Physics and Society · Physics 2013-09-03 Johan Dahlin , Pontus Svenson

Hierarchical models are versatile tools for joint modeling of data sets arising from different, but related, sources. Fully Bayesian inference may, however, become computationally prohibitive if the source-specific data models are complex,…

Computation · Statistics 2016-05-06 Ritabrata Dutta , Paul Blomstedt , Samuel Kaski

In the age of big data, nonprobability surveys are becoming increasingly abundant. Data integration techniques involving both probability and nonprobability surveys are being extensively used for providing improved estimates for finite…

Applications · Statistics 2025-10-17 Aditi Sen , Partha Lahiri

Multi-level modeling is an important approach for analyzing complex survey data using multi-stage sampling. However, estimation of multi-level models can be challenging when we combine several datasets with distinct hierarchies with…

Methodology · Statistics 2023-09-26 Seho Park , A James OMalley

This paper presents a general and efficient framework for probabilistic inference and learning from arbitrary uncertain information. It exploits the calculation properties of finite mixture models, conjugate families and factorization. Both…

Artificial Intelligence · Computer Science 2011-05-19 M. C. Garrido , P. E. Lopez-de-Teruel , A. Ruiz

In the typical analysis of a data set, a single method is selected for statistical reporting even when equally applicable methods yield very different results. Examples of equally applicable methods can correspond to those of different…

Methodology · Statistics 2012-10-30 David R. Bickel

Differential privacy is widely adopted to provide provable privacy guarantees in data analysis. We consider the problem of combining public and private data (and, more generally, data with heterogeneous privacy needs) for estimating…

Machine Learning · Computer Science 2021-11-02 Cecilia Ferrando , Jennifer Gillenwater , Alex Kulesza

Combining distributions is an important issue in decision theory and Bayesian inference. Logarithmic pooling is a popular method to aggregate expert opinions by using a set of weights that reflect the reliability of each information source.…

Many applications rely on Web data and extraction systems to accomplish knowledge-driven tasks. Web information is not curated, so many sources provide inaccurate, or conflicting information. Moreover, extraction systems introduce…

Databases · Computer Science 2015-03-03 Ravali Pochampally , Anish Das Sarma , Xin Luna Dong , Alexandra Meliou , Divesh Srivastava

Nonparametric mixture models based on the Dirichlet process are an elegant alternative to finite models when the number of underlying components is unknown, but inference in such models can be slow. Existing attempts to parallelize…

Machine Learning · Statistics 2012-12-03 Sinead A. Williamson , Avinava Dubey , Eric P. Xing