中文
相关论文

相关论文: Fully Synthetic Data for Complex Surveys

200 篇论文

This paper studies the feasibility of synthetic data generation for mission-critical applications. The emphasis is on synthetic data generation for anomalous detection in complex social networks. In particular, the development of a…

社会与信息网络 · 计算机科学 2020-10-27 Andreea Sistrunk , Vanessa Cedeno , Subhodip Biswas

Machine learning heavily relies on data, but real-world applications often encounter various data-related issues. These include data of poor quality, insufficient data points leading to under-fitting of machine learning models, and…

Big Data often presents as massive non-probability samples. Not only is the selection mechanism often unknown, but larger data volume amplifies the relative contribution of selection bias to total error. Existing bias adjustment approaches…

统计方法学 · 统计学 2022-03-29 Ali Rafei , Carol A. C. Flannagan , Brady T. West , Michael R. Elliott

A synthetic dataset is a data object that is generated programmatically, and it may be valuable to creating a single dataset from multiple sources when direct collection is difficult or costly. Although it is a fundamental step for many…

应用统计 · 统计学 2020-09-22 Zheng Li , Yue Zhao , Jialin Fu

Location data collected from mobile devices represent mobility behaviors at individual and societal levels. These data have important applications ranging from transportation planning to epidemic modeling. However, issues must be overcome…

机器学习 · 计算机科学 2022-01-05 Alex Berke , Ronan Doorley , Kent Larson , Esteban Moro

Recent advances in deep generative models have greatly expanded the potential to create realistic synthetic health datasets. These synthetic datasets aim to preserve the characteristics, patterns, and overall scientific conclusions derived…

机器学习 · 计算机科学 2024-07-04 Jennifer A Bartell , Sander Boisen Valentin , Anders Krogh , Henning Langberg , Martin Bøgsted

Synthetic data generation, a cornerstone of Generative Artificial Intelligence, promotes a paradigm shift in data science by addressing data scarcity and privacy while enabling unprecedented performance. As synthetic data becomes more…

机器学习 · 统计学 2024-03-12 Xiaotong Shen , Yifei Liu , Rex Shen

Most statistical agencies release randomly selected samples of Census microdata, usually with sample fractions under 10% and with other forms of statistical disclosure control (SDC) applied. An alternative to SDC is data synthesis, which…

密码学与安全 · 计算机科学 2022-07-08 Claire Little , Mark Elliot , Richard Allmendinger

Privacy-preserving synthetic data offers a promising solution to harness segregated data in high-stakes domains where information is compartmentalized for regulatory, privacy, or institutional reasons. This survey provides a comprehensive…

密码学与安全 · 计算机科学 2025-03-28 Viktor Schlegel , Anil A Bharath , Zilong Zhao , Kevin Yee

Imbalanced data, where the positive samples represent only a small proportion compared to the negative samples, makes it challenging for classification problems to balance the false positive and false negative rates. A common approach to…

机器学习 · 统计学 2026-02-17 Pengfei Lyu , Zhengchi Ma , Linjun Zhang , Anru R. Zhang

An ideal synthetic population, a key input to activity-based models, mimics the distribution of the individual- and household-level attributes in the actual population. Since the entire population's attributes are generally unavailable,…

机器学习 · 统计学 2022-08-03 Eui-Jin Kim , Prateek Bansal

Data on businesses collected by statistical agencies are challenging to protect. Many businesses have unique characteristics, and distributions of employment, sales, and profits are highly skewed. Attackers wishing to conduct identification…

计量经济学 · 经济学 2020-11-13 M. Jahangir Alam , Benoit Dostie , Jörg Drechsler , Lars Vilhuber

There is significant growth and interest in the use of synthetic data as an enabler for machine learning in environments where the release of real data is restricted due to privacy or availability constraints. Despite a large number of…

机器学习 · 计算机科学 2020-11-25 Harrison Wilde , Jack Jewson , Sebastian Vollmer , Chris Holmes

The statistical challenges in using big data for making valid statistical inference in the finite population have been well documented in literature. These challenges are due primarily to statistical bias arising from under-coverage in the…

统计方法学 · 统计学 2020-06-19 Jae-kwang Kim , Siu-Ming Tam

Data analysis based on information from several sources is common in economic and biomedical studies. This setting is often referred to as the data fusion problem, which differs from traditional missing data problems since no complete data…

统计方法学 · 统计学 2022-04-07 Wei Li , Shanshan Luo , Wangli Xu

Private synthetic data sharing is preferred as it keeps the distribution and nuances of original data compared to summary statistics. The state-of-the-art methods adopt a select-measure-generate paradigm, but measuring large domain…

密码学与安全 · 计算机科学 2023-10-11 Meifan Zhang , Dihang Deng , Lihua Yin

Multiple imputation has become one of the standard methods in drawing inferences in many incomplete data applications. Applications of multiple imputation in relatively more complex settings, such as high-dimensional clustered data, require…

统计方法学 · 统计学 2025-04-08 Qiushuang Li , Recai Yucel

In the analysis of survey data, sampling weights are needed for consistent estimation of the population. However, the original inverse probability weights from the survey sample design are typically modified to account for non-response, to…

统计计算 · 统计学 2025-08-19 Matthew R. Williams , Terrance D. Savitsky

Nonprobability (convenience) samples are increasingly sought to stabilize estimations for one or more population variables of interest that are performed using a randomized survey (reference) sample by increasing the effective sample size.…

In differential privacy (DP), a challenging problem is to generate synthetic datasets that efficiently capture the useful information in the private data. The synthetic dataset enables any task to be done without privacy concern and…

密码学与安全 · 计算机科学 2021-01-01 Zhikun Zhang , Tianhao Wang , Ninghui Li , Jean Honorio , Michael Backes , Shibo He , Jiming Chen , Yang Zhang