English
Related papers

Related papers: Multiple Imputation and Synthetic Data Generation …

200 papers

The development and generation of synthetic data are becoming increasingly vital in the field of statistical disclosure control. The PSInference package provides tools to perform exact inferential analysis on singly imputed synthetic data…

Methodology · Statistics 2025-03-20 Ricardo Moura , Mina Norouzirad , Vitor Augusto , Miguel Fonseca

Missing data imputation in tabular datasets remains a pivotal challenge in data science and machine learning, particularly within socioeconomic research. However, real-world socioeconomic datasets are typically subject to strict data…

Machine Learning · Computer Science 2025-06-11 Siyi Sun , David Antony Selby , Yunchuan Huang , Sebastian Vollmer , Seth Flaxman , Anisoara Calinescu

We propose a categorical data synthesizer with a quantifiable disclosure risk. Our algorithm, named Perturbed Gibbs Sampler, can handle high-dimensional categorical data that are often intractable to represent as contingency tables. The…

Machine Learning · Statistics 2013-12-20 Yubin Park , Joydeep Ghosh

Incomplete data is a persistent challenge in real-world datasets, often governed by complex and unobservable missing mechanisms. Simulating missingness has become a standard approach for understanding its impact on learning and analysis.…

Machine Learning · Computer Science 2025-08-08 Youran Zhou , Mohamed Reda Bouadjenek , Sunil Aryal

Missing data present challenges in data analysis. Naive analyses such as complete-case and available-case analysis may introduce bias and loss of efficiency, and produce unreliable results. Multiple imputation (MI) is one of the most widely…

Methodology · Statistics 2019-05-15 Domonique W. Hodge , Sandra E. Safo , Qi Long

We present a Bayesian model for estimating the joint distribution of multivariate categorical data when units are nested within groups. Such data arise frequently in social science settings, for example, people living in households. The…

Methodology · Statistics 2016-10-31 Jingchen Hu , Jerome P. Reiter , Quanli Wang

The dirichletprocess package provides software for creating flexible Dirichlet process objects. Users can perform nonparametric Bayesian analysis using Dirichlet processes without the need to program their own inference algorithms. Instead,…

Computation · Statistics 2026-05-05 Gordon J. Ross , Dean Markwick , Priyanshu Tiwari

Statistical agencies utilize models to synthesize respondent-level data for release to the general public as an alternative to the actual data records. A Bayesian model synthesizer encodes privacy protection by employing a hierarchical…

Statistics Theory · Mathematics 2020-05-19 Jingchen Hu , Terrance D. Savitsky

Differential privacy (DP) data synthesizers support public release of sensitive information, offering theoretical guarantees for privacy but limited evidence of utility in practical settings. Utility is typically measured as the error on…

Recent advances in big data and analytics research have provided a wealth of large data sets that are too big to be analyzed in their entirety, due to restrictions on computer memory or storage size. New Bayesian methods have been developed…

Applications · Statistics 2014-09-30 Alexey Miroshnikov , Erin Conlon

Synthetic data generation methods, and in particular, private synthetic data generation methods, are gaining popularity as a means to make copies of sensitive databases that can be shared widely for research and data analysis. Some of the…

Databases · Computer Science 2023-09-18 Shweta Patwa , Danyu Sun , Amir Gilad , Ashwin Machanavajjhala , Sudeepa Roy

The dissemination of synthetic data can be an effective means of making information from sensitive data publicly available while reducing the risk of disclosure associated with releasing the sensitive data directly. While mechanisms exist…

Methodology · Statistics 2021-09-23 Harrison Quick

Differential privacy (DP) has been accepted as a rigorous criterion for measuring the privacy protection offered by random mechanisms used to obtain statistics or, as we will study here, synthetic datasets from confidential data. Methods to…

Methodology · Statistics 2024-05-09 Leila Nombo , Anne-Sophie Charest

In a world where artificial intelligence and data science become omnipresent, data sharing is increasingly locking horns with data-privacy concerns. Differential privacy has emerged as a rigorous framework for protecting individual privacy…

Cryptography and Security · Computer Science 2022-06-06 March Boedihardjo , Thomas Strohmer , Roman Vershynin

Missing data are ubiquitous in real world applications and, if not adequately handled, may lead to the loss of information and biased findings in downstream analysis. Particularly, high-dimensional incomplete data with a moderate sample…

Machine Learning · Computer Science 2022-12-23 Zongyu Dai , Zhiqi Bu , Qi Long

The R package micompr implements a procedure for assessing if two or more multivariate samples are drawn from the same distribution. The procedure uses principal component analysis to convert multivariate observations into a set of linearly…

Mathematical Software · Computer Science 2021-05-11 Nuno Fachada , João Rodrigues , Vitor V. Lopes , Rui C. Martins , Agostinho C. Rosa

Training generative machine learning models to produce synthetic tabular data has become a popular approach for enhancing privacy in data sharing. As this typically involves processing sensitive personal information, releasing either the…

Cryptography and Security · Computer Science 2026-02-02 Georgi Ganev , Emiliano De Cristofaro

Imputing missing values is an important preprocessing step in data analysis, but the literature offers little guidance on how to choose between different imputation models. This letter suggests adopting the imputation model that generates a…

Methodology · Statistics 2021-07-13 Moritz Marbach

Generation of realistic synthetic data has garnered considerable attention in recent years, particularly in the health research domain due to its utility in, for instance, sharing data while protecting patient privacy or determining optimal…

Other Statistics · Statistics 2025-01-30 Niki Z. Petrakos , Erica E. M. Moodie , Nicolas Savy

The scarcity of Smart Home data is still a pretty big problem, and in a world where the size of a dataset can often make the difference between a poor performance and a good performance for problems related to machine learning projects,…

Other Computer Science · Computer Science 2019-09-24 Marco Piangerelli , Giacomo Rocchetti , Alessandro Liscio , Renato De Leone