English
Related papers

Related papers: Synthetic Data Generators: Sequential and Private

200 papers

We propose a new framework of synthesizing data using deep generative models in a differentially private manner. Within our framework, sensitive data are sanitized with rigorous privacy guarantees in a one-shot fashion, such that training…

Machine Learning · Computer Science 2022-03-09 Seng Pei Liew , Tsubasa Takahashi , Michihiko Ueno

Individual-level data (microdata) that characterizes a population, is essential for studying many real-world problems. However, acquiring such data is not straightforward due to cost and privacy constraints, and access is often limited to…

Machine Learning · Computer Science 2022-12-13 Angeela Acharya , Siddhartha Sikdar , Sanmay Das , Huzefa Rangwala

Synthetic data generation has emerged as a promising approach to address the challenges of using sensitive financial data in machine learning applications. By leveraging generative models, such as Generative Adversarial Networks (GANs) and…

Machine Learning · Computer Science 2025-10-31 James Meldrum , Basem Suleiman , Fethi Rabhi , Muhammad Johan Alibasa

We prove new upper and lower bounds on the sample complexity of $(\epsilon, \delta)$ differentially private algorithms for releasing approximate answers to threshold functions. A threshold function $c_x$ over a totally ordered domain $X$…

Cryptography and Security · Computer Science 2024-12-23 Mark Bun , Kobbi Nissim , Uri Stemmer , Salil Vadhan

The collection and curation of high-quality training data is crucial for developing text classification models with superior performance, but it is often associated with significant costs and time investment. Researchers have recently…

Computation and Language · Computer Science 2023-10-16 Zhuoyan Li , Hangxiao Zhu , Zhuoran Lu , Ming Yin

Deep learning holds immense promise for aiding radiologists in breast cancer detection. However, achieving optimal model performance is hampered by limitations in availability and sharing of data commonly associated to patient privacy…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Richard Osuala , Daniel M. Lang , Anneliese Riess , Georgios Kaissis , Zuzanna Szafranowska , Grzegorz Skorupko , Oliver Diaz , Julia A. Schnabel , Karim Lekadir

Synthetic data inherits the differential privacy guarantees of the model used to generate it. Additionally, synthetic data may benefit from privacy amplification when the generative model is kept hidden. While empirical studies suggest this…

Machine Learning · Computer Science 2025-06-06 Clément Pierquin , Aurélien Bellet , Marc Tommasi , Matthieu Boussard

Synthetic data is an increasingly popular tool for training deep learning models, especially in computer vision but also in other areas. In this work, we attempt to provide a comprehensive survey of the various directions in the development…

Machine Learning · Computer Science 2019-09-26 Sergey I. Nikolenko

The prevalence and low cost of LLMs have led to a rise of synthetic content. From review sites to court documents, "natural" content has been contaminated by data points that appear similar to natural data, but are in fact LLM-generated. In…

Machine Learning · Computer Science 2026-02-04 Kareem Amin , Alex Bie , Weiwei Kong , Umar Syed , Sergei Vassilvitskii

In the current data driven era, synthetic data, artificially generated data that resembles the characteristics of real world data without containing actual personal information, is gaining prominence. This is due to its potential to…

Machine Learning · Computer Science 2023-09-06 Tshilidzi Marwala , Eleonore Fournier-Tombs , Serge Stinckwich

We address the challenge of ensuring differential privacy (DP) guarantees in training deep retrieval systems. Training these systems often involves the use of contrastive-style losses, which are typically non-per-example decomposable,…

Computation and Language · Computer Science 2024-05-24 Aldo Gael Carranza , Rezsa Farahani , Natalia Ponomareva , Alex Kurakin , Matthew Jagielski , Milad Nasr

Probabilistic relational models provide a well-established formalism to combine first-order logic and probabilistic models, thereby allowing to represent relationships between objects in a relational domain. At the same time, the field of…

Artificial Intelligence · Computer Science 2024-10-03 Malte Luttermann , Ralf Möller , Mattis Hartwig

Synthetic text generation with Differential Privacy (DP) guarantees emerges as a principled approach that can enable the sharing of sensitive datasets across institutional and regulatory boundaries, while bounding the risks of…

Sharing of tabular data containing valuable but private information is limited due to legal and ethical issues. Synthetic data could be an alternative solution to this sharing problem, as it is artificially generated by machine learning…

Machine Learning · Computer Science 2025-03-06 Fatima J. Sarmin , Atiquer R. Rahman , Christopher J. Henry , Noman Mohammed

Deep learning models have demonstrated superior performance in several application problems, such as image classification and speech processing. However, creating a deep learning model using health record data requires addressing certain…

Machine Learning · Computer Science 2021-12-14 Amirsina Torfi , Edward A. Fox , Chandan K. Reddy

This paper introduces two methods of creating differentially private (DP) synthetic data that are now incorporated into the \textit{synthpop} package for \textbf{R}. Both are suitable for synthesising categorical data, or numeric data…

Applications · Statistics 2022-06-28 Gillian M Raab

Understanding the relationship between generalization and privacy remains a central challenge in modern machine learning theory, particularly for deep networks trained by variants of differentially private stochastic gradient descent…

Machine Learning · Computer Science 2026-05-27 Christoph H. Lampert , Hossein Zakerinia

Class imbalance can often degrade predictive performance of supervised learning algorithms. Balanced classes can be obtained by oversampling exact copies, with noise, or interpolation between nearest neighbours (as in traditional SMOTE…

Machine Learning · Computer Science 2022-01-17 Emily Muller , Xu Zheng , Jer Hayes

We propose a Bayesian pseudo posterior mechanism to generate record-level synthetic databases equipped with an $(\epsilon,\delta)-$ probabilistic differential privacy (pDP) guarantee, where $\delta$ denotes the probability that any observed…

Methodology · Statistics 2021-08-17 Terrance D. Savitsky , Matthew R. Williams , Jingchen Hu

This paper investigates synthetic data generation strategies in developing generative retrieval models for domain-specific corpora, thereby addressing the scalability challenges inherent in manually annotating in-domain queries. We study…

Computation and Language · Computer Science 2025-02-26 Haoyang Wen , Jiang Guo , Yi Zhang , Jiarong Jiang , Zhiguo Wang