English
Related papers

Related papers: Quality Degradation Attack in Synthetic Data

200 papers

What are the limits of controlling language models via synthetic training data? We develop a reinforcement learning (RL) primitive, the Dataset Policy Gradient (DPG), which can precisely optimize synthetic data generators to produce a…

Computation and Language · Computer Science 2026-04-10 Tristan Thrush , Sung Min Park , Herman Brunborg , Luke Bailey , Marcel Roed , Neil Band , Christopher Potts , Tatsunori Hashimoto

Machine learning practitioners frequently seek to leverage the most informative available data, without violating the data owner's privacy, when building predictive models. Differentially private data synthesis protects personal details…

Machine Learning · Computer Science 2020-11-12 Lucas Rosenblatt , Xiaoyan Liu , Samira Pouyanfar , Eduardo de Leon , Anuj Desai , Joshua Allen

With the development of machine learning and data science, data sharing is very common between companies and research institutes to avoid data scarcity. However, sharing original datasets that contain private information can cause privacy…

Machine Learning · Computer Science 2022-11-30 Mingchen Li , Di Zhuang , J. Morris Chang

Synthetic data generation (SDG) is a promising approach for enabling data sharing in biomedical studies while preserving patient privacy. Yet, state-of-the-art generative models often require large datasets and complex training procedures,…

Machine Learning · Computer Science 2026-01-27 Natalia Espinosa-Dice , Nicholas J. Jackson , Chao Yan , Aaron Lee , Bradley A. Malin

We propose a new framework of synthesizing data using deep generative models in a differentially private manner. Within our framework, sensitive data are sanitized with rigorous privacy guarantees in a one-shot fashion, such that training…

Machine Learning · Computer Science 2022-03-09 Seng Pei Liew , Tsubasa Takahashi , Michihiko Ueno

Smart Meters (SMs) are able to share the power consumption of users with utility providers almost in real-time. These fine-grained signals carry sensitive information about users, which has raised serious concerns from the privacy…

Signal Processing · Electrical Eng. & Systems 2021-11-29 Mohammadhadi Shateri , Francisco Messina , Pablo Piantanida , Fabrice Labeau

Machine learning, particularly deep learning, is transforming industrial quality inspection. Yet, training robust machine learning models typically requires large volumes of high-quality labeled data, which are expensive, time-consuming,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Ruo-Syuan Mei , Sixian Jia , Guangze Li , Soo Yeon Lee , Brian Musser , William Keller , Sreten Zakula , Jorge Arinez , Chenhui Shao

As more tech companies engage in rigorous economic analyses, we are confronted with a data problem: in-house papers cannot be replicated due to use of sensitive, proprietary, or private data. Readers are left to assume that the obscured…

General Economics · Economics 2020-11-10 Allison Koenecke , Hal Varian

The integration of privacy measures, including differential privacy techniques, ensures a provable privacy guarantee for the synthetic data. However, challenges arise for Generative Deep Learning models when tasked with generating realistic…

Machine Learning · Computer Science 2024-09-27 Anantaa Kotal , Anupam Joshi

When machine learning models are trained on synthetic data and then deployed on real data, there is often a performance drop due to the distribution shift between synthetic and real data. In this paper, we introduce a new ensemble strategy…

Cryptography and Security · Computer Science 2023-10-17 Haoyuan Sun , Navid Azizan , Akash Srivastava , Hao Wang

For sharing privacy-sensitive data, de-identification is commonly regarded as adequate for safeguarding privacy. Synthetic data is also being considered as a privacy-preserving alternative. Recent successes with numerical and tabular data…

Computation and Language · Computer Science 2025-03-05 Atiquer Rahman Sarkar , Yao-Shun Chuang , Noman Mohammed , Xiaoqian Jiang

In the social sciences, small- to medium-scale datasets are common, and linear regression is canonical. In privacy-aware settings, much work has focused on differentially private (DP) linear regression, but mostly on point estimation with…

Machine Learning · Computer Science 2026-03-31 Shurong Lin , Aleksandra Slavković , Deekshith Reddy Bhoomireddy

Sequential data is everywhere, and it can serve as a basis for research that will lead to improved processes. For example, road infrastructure can be improved by identifying bottlenecks in GPS data, or early diagnosis can be improved by…

Cryptography and Security · Computer Science 2020-02-25 Sigal Shaked , Lior Rokach

The difficulty of anonymizing text data hinders the development and deployment of NLP in high-stakes domains that involve private data, such as healthcare and social services. Poorly anonymized sensitive data cannot be easily shared with…

Computation and Language · Computer Science 2024-10-14 Krithika Ramesh , Nupoor Gandhi , Pulkit Madaan , Lisa Bauer , Charith Peris , Anjalie Field

The biomedical field is among the sectors most impacted by the increasing regulation of Artificial Intelligence (AI) and data protection legislation, given the sensitivity of patient information. However, the rise of synthetic data…

Machine Learning · Computer Science 2024-04-26 Eric Macias-Fassio , Aythami Morales , Cristina Pruenza , Julian Fierrez

The distributed subgradient method (DSG) is a widely discussed algorithm to cope with large-scale distributed optimization problems in the arising machine learning applications. Most exisiting works on DSG focus on ideal communication…

Signal Processing · Electrical Eng. & Systems 2022-08-24 Zhaoyue Xia , Jun Du , Yong Ren

Generative data-free quantization emerges as a practical compression approach that quantizes deep neural networks to low bit-width without accessing the real data. This approach generates data utilizing batch normalization (BN) statistics…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Haotong Qin , Yifu Ding , Xiangguo Zhang , Jiakai Wang , Xianglong Liu , Jiwen Lu

Differential privacy allows quantifying privacy loss resulting from accessing sensitive personal data. Repeated accesses to underlying data incur increasing loss. Releasing data as privacy-preserving synthetic data would avoid this…

Machine Learning · Statistics 2021-06-10 Joonas Jälkö , Eemil Lagerspetz , Jari Haukka , Sasu Tarkoma , Antti Honkela , Samuel Kaski

As synthetic data becomes increasingly popular in machine learning tasks, numerous methods--without formal differential privacy guarantees--use synthetic data for training. These methods often claim, either explicitly or implicitly, to…

Cryptography and Security · Computer Science 2025-02-19 Yunpeng Zhao , Jie Zhang

Synthetic data offers a promising solution to privacy concerns in healthcare by generating useful datasets in a privacy-aware manner. However, although synthetic data is typically developed with the intention of sharing said data, ambiguous…