English
Related papers

Related papers: Controlled Generation for Private Synthetic Text

200 papers

The growing reliance on artificial intelligence (AI) in customer support has significantly improved operational efficiency and user experience. However, traditional machine learning (ML) approaches, which require extensive local training on…

Machine Learning · Computer Science 2025-01-03 Anant Prakash Awasthi , Girdhar Gopal Agarwal , Chandraketu Singh , Rakshit Varma , Sanchit Sharma

Semi-supervised learning (SSL) is a promising approach for training deep classification models using labeled and unlabeled datasets. However, existing SSL methods rely on a large unlabeled dataset, which may not always be available in many…

Machine Learning · Computer Science 2023-09-29 Shin'ya Yamaguchi

Learning disentangled representations of data is a fundamental problem in artificial intelligence. Specifically, disentangled latent representations allow generative models to control and compose the disentangled factors in the synthesis…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Yotam Nitzan , Amit Bermano , Yangyan Li , Daniel Cohen-Or

To protect the privacy of individuals whose data is being shared, it is of high importance to develop methods allowing researchers and companies to release textual data while providing formal privacy guarantees to its originators. In the…

Machine Learning · Computer Science 2022-10-27 Justus Mattern , Zhijing Jin , Benjamin Weggenmann , Bernhard Schoelkopf , Mrinmaya Sachan

Generative diffusion models have emerged as powerful tools to synthetically produce training data, offering potential solutions to data scarcity and reducing labelling costs for downstream supervised deep learning applications. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Nicolo Resmini , Eugenio Lomurno , Cristian Sbrolli , Matteo Matteucci

The recent surge in research focused on generating synthetic data from large language models (LLMs), especially for scenarios with limited data availability, marks a notable shift in Generative Artificial Intelligence (AI). Their ability to…

Machine Learning · Computer Science 2024-03-08 Xu Guo , Yiqiang Chen

We study private synthetic data generation for query release, where the goal is to construct a sanitized version of a sensitive dataset, subject to differential privacy, that approximately preserves the answers to a large collection of…

Machine Learning · Computer Science 2021-12-10 Terrance Liu , Giuseppe Vietri , Zhiwei Steven Wu

It has always been an important yet challenging problem to control language models to avoid generating texts with undesirable attributes, such as toxic language and unnatural repetition. We introduce Click for controllable text generation,…

Computation and Language · Computer Science 2023-06-07 Chujie Zheng , Pei Ke , Zheng Zhang , Minlie Huang

Sharing sensitive data is vital in enabling many modern data analysis and machine learning tasks. However, current methods for data release are insufficiently accurate or granular to provide meaningful utility, and they carry a high risk of…

Databases · Computer Science 2021-08-25 Teddy Cunningham , Graham Cormode , Hakan Ferhatosmanoglu

Texts convey sophisticated knowledge. However, texts also convey sensitive information. Despite the success of general-purpose language models and domain-specific mechanisms with differential privacy (DP), existing text sanitization…

Computation and Language · Computer Science 2021-06-03 Xiang Yue , Minxin Du , Tianhao Wang , Yaliang Li , Huan Sun , Sherman S. M. Chow

Sensitive datasets are often underutilized in research and industry due to privacy concerns, limiting the potential of valuable data-driven insights. Synthetic data generation presents a promising solution to address this challenge by…

Computation · Statistics 2026-01-27 Ali Furkan Kalay

This Viewpoint discusses generative artificial intelligence and safeguarding privacy by using synthetic data as a substitute for private health data.

Cryptography and Security · Computer Science 2025-01-17 Gwénolé Abgrall , Xavier Monnet , Anmol Arora

Differential privacy allows quantifying privacy loss resulting from accessing sensitive personal data. Repeated accesses to underlying data incur increasing loss. Releasing data as privacy-preserving synthetic data would avoid this…

Machine Learning · Statistics 2021-06-10 Joonas Jälkö , Eemil Lagerspetz , Jari Haukka , Sasu Tarkoma , Antti Honkela , Samuel Kaski

We propose a novel framework for ID-preserving generation using a multi-modal encoding strategy rather than injecting identity features via adapters into pre-trained models. Our method treats identity and text as a unified conditioning…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Zichuan Liu , Liming Jiang , Qing Yan , Yumin Jia , Hao Kang , Xin Lu

The scarcity of accessible, compliant, and ethically sourced data presents a considerable challenge to the adoption of artificial intelligence (AI) in sensitive fields like healthcare, finance, and biomedical research. Furthermore, access…

Machine Learning · Computer Science 2025-04-02 Kumar Kshitij Patel , Weitong Zhang , Lingxiao Wang

In recent years, machine learning - particularly deep learning - has significantly impacted the field of information management. While several strategies have been proposed to restrict models from learning and memorizing sensitive…

Computation and Language · Computer Science 2024-07-10 Jiajia Li , Lu Yang , Letian Peng , Shitou Zhang , Ping Wang , Zuchao Li , Hai Zhao

Recently, generative AI has attracted much attention from both academic and industrial fields, which has shown its potential, especially in the data generation and synthesis aspects. Simultaneously, secure and privacy-preserving mobile…

Cryptography and Security · Computer Science 2024-05-20 Yaoqi Yang , Bangning Zhang , Daoxing Guo , Hongyang Du , Zehui Xiong , Dusit Niyato , Zhu Han

Modern text-to-image generative models can inadvertently reproduce copyrighted content memorized in their training data, raising serious concerns about potential copyright infringement. We introduce Guardians of Generation, a model agnostic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Soham Roy , Abhishek Mishra , Shirish Karande , Murari Mandal

Recently, multi-aspect controllable text generation that controls the generated text in multiple aspects (e.g., sentiment, topic, and keywords) has attracted increasing attention. Although methods based on parameter efficient tuning like…

Computation and Language · Computer Science 2023-05-30 Xuancheng Huang , Zijun Liu , Peng Li , Tao Li , Maosong Sun , Yang Liu

We present a novel approach for differentially private data synthesis of protected tabular datasets, a relevant task in highly sensitive domains such as healthcare and government. Current state-of-the-art methods predominantly use…

Machine Learning · Computer Science 2024-07-30 Konstantin Donhauser , Javier Abad , Neha Hulkund , Fanny Yang