English
Related papers

Related papers: EPSVec: Efficient and Private Synthetic Data Gener…

200 papers

Our ability to synthesize sensory data that preserves specific statistical properties of the real data has had tremendous implications on data privacy and big data analytics. The synthetic data can be used as a substitute for selective real…

Machine Learning · Computer Science 2017-02-01 Moustafa Alzantot , Supriyo Chakraborty , Mani B. Srivastava

Large Language Models (LLMs) such as GPT-4 and Llama3 have significantly impacted various fields by enabling high-quality synthetic data generation and reducing dependence on expensive human-generated datasets. Despite this, challenges…

Computation and Language · Computer Science 2025-11-18 Yue Huang , Siyuan Wu , Chujie Gao , Dongping Chen , Qihui Zhang , Yao Wan , Tianyi Zhou , Jianfeng Gao , Chaowei Xiao , Lichao Sun , Xiangliang Zhang

Substantial quantity and high quality are the golden rules of making a good training dataset with sample privacy protection equally important. Generating synthetic samples that resemble high-quality private data while ensuring Differential…

Machine Learning · Computer Science 2025-02-04 Tianyuan Zou , Yang Liu , Peng Li , Yufei Xiong , Jianqing Zhang , Jingjing Liu , Xiaozhou Ye , Ye Ouyang , Ya-Qin Zhang

Training models to high-end performance requires availability of large labeled datasets, which are expensive to get. The goal of our work is to automatically synthesize labeled datasets that are relevant for a downstream task. We propose…

Computer Vision and Pattern Recognition · Computer Science 2019-04-29 Amlan Kar , Aayush Prakash , Ming-Yu Liu , Eric Cameracci , Justin Yuan , Matt Rusiniak , David Acuna , Antonio Torralba , Sanja Fidler

While modern machine learning models rely on increasingly large training datasets, data is often limited in privacy-sensitive domains. Generative models trained with differential privacy (DP) on sensitive data can sidestep this challenge,…

Machine Learning · Statistics 2024-01-02 Tim Dockhorn , Tianshi Cao , Arash Vahdat , Karsten Kreis

The unavailability of training data is a permanent source of much frustration in research, especially when it is due to privacy concerns. This is particularly true for location data since previous techniques all suffer from the inherent…

Cryptography and Security · Computer Science 2022-03-15 Szilvia Lestyán , Gergely Ács , Gergely Biczók

How can we release a massive volume of sensitive data while mitigating privacy risks? Privacy-preserving data synthesis enables the data holder to outsource analytical tasks to an untrusted third party. The state-of-the-art approach for…

Machine Learning · Computer Science 2022-03-08 Shun Takagi , Tsubasa Takahashi , Yang Cao , Masatoshi Yoshikawa

The recent surge in research focused on generating synthetic data from large language models (LLMs), especially for scenarios with limited data availability, marks a notable shift in Generative Artificial Intelligence (AI). Their ability to…

Machine Learning · Computer Science 2024-03-08 Xu Guo , Yiqiang Chen

Simulation is increasingly being used for generating large labelled datasets in many machine learning problems. Recent methods have focused on adjusting simulator parameters with the goal of maximising accuracy on a validation task, usually…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Harkirat Singh Behl , Atılım Güneş Baydin , Ran Gal , Philip H. S. Torr , Vibhav Vineet

Analyzing medical data to find abnormalities is a time-consuming and costly task, particularly for rare abnormalities, requiring tremendous efforts from medical experts. Artificial intelligence has become a popular tool for the automatic…

Recent advancements in generative AI have made it possible to create synthetic datasets that can be as accurate as real-world data for training AI models, powering statistical insights, and fostering collaboration with sensitive datasets…

Machine Learning · Computer Science 2025-01-08 Amy Steier , Lipika Ramaswamy , Andre Manoel , Alexa Haushalter

Large Language Models (LLMs) have demonstrated remarkable multilingual capabilities, making them promising tools in both high- and low-resource languages. One particularly valuable use case is generating synthetic samples that can be used…

Computation and Language · Computer Science 2026-01-26 Branislav Pecher , Jan Cegin , Robert Belanec , Ivan Srba , Jakub Simko , Maria Bielikova

The increasing reliance on Large Language Models (LLMs) across diverse sectors highlights the need for robust domain-specific and language-specific evaluation datasets; however, the collection of such datasets is challenging due to privacy…

Artificial Intelligence · Computer Science 2026-04-28 Alessio Sordo , Lingxiao Du , Meeka-Hanna Lenisa , Evgeny Bogdanov , Maxim Romanovsky

Vector representations have been pivotal in advancing natural language processing (NLP), with prior research focusing on embedding techniques for mathematical expressions using mathematically equivalent formulations. While effective, these…

Machine Learning · Computer Science 2025-03-11 Hongbo Zheng , Suyuan Wang , Neeraj Gangwar , Nickvash Kani

Existing code large language models (LLMs) often rely on large-scale instruction data distilled from proprietary LLMs for fine-tuning, which typically incurs high costs. In this paper, we explore the potential of small-scale open-source…

Artificial Intelligence · Computer Science 2025-09-10 Xinyu Zhang , Changzhi Zhou , Linmei Hu , Luhao Zhang , Xiancai Chen , Haomin Fu , Yang Yang , Mengdi Zhang

Releasing relational databases while preserving privacy is an important research problem with numerous applications. A canonical approach is to generate synthetic data under differential privacy (DP), which provides a strong, rigorous…

Databases · Computer Science 2025-04-01 Kuntai Cai , Xiaokui Xiao , Yin Yang

Process data with confidential information cannot be shared directly in public, which hinders the research in process data mining and analytics. Data encryption methods have been studied to protect the data, but they still may be decrypted,…

Machine Learning · Computer Science 2022-03-16 Keyi Li , Sen Yang , Travis M. Sullivan , Randall S. Burd , Ivan Marsic

Searchable Symmetric Encryption (SSE) enables efficient search capabilities over encrypted data, allowing users to maintain privacy while utilizing cloud storage. However, SSE schemes are vulnerable to leakage attacks that exploit access…

Cryptography and Security · Computer Science 2025-04-30 Joshua Chiu , Partha Protim Paul , Zahin Wahab

While deep learning techniques have proven successful in image-related tasks, the exponentially increased data storage and computation costs become a significant challenge. Dataset distillation addresses these challenges by synthesizing…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Zhe Li , Weitong Zhang , Sarah Cechnicka , Bernhard Kainz

Deep generative models are often trained on sensitive data, such as genetic sequences, health data, or more broadly, any copyrighted, licensed or protected content. This raises critical concerns around privacy-preserving synthetic data, and…