中文
相关论文

相关论文: Privately Fine-Tuned LLMs Preserve Temporal Dynami…

200 篇论文

Federated learning (FL) enables training large language models (LLMs) without sharing raw data, but adapting LLMs under strict data isolation and non-IID client distributions remains challenging in practice. Synthetic data offers a natural…

Differentially private (DP) synthetic data generation plays a pivotal role in developing large language models (LLMs) on private data, where data owners cannot provide eyes-on access to individual examples. Generating DP synthetic data…

Tabular data is common yet typically incomplete, small in volume, and access-restricted due to privacy concerns. Synthetic data generation offers potential solutions. Many metrics exist for evaluating the quality of synthetic tabular data;…

机器学习 · 计算机科学 2024-04-01 Scott Cheng-Hsin Yang , Baxter Eaves , Michael Schmidt , Ken Swanson , Patrick Shafto

In a world where artificial intelligence and data science become omnipresent, data sharing is increasingly locking horns with data-privacy concerns. Differential privacy has emerged as a rigorous framework for protecting individual privacy…

密码学与安全 · 计算机科学 2022-06-06 March Boedihardjo , Thomas Strohmer , Roman Vershynin

Tabular data, widely used in various applications such as industrial control systems, finance, and supply chain, often contains complex interrelationships among its attributes. Data disentanglement seeks to transform such data into latent…

The dissemination of synthetic data can be an effective means of making information from sensitive data publicly available while reducing the risk of disclosure associated with releasing the sensitive data directly. While mechanisms exist…

统计方法学 · 统计学 2021-09-23 Harrison Quick

Privacy-preserving synthetic data offers a promising solution to harness segregated data in high-stakes domains where information is compartmentalized for regulatory, privacy, or institutional reasons. This survey provides a comprehensive…

密码学与安全 · 计算机科学 2025-03-28 Viktor Schlegel , Anil A Bharath , Zilong Zhao , Kevin Yee

Tabular data synthesis involves not only multi-table synthesis but also generating multi-modal data (e.g., strings and categories), which enables diverse knowledge synthesis. However, separating numerical and categorical data has limited…

机器学习 · 计算机科学 2025-03-21 Tung Sum Thomas Kwok , Chi-Hua Wang , Guang Cheng

In this paper we demonstrate that, ignoring computational constraints, it is possible to privately release synthetic databases that are useful for large classes of queries -- much larger in size than the database itself. Specifically, we…

数据结构与算法 · 计算机科学 2011-09-13 Avrim Blum , Katrina Ligett , Aaron Roth

We present an approach for generating differentially private synthetic text using large language models (LLMs), via private prediction. In the private prediction framework, we only require the output synthetic data to satisfy differential…

Generating high-fidelity synthetic tabular data remains a critical challenge for enhancing data availability in privacy-sensitive and low-resource domains. Recent approaches leverage LLMs by representing table rows as sequences, yet suffer…

机器学习 · 计算机科学 2026-04-28 Shuo Yang , Zheyu Zhang , Bardh Prenkaj , Gjergji Kasneci

Large language models (LLMs) are increasingly used in daily applications, from content generation to code writing, where each interaction treats the model as stateless, generating responses independently without memory. Yet human writing is…

计算与语言 · 计算机科学 2026-04-15 Zhanwei Cao , YeoJin Go , Yifan Hu , Shanu Sushmita

Preserving individual privacy while enabling collaborative data sharing is crucial for organizations. Synthetic data generation is one solution, producing artificial data that mirrors the statistical properties of private data. While…

密码学与安全 · 计算机科学 2024-09-06 Samuel Maddock , Graham Cormode , Carsten Maple

Augmenting large language models (LLMs) with external tools is a promising approach to enhance their capabilities, especially for complex tasks. Synthesizing tool-use data through real-world simulations is an effective way to achieve this.…

计算与语言 · 计算机科学 2025-11-10 Yirong Zeng , Xiao Ding , Yuxian Wang , Weiwen Liu , Wu Ning , Yutai Hou , Xu Huang , Duyu Tang , Dandan Tu , Bing Qin , Ting Liu

Generating high-fidelity synthetic tabular data under formal differential privacy guarantees remains an open challenge. Methods that provide strong theoretical protection typically sacrifice the modeling of inter-feature dependencies…

机器学习 · 计算机科学 2026-05-27 M. Youssef , M. Woźniak

Tabular data synthesis is crucial in machine learning, yet existing general methods-primarily based on statistical or deep learning models-are highly data-dependent and often fall short in recommender systems. This limitation arises from…

信息检索 · 计算机科学 2025-02-12 Jingtong Gao , Zhaocheng Du , Xiaopeng Li , Yichao Wang , Xiangyang Li , Huifeng Guo , Ruiming Tang , Xiangyu Zhao

Task-oriented dialogue systems often assist users with personal or confidential matters. For this reason, the developers of such a system are generally prohibited from observing actual usage. So how can they know where the system is failing…

计算与语言 · 计算机科学 2023-06-12 Fatemehsadat Mireshghallah , Yu Su , Tatsunori Hashimoto , Jason Eisner , Richard Shin

Despite recent advances in synthetic data generation, the scientific community still lacks a unified consensus on its usefulness. It is commonly believed that synthetic data can be used for both data exchange and boosting machine learning…

机器学习 · 计算机科学 2023-06-28 Dionysis Manousakas , Sergül Aydöre

Synthetic data generation is gaining traction as a privacy enhancing technology (PET). When properly generated, synthetic data preserve the analytic utility of real data while avoiding the retention of information that would allow the…

Synthetic tabular data, which are widely used in domains such as healthcare, enterprise operations, and customer analytics, are increasingly evaluated to ensure that they preserve both privacy and utility. While existing evaluation…

机器学习 · 计算机科学 2025-11-25 Ke Yu , Shigeru Ishikura , Yukari Usukura , Yuki Shigoku , Teruaki Hayashi