中文
相关论文

相关论文: Privately Fine-Tuned LLMs Preserve Temporal Dynami…

200 篇论文

The need to analyze sensitive data, such as medical records or financial data, has created a critical research challenge in recent years. In this paper, we adopt the framework of differential privacy, and explore mechanisms for generating…

密码学与安全 · 计算机科学 2024-05-09 Nikolija Bojkovic , Po-Ling Loh

In differentially private (DP) tabular data synthesis, the consensus is that statistical models are better than neural network (NN)-based methods. However, we argue that this conclusion is incomplete and overlooks the challenge of densely…

机器学习 · 计算机科学 2025-11-19 Kai Chen , Chen Gong , Tianhao Wang

Motivated by privacy concerns in long-term longitudinal studies in medical and social science research, we study the problem of continually releasing differentially private synthetic data from longitudinal data collections. We introduce a…

数据结构与算法 · 计算机科学 2024-05-28 Mark Bun , Marco Gaboardi , Marcel Neunhoeffer , Wanrong Zhang

While differentially private (DP) fine-tuning of large language models (LLMs) is a powerful tool, it is often computationally prohibitive or infeasible when state-of-the-art models are only accessible via proprietary APIs. In such settings,…

计算与语言 · 计算机科学 2026-03-23 Eli Chien , Yuzheng Hu , Ryan McKenna , Shanshan Wu , Zheng Xu , Peter Kairouz

Tabular data have been playing a vital role in diverse real-world fields, including healthcare, finance, etc. With the recent success of Large Language Models (LLMs), early explorations of extending LLMs to the domain of tabular data have…

机器学习 · 计算机科学 2025-12-11 Hangting Ye , Jinmeng Li , He Zhao , Dandan Guo , Yi Chang

Synthetic healthcare data generation offers a promising solution to research limitations in clinical settings caused by privacy and regulatory constraints. However, current synthetic data generation approaches require specialized knowledge…

The development of robust clinical decision support systems is frequently impeded by the scarcity of high-fidelity, privacy-preserving biomedical data. While Generative Large Language Models (LLMs) offer a promising avenue for synthetic…

机器学习 · 计算机科学 2026-04-03 Arshia Ilaty , Hossein Shirazi , Amir Rahmani , Hajar Homayouni

In the era of big data, access to abundant data is crucial for driving research forward. However, such data is often inaccessible due to privacy concerns or high costs, particularly in healthcare domain. Generating synthetic (tabular) data…

机器学习 · 计算机科学 2026-04-10 Yaobin Ling , Xiaoqian Jiang , Yejin Kim

Synthetic data offers a promising path to train models while preserving data privacy. Differentially private (DP) finetuning of large language models (LLMs) as data generator is effective, but is impractical when computation resources are…

计算与语言 · 计算机科学 2025-07-18 Bowen Tan , Zheng Xu , Eric Xing , Zhiting Hu , Shanshan Wu

While advances in large language models (LLMs) have greatly improved the quality of synthetic text data in recent years, synthesizing tabular data has received relatively less attention. We address this disparity with Tabby, a simple but…

We propose two synthetic microdata approaches to generate private tabular survey data products for public release. We adapt a pseudo posterior mechanism that downweights by-record likelihood contributions with weights $\in [0,1]$ based on…

统计方法学 · 统计学 2022-03-07 Jingchen Hu , Terrance D. Savitsky , Matthew R. Williams

Synthetic data generation has emerged as an invaluable solution in scenarios where real-world data collection and usage are limited by cost and scarcity. Large language models (LLMs) have demonstrated remarkable capabilities in producing…

机器学习 · 计算机科学 2025-07-22 Anh Nguyen , Sam Schafft , Nicholas Hale , John Alfaro

This study introduces a set of metrics for evaluating temporal preservation in synthetic longitudinal patient data, defined as artificially generated data that mimic real patients' repeated measurements over time. The proposed metrics…

机器学习 · 计算机科学 2026-02-12 Katariina Perkonoja , Parisa Movahedi , Antti Airola , Kari Auranen , Joni Virta

Longitudinal medical report generation is clinically important yet remains challenging due to strict privacy constraints and the evolving nature of disease progression. Although federated learning (FL) enables collaborative training without…

计算机视觉与模式识别 · 计算机科学 2026-02-24 He Zhu , Ren Togo , Takahiro Ogawa , Kenji Hirata , Minghui Tang , Takaaki Yoshimura , Hiroyuki Sugimori , Noriko Nishioka , Yukie Shimizu , Kohsuke Kudo , Miki Haseyama

There are now several large scale deployments of differential privacy used to collect statistical information about users. However, these deployments periodically recollect the data and recompute the statistics using algorithms designed for…

机器学习 · 计算机科学 2018-11-21 Matthew Joseph , Aaron Roth , Jonathan Ullman , Bo Waggoner

The sharing of large-scale transportation data is beneficial for transportation planning and policymaking. However, it also raises significant security and privacy concerns, as the data may include identifiable personal information, such as…

机器学习 · 计算机科学 2025-02-14 Chengen Wang , Alvaro Cardenas , Gurcan Comert , Murat Kantarcioglu

While Multimodal Large Language Models have achieved human-like performance on many visual and textual reasoning tasks, their proficiency in fine-grained spatial understanding, such as route tracing on maps remains limited. Unlike humans,…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Artemis Panagopoulou , Aveek Purohit , Achin Kulshrestha , Soroosh Yazdani , Mohit Goyal

We introduce DP-FinDiff, a differentially private diffusion framework for synthesizing mixed-type tabular data. DP-FinDiff employs embedding-based representations for categorical features, reducing encoding overhead and scaling to…

机器学习 · 计算机科学 2025-12-02 Timur Sattarov , Marco Schreyer , Damian Borth

AI systems in healthcare research have shown potential to increase patient throughput and assist clinicians, yet progress is constrained by limited access to real patient data. To address this issue, we present a zero-shot, knowledge-guided…

We propose a general, flexible, and scalable framework dpart, an open source Python library for differentially private synthetic data generation. Central to the approach is autoregressive modelling -- breaking the joint data distribution to…

机器学习 · 计算机科学 2022-07-14 Sofiane Mahiou , Kai Xu , Georgi Ganev