English
Related papers

Related papers: DP-SelFT: Differentially Private Selective Fine-Tu…

200 papers

To defend the inference attacks and mitigate the sensitive information leakages in Federated Learning (FL), client-level Differentially Private FL (DPFL) is the de-facto standard for privacy protection by clipping local updates and adding…

Machine Learning · Computer Science 2023-05-03 Yifan Shi , Kang Wei , Li Shen , Yingqi Liu , Xueqian Wang , Bo Yuan , Dacheng Tao

Despite demonstrating superior performance across a variety of linguistic tasks, pre-trained large language models (LMs) often require fine-tuning on specific datasets to effectively address different downstream tasks. However, fine-tuning…

Computation and Language · Computer Science 2024-10-02 Zhidong Gao , Yu Zhang , Zhenxiao Zhang , Yanmin Gong , Yuanxiong Guo

Machine learning models should not reveal particular information that is not otherwise accessible. Differential privacy provides a formal framework to mitigate privacy risks by ensuring that the inclusion or exclusion of any single data…

Cryptography and Security · Computer Science 2026-03-12 Francisco Aguilera-Martínez , Fernando Berzal

Differentially private (DP) synthetic data is a versatile tool for enabling the analysis of private data. Recent advancements in large language models (LLMs) have inspired a number of algorithm techniques for improving DP synthetic data…

Machine Learning · Computer Science 2025-02-11 Marika Swanberg , Ryan McKenna , Edo Roth , Albert Cheu , Peter Kairouz

Differentially Private Federated Learning (DPFL) strengthens privacy protection by perturbing model gradients with noise, though at the cost of reduced accuracy. Although prior empirical studies indicate that initializing from pre-trained…

Machine Learning · Computer Science 2025-10-10 Huitong Jin , Yipeng Zhou , Quan Z. Sheng , Shiting Wen , Laizhong Cui

Differential privacy (DP) is crucial for safeguarding sensitive client information in federated learning (FL), yet traditional DP-FL methods rely predominantly on fixed gradient clipping thresholds. Such static clipping neglects significant…

Cryptography and Security · Computer Science 2026-03-26 Hao Zhou , Siqi Cai , Hua Dai , Geng Yang , Jing Luo , Hui Cai

The rapid development of language models (LMs) brings unprecedented accessibility and usage for both models and users. On the one hand, powerful LMs achieve state-of-the-art performance over numerous downstream NLP tasks. On the other hand,…

Computation and Language · Computer Science 2024-06-04 Haoran Li , Dadi Guo , Donghao Li , Wei Fan , Qi Hu , Xin Liu , Chunkit Chan , Duanyi Yao , Yuan Yao , Yangqiu Song

Positioned between pre-training and user deployment, aligning large language models (LLMs) through reinforcement learning (RL) has emerged as a prevailing strategy for training instruction following-models such as ChatGPT. In this work, we…

Machine Learning · Computer Science 2024-05-06 Fan Wu , Huseyin A. Inan , Arturs Backurs , Varun Chandrasekaran , Janardhan Kulkarni , Robert Sim

The field of privacy-preserving Natural Language Processing has risen in popularity, particularly at a time when concerns about privacy grow with the proliferation of Large Language Models. One solution consistently appearing in recent…

Computation and Language · Computer Science 2024-10-02 Stephen Meisenbacher , Florian Matthes

Density-adaptive domain discretization is essential for high-utility privacy-preserving analytics but remains challenging under Local Differential Privacy (LDP) due to the privacy-budget costs associated with iterative refinement. We…

Machine Learning · Computer Science 2026-02-24 Alexey Kroshnin , Alexandra Suvorikova

Federated Learning (FL) offers a decentralized framework for training and fine-tuning Large Language Models (LLMs) by leveraging computational resources across organizations while keeping sensitive data on local devices. It addresses…

Cryptography and Security · Computer Science 2026-05-20 Md Jueal Mia , M. Hadi Amini

Personalized federated learning is extensively utilized in scenarios characterized by data heterogeneity, facilitating more efficient and automated local training on data-owning terminals. This includes the automated selection of…

Machine Learning · Computer Science 2025-04-29 Chuanyin Wang , Yifei Zhang , Neng Gao , Qiang Luo

The emergence and evolution of Local Differential Privacy (LDP) and its various adaptations play a pivotal role in tackling privacy issues related to the vast amounts of data generated by intelligent devices, which are crucial for…

Cryptography and Security · Computer Science 2024-01-26 Likun Qin , Tianshuo Qiu

We demonstrate that it is possible to train large recurrent language models with user-level differential privacy guarantees with only a negligible cost in predictive accuracy. Our work builds on recent advances in the training of deep…

Machine Learning · Computer Science 2018-02-27 H. Brendan McMahan , Daniel Ramage , Kunal Talwar , Li Zhang

In-context learning (ICL) is an important capability of Large Language Models (LLMs), enabling these models to dynamically adapt based on specific, in-context exemplars, thereby improving accuracy and relevance. However, LLM's responses may…

Machine Learning · Computer Science 2023-10-03 Tong Wu , Ashwinee Panda , Jiachen T. Wang , Prateek Mittal

Large language models (LLMs) have shown remarkable abilities in diverse natural language processing (NLP) tasks. The LLMs generally undergo supervised fine-tuning (SFT) followed by preference alignment to be usable in downstream…

Computation and Language · Computer Science 2024-06-27 Shiva Kumar Pentyala , Zhichao Wang , Bin Bi , Kiran Ramnath , Xiang-Bo Mao , Regunathan Radhakrishnan , Sitaram Asur , Na , Cheng

The capabilities of Large Language Models (LLMs) are limited to some extent by pre-training, so some researchers optimize LLMs through post-training. Existing post-training strategies, such as memory-based retrieval or preference…

Computation and Language · Computer Science 2025-07-22 Haoran Sun , Zekun Zhang , Shaoning Zeng

Decentralized Federated Learning (DFL) enables collaborative model training without a central server, but it remains vulnerable to privacy leakage because shared model updates can expose sensitive information through inversion,…

Cryptography and Security · Computer Science 2025-12-09 Fardin Jalil Piran , Zhiling Chen , Yang Zhang , Qianyu Zhou , Jiong Tang , Farhad Imani

Data holders are increasingly seeking to protect their user's privacy, whilst still maximizing their ability to produce machine models with high quality predictions. In this work, we empirically evaluate various implementations of…

Cryptography and Security · Computer Science 2020-09-16 Benjamin Zi Hao Zhao , Mohamed Ali Kaafar , Nicolas Kourtellis

Nowadays, machine learning models and applications have become increasingly pervasive. With this rapid increase in the development and employment of machine learning models, a concern regarding privacy has risen. Thus, there is a legitimate…

Machine Learning · Computer Science 2022-11-22 Samah Baraheem , Zhongmei Yao