English
Related papers

Related papers: 1-Diffractor: Efficient and Utility-Preserving Tex…

200 papers

Fine-tuning large language models (LLMs) for specific tasks introduces privacy risks, as models may inadvertently memorise and leak sensitive training data. While Differential Privacy (DP) offers a solution to mitigate these risks, it…

Machine Learning · Computer Science 2024-11-26 Olivia Ma , Jonathan Passerat-Palmbach , Dmitrii Usynin

In recent years, machine learning - particularly deep learning - has significantly impacted the field of information management. While several strategies have been proposed to restrict models from learning and memorizing sensitive…

Computation and Language · Computer Science 2024-07-10 Jiajia Li , Lu Yang , Letian Peng , Shitou Zhang , Ping Wang , Zuchao Li , Hai Zhao

As the tide of Big Data continues to influence the landscape of Natural Language Processing (NLP), the utilization of modern NLP methods has grounded itself in this data, in order to tackle a variety of text-based tasks. These methods…

Computation and Language · Computer Science 2022-08-18 Oleksandra Klymenko , Stephen Meisenbacher , Florian Matthes

As large language models (LLMs) increasingly underpin technological advancements, the privacy of their training data emerges as a critical concern. Differential Privacy (DP) serves as a rigorous mechanism to protect this data, yet its…

Machine Learning · Computer Science 2025-07-03 Liangyu Wang , Junxiao Wang , Jie Ren , Zihang Xiang , David E. Keyes , Di Wang

Large language models have repeatedly shown outstanding performance across diverse applications. However, deploying these models can inadvertently risk user privacy. The significant memory demands during training pose a major challenge in…

Cryptography and Security · Computer Science 2025-02-21 Yanming Liu , Xinyue Peng , Yuwei Zhang , Xiaolan Ke , Songhang Deng , Jiannan Cao , Chen Ma , Mengchen Fu , Tianyu Du , Sheng Cheng , Xun Wang , Jianwei Yin , Xuhong Zhang

When collecting information, local differential privacy (LDP) alleviates privacy concerns of users because their private information is randomized before being sent it to the central aggregator. LDP imposes large amount of noise as each…

Cryptography and Security · Computer Science 2020-08-04 Tianhao Wang , Bolin Ding , Min Xu , Zhicong Huang , Cheng Hong , Jingren Zhou , Ninghui Li , Somesh Jha

It has been demonstrated that hidden representation learned by a deep model can encode private information of the input, hence can be exploited to recover such information with reasonable accuracy. To address this issue, we propose a novel…

Machine Learning · Computer Science 2020-10-06 Lingjuan Lyu , Xuanli He , Yitong Li

To protect the privacy of individuals whose data is being shared, it is of high importance to develop methods allowing researchers and companies to release textual data while providing formal privacy guarantees to its originators. In the…

Machine Learning · Computer Science 2022-10-27 Justus Mattern , Zhijing Jin , Benjamin Weggenmann , Bernhard Schoelkopf , Mrinmaya Sachan

Fine-tuning large language models (LLMs) has become an essential strategy for adapting them to specialized tasks; however, this process introduces significant privacy challenges, as sensitive training data may be inadvertently memorized and…

Cryptography and Security · Computer Science 2025-05-02 Hao Du , Shang Liu , Yang Cao

Texts convey sophisticated knowledge. However, texts also convey sensitive information. Despite the success of general-purpose language models and domain-specific mechanisms with differential privacy (DP), existing text sanitization…

Computation and Language · Computer Science 2021-06-03 Xiang Yue , Minxin Du , Tianhao Wang , Yaliang Li , Huan Sun , Sherman S. M. Chow

Applying differential privacy (DP) by means of the DP-SGD algorithm to protect individual data points during training is becoming increasingly popular in NLP. However, the choice of granularity at which DP is applied is often neglected. For…

Computation and Language · Computer Science 2024-09-27 Doan Nam Long Vu , Timour Igamberdiev , Ivan Habernal

The growing popularity and adoption of differential privacy in academic and industrial settings has resulted in the development of increasingly sophisticated algorithms for releasing information while preserving privacy. Accompanying this…

Programming Languages · Computer Science 2016-12-13 Danfeng Zhang , Daniel Kifer

Pre-trained Large Language Models (LLMs) are an integral part of modern AI that have led to breakthrough performances in complex AI tasks. Major AI companies with expensive infrastructures are able to develop and train these large models…

Cryptography and Security · Computer Science 2023-05-02 Rouzbeh Behnia , Mohamamdreza Ebrahimi , Jason Pacheco , Balaji Padmanabhan

User language data can contain highly sensitive personal content. As such, it is imperative to offer users a strong and interpretable privacy guarantee when learning from their data. In this work, we propose SentDP: pure local differential…

Machine Learning · Computer Science 2022-05-11 Casey Meehan , Khalil Mrini , Kamalika Chaudhuri

This article deals with adversarial attacks towards deep learning systems for Natural Language Processing (NLP), in the context of privacy protection. We study a specific type of attack: an attacker eavesdrops on the hidden representations…

Computation and Language · Computer Science 2018-08-29 Maximin Coavoux , Shashi Narayan , Shay B. Cohen

Fine-tuning large language models on downstream tasks is crucial for realizing their cross-domain potential but often relies on sensitive data, raising privacy concerns. Differential privacy (DP) offers rigorous privacy guarantees and has…

Machine Learning · Computer Science 2026-01-19 Lele Zheng , Xiang Wang , Tao Zhang , Yang Cao , Ke Cheng , Yulong Shen

The task of text privatization using Differential Privacy has recently taken the form of $\textit{text rewriting}$, in which an input text is obfuscated via the use of generative (large) language models. While these methods have shown…

Computation and Language · Computer Science 2024-07-02 Stephen Meisenbacher , Maulik Chevli , Juraj Vladika , Florian Matthes

Large Language models (LLMs) are achieving state-of-the-art performance in many different downstream tasks. However, the increasing urgency of data privacy puts pressure on practitioners to train LLMs with Differential Privacy (DP) on…

Machine Learning · Computer Science 2025-12-17 James Flemings , Murali Annavaram

We propose a privacy-preserving method for sharing text data by sharing noisy versions of their transformer embeddings. It has been shown that hidden representations learned by deep models can encode sensitive information from the input,…

Machine Learning · Computer Science 2026-01-15 Dina El Zein , James Henderson

Privatized text rewriting with local differential privacy (LDP) is a recent approach that enables sharing of sensitive textual documents while formally guaranteeing privacy protection to individuals. However, existing systems face several…

Cryptography and Security · Computer Science 2025-08-14 Timour Igamberdiev , Ivan Habernal