English
Related papers

Related papers: I Am Not What I Write: Privacy Preserving Text Rep…

200 papers

Accurately learning from user data while providing quantifiable privacy guarantees provides an opportunity to build better ML models while maintaining user trust. This paper presents a formal approach to carrying out privacy preserving text…

Machine Learning · Computer Science 2019-10-22 Oluwaseyi Feyisetan , Borja Balle , Thomas Drake , Tom Diethe

The field of privacy-preserving Natural Language Processing has risen in popularity, particularly at a time when concerns about privacy grow with the proliferation of Large Language Models. One solution consistently appearing in recent…

Computation and Language · Computer Science 2024-10-02 Stephen Meisenbacher , Florian Matthes

With the development of Big Data and cloud data sharing, privacy preserving data publishing becomes one of the most important topics in the past decade. As one of the most influential privacy definitions, differential privacy provides a…

Cryptography and Security · Computer Science 2017-10-17 Tianqing Zhu , Ping Xiong , Gang Li , Wanlei Zhou , Philip S. Yu

Guaranteeing a certain level of user privacy in an arbitrary piece of text is a challenging issue. However, with this challenge comes the potential of unlocking access to vast data stores for training machine learning models and supporting…

Machine Learning · Computer Science 2019-10-22 Oluwaseyi Feyisetan , Tom Diethe , Thomas Drake

Accurately learning from user data while ensuring quantifiable privacy guarantees provides an opportunity to build better Machine Learning (ML) models while maintaining user trust. Recent literature has demonstrated the applicability of a…

Machine Learning · Computer Science 2020-12-11 Oluwaseyi Feyisetan , Abhinav Aggarwal , Zekun Xu , Nathanael Teissier

One of the big challenges in machine learning applications is that training data can be different from the real-world data faced by the algorithm. In language modeling, users' language (e.g. in private messaging) could change in a year and…

Computation and Language · Computer Science 2018-03-07 Vadim Popov , Mikhail Kudinov , Irina Piontkovskaya , Petr Vytovtov , Alex Nevidomsky

Machine Learning approaches to Natural Language Processing tasks benefit from a comprehensive collection of real-life user data. At the same time, there is a clear need for protecting the privacy of the users whose data is collected and…

Computation and Language · Computer Science 2022-11-16 David Ifeoluwa Adelani , Ali Davody , Thomas Kleinbauer , Dietrich Klakow

The task of text privatization using Differential Privacy has recently taken the form of $\textit{text rewriting}$, in which an input text is obfuscated via the use of generative (large) language models. While these methods have shown…

Computation and Language · Computer Science 2024-07-02 Stephen Meisenbacher , Maulik Chevli , Juraj Vladika , Florian Matthes

Natural language reflects our private lives and identities, making its privacy concerns as broad as those of real life. Language models lack the ability to understand the context and sensitivity of text, and tend to memorize phrases present…

Machine Learning · Statistics 2022-02-15 Hannah Brown , Katherine Lee , Fatemehsadat Mireshghallah , Reza Shokri , Florian Tramèr

In recent years, machine learning - particularly deep learning - has significantly impacted the field of information management. While several strategies have been proposed to restrict models from learning and memorizing sensitive…

Computation and Language · Computer Science 2024-07-10 Jiajia Li , Lu Yang , Letian Peng , Shitou Zhang , Ping Wang , Zuchao Li , Hai Zhao

The widespread use of cloud-based Large Language Models (LLMs) has heightened concerns over user privacy, as sensitive information may be inadvertently exposed during interactions with these services. To protect privacy before sending…

Computation and Language · Computer Science 2025-05-28 Shuo Huang , William MacLean , Xiaoxi Kang , Qiongkai Xu , Zhuang Li , Xingliang Yuan , Gholamreza Haffari , Lizhen Qu

The goal of differentially private text obfuscation is to obfuscate, or "perturb", input texts with Differential Privacy (DP) guarantees, such that the private output texts are quantifiably indistinguishable from the originals. While…

Computation and Language · Computer Science 2026-05-05 Stephen Meisenbacher , Angelo Kleinert , Florian Matthes

Prompt privacy is crucial, especially when using online large language models (LLMs), due to the sensitive information often contained within prompts. While LLMs can enhance prompt privacy through text rewriting, existing methods primarily…

Computation and Language · Computer Science 2025-11-18 Mingchen Li , Heng Fan , Song Fu , Junhua Ding , Yunhe Feng

Deep neural networks have become a primary tool for solving problems in many fields. They are also used for addressing information retrieval problems and show strong performance in several tasks. Training these models requires large,…

Information Retrieval · Computer Science 2017-07-25 Mostafa Dehghani , Hosein Azarbonyad , Jaap Kamps , Maarten de Rijke

The problem of obfuscating the authorship of a text document has received little attention in the literature to date. Current approaches are ad-hoc and rely on assumptions about an adversary's auxiliary knowledge which makes it difficult to…

Cryptography and Security · Computer Science 2018-05-24 Natasha Fernandes , Mark Dras , Annabelle McIver

As the issues of privacy and trust are receiving increasing attention within the research community, various attempts have been made to anonymize textual data. A significant subset of these approaches incorporate differentially private…

Cryptography and Security · Computer Science 2022-05-05 Justus Mattern , Benjamin Weggenmann , Florian Kerschbaum

It has been demonstrated that hidden representation learned by a deep model can encode private information of the input, hence can be exploited to recover such information with reasonable accuracy. To address this issue, we propose a novel…

Machine Learning · Computer Science 2020-10-06 Lingjuan Lyu , Xuanli He , Yitong Li

Generative AI offers transformative potential for high-stakes domains such as healthcare and finance, yet privacy and regulatory barriers hinder the use of real-world data. To address this, differentially private synthetic data generation…

The success of deep learning partially benefits from the availability of various large-scale datasets. These datasets are often crowdsourced from individual users and contain private information like gender, age, etc. The emerging privacy…

Machine Learning · Computer Science 2020-09-01 Ang Li , Yixiao Duan , Huanrui Yang , Yiran Chen , Jianlei Yang

Differential Privacy (DP) has been tailored to address the unique challenges of text-to-text privatization. However, text-to-text privatization is known for degrading the performance of language models when trained on perturbed text.…

Computation and Language · Computer Science 2023-10-18 Stefan Arnold , Nils Kemmerzell , Annika Schreiner