English
Related papers

Related papers: Towards Robust and Privacy-preserving Text Represe…

200 papers

Machine learning models are vulnerable to both security attacks (e.g., adversarial examples) and privacy attacks (e.g., private attribute inference). We take the first step to mitigate both the security and privacy attacks, and maintain…

Machine Learning · Computer Science 2024-12-17 Binghui Zhang , Sayedeh Leila Noorbakhsh , Yun Dong , Yuan Hong , Binghui Wang

Authorship obfuscation techniques hold the promise of helping people protect their privacy in online communications by automatically rewriting text to hide the identity of the original author. However, obfuscation has been evaluated in…

Computation and Language · Computer Science 2024-05-17 Calvin Bao , Marine Carpuat

Online users generate tremendous amounts of textual information by participating in different activities, such as writing reviews and sharing tweets. This textual data provides opportunities for researchers and business partners to study…

Cryptography and Security · Computer Science 2019-07-09 Ghazaleh Beigi , Kai Shu , Ruocheng Guo , Suhang Wang , Huan Liu

In this work, we address the problem of text anonymization where the goal is to prevent adversaries from correctly inferring private attributes of the author, while keeping the text utility, i.e., meaning and semantics. We propose…

Cryptography and Security · Computer Science 2025-02-04 Ahmed Frikha , Nassim Walha , Krishna Kanth Nakka , Ricardo Mendes , Xue Jiang , Xuebing Zhou

Contextual word representations generated by language models (LMs) learn spurious associations present in the training corpora. Recent findings reveal that adversaries can exploit these associations to reverse-engineer the private…

Computation and Language · Computer Science 2021-12-08 Geetanjali Bihani

Language models are widely deployed to provide automatic text completion services in user products. However, recent research has revealed that language models (especially large ones) bear considerable risk of memorizing private training…

Computation and Language · Computer Science 2022-12-19 C. M. Downey , Wei Dai , Huseyin A. Inan , Kim Laine , Saurabh Naik , Tomasz Religa

Large scale adoption of large language models has introduced a new era of convenient knowledge transfer for a slew of natural language processing tasks. However, these models also run the risk of undermining user trust by exposing unwanted…

Computation and Language · Computer Science 2022-04-21 Richard Plant , Valerio Giuffrida , Dimitra Gkatzia

Automatically disentangling an author's style from the content of their writing is a longstanding and possibly insurmountable problem in computational linguistics. At the same time, the availability of large text corpora furnished with…

Computation and Language · Computer Science 2023-08-28 Andrew Wang , Cristina Aggazzotti , Rebecca Kotula , Rafael Rivera Soto , Marcus Bishop , Nicholas Andrews

Differential Privacy (DP) has been tailored to address the unique challenges of text-to-text privatization. However, text-to-text privatization is known for degrading the performance of language models when trained on perturbed text.…

Computation and Language · Computer Science 2023-10-18 Stefan Arnold , Nils Kemmerzell , Annika Schreiner

Adversarial training was introduced as a way to improve the robustness of deep learning models to adversarial attacks. This training method improves robustness against adversarial attacks, but increases the models vulnerability to privacy…

Text prediction models, when used in applications like email clients or word processors, must protect user data privacy and adhere to model size constraints. These constraints are crucial to meet memory and inference time requirements, as…

Machine Learning · Computer Science 2024-07-03 Da Yu , Sivakanth Gopi , Janardhan Kulkarni , Zinan Lin , Saurabh Naik , Tomasz Lukasz Religa , Jian Yin , Huishuai Zhang

It has been shown in the field of Author Profiling that texts may inadvertently reveal sensitive information about their authors, such as gender or age. This raises important privacy concerns that have been extensively addressed in the…

Computation and Language · Computer Science 2024-12-18 Martin Borquez , Mikaela Keller , Michael Perrot , Damien Sileo

Large language models are shown to memorize privacy information such as social security numbers in training data. Given the sheer scale of the training corpus, it is challenging to screen and filter these privacy data, either manually or…

Computation and Language · Computer Science 2022-06-27 Xuandong Zhao , Lei Li , Yu-Xiang Wang

Data privacy has emerged as an important issue as data-driven deep learning has been an essential component of modern machine learning systems. For instance, there could be a potential privacy risk of machine learning systems via the model…

Machine Learning · Computer Science 2019-11-25 Taihong Xiao , Yi-Hsuan Tsai , Kihyuk Sohn , Manmohan Chandraker , Ming-Hsuan Yang

Natural language processing (NLP) models may leak private information in different ways, including membership inference, reconstruction or attribute inference attacks. Sensitive information may not be explicit in the text, but hidden in…

Computation and Language · Computer Science 2024-07-01 Pedro Faustini , Shakila Mahjabin Tonni , Annabelle McIver , Qiongkai Xu , Mark Dras

Several domains increasingly rely on machine learning in their applications. The resulting heavy dependence on data has led to the emergence of various laws and regulations around data ethics and privacy and growing awareness of the need…

Machine Learning · Computer Science 2023-09-11 Sofiane Ouaari , Ali Burak Ünal , Mete Akgün , Nico Pfeifer

We address the problem of how to "obfuscate" texts by removing stylistic clues which can identify authorship, whilst preserving (as much as possible) the content of the text. In this paper we combine ideas from "generalised differential…

Cryptography and Security · Computer Science 2019-02-06 Natasha Fernandes , Mark Dras , Annabelle McIver

Ensuring the privacy of sensitive data used to train modern machine learning models is of paramount importance in many areas of practice. One recent popular approach to study these concerns is using the differential privacy via a…

Cryptography and Security · Computer Science 2020-07-29 Lichao Sun , Ji Wang , Philip S. Yu , Lifang He

This article deals with adversarial attacks towards deep learning systems for Natural Language Processing (NLP), in the context of privacy protection. We study a specific type of attack: an attacker eavesdrops on the hidden representations…

Computation and Language · Computer Science 2018-08-29 Maximin Coavoux , Shashi Narayan , Shay B. Cohen

Text-based analysis methods allow to reveal privacy relevant author attributes such as gender, age and identify of the text's author. Such methods can compromise the privacy of an anonymous author even when the author tries to remove…

Cryptography and Security · Computer Science 2018-02-20 Rakshith Shetty , Bernt Schiele , Mario Fritz
‹ Prev 1 2 3 10 Next ›