English
Related papers

Related papers: Privacy-preserving Neural Representations of Text

200 papers

Differential privacy (DP) is applied when fine-tuning pre-trained large language models (LLMs) to limit leakage of training examples. While most DP research has focused on improving a model's privacy-utility tradeoff, some find that DP can…

Computation and Language · Computer Science 2024-10-25 Md. Khairul Islam , Andrew Wang , Tianhao Wang , Yangfeng Ji , Judy Fox , Jieyu Zhao

Adversarial attacks have become a major threat for machine learning applications. There is a growing interest in studying these attacks in the audio domain, e.g, speech and speaker recognition; and find defenses against them. In this work,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-12 Jesús Villalba , Sonal Joshi , Piotr Żelasko , Najim Dehak

Recent studies show that neural natural language processing (NLP) models are vulnerable to backdoor attacks. Injected with backdoors, models perform normally on benign examples but produce attacker-specified predictions when the backdoor is…

Computation and Language · Computer Science 2021-06-14 Fanchao Qi , Yuan Yao , Sophia Xu , Zhiyuan Liu , Maosong Sun

In recent years, with the development of cloud computing platforms, privacy-preserving methods for deep learning have become an urgent problem. NeuraCrypt is a private random neural network for privacy-preserving that allows data owners to…

Cryptography and Security · Computer Science 2023-01-13 Zheng Qi , AprilPyone MaungMaung , Hitoshi Kiya

From face recognition systems installed in phones to self-driving cars, the field of AI is witnessing rapid transformations and is being integrated into our everyday lives at an incredible pace. Any major failure in these system's…

Cryptography and Security · Computer Science 2020-12-14 Ayush Goel

At present, backdoor attacks attract attention as they do great harm to deep learning models. The adversary poisons the training data making the model being injected with a backdoor after being trained unconsciously by victims using the…

Cryptography and Security · Computer Science 2023-03-06 Shengfang Zhai , Qingni Shen , Xiaoyi Chen , Weilong Wang , Cong Li , Yuejian Fang , Zhonghai Wu

Adversarial Training (AT) is crucial for obtaining deep neural networks that are robust to adversarial attacks, yet recent works found that it could also make models more vulnerable to privacy attacks. In this work, we further reveal this…

Machine Learning · Computer Science 2022-02-23 Jingyang Zhang , Yiran Chen , Hai Li

Scientific collaborations benefit from collaborative learning of distributed sources, but remain difficult to achieve when data are sensitive. In recent years, privacy preserving techniques have been widely studied to analyze distributed…

Cryptography and Security · Computer Science 2022-06-30 Guanhong Miao , A. Adam Ding , Samuel S. Wu

The application of differential privacy to the training of deep neural networks holds the promise of allowing large-scale (decentralized) use of sensitive data while providing rigorous privacy guarantees to the individual. The predominant…

Machine Learning · Computer Science 2021-08-11 Moritz Knolle , Dmitrii Usynin , Alexander Ziller , Marcus R. Makowski , Daniel Rueckert , Georgios Kaissis

Machine learning (ML) is vulnerable to inference (e.g., membership inference, property inference, and data reconstruction) attacks that aim to infer the private information of training data or dataset. Existing defenses are only designed…

Machine Learning · Computer Science 2024-03-05 Sayedeh Leila Noorbakhsh , Binghui Zhang , Yuan Hong , Binghui Wang

Privacy preservation remains a key challenge in data mining and Natural Language Understanding (NLU). Previous research shows that the input text or even text embeddings can leak private information. This concern motivates our research on…

Computation and Language · Computer Science 2021-08-23 Chen Qu , Weize Kong , Liu Yang , Mingyang Zhang , Michael Bendersky , Marc Najork

Graph convolutional networks (GCNs) are a powerful architecture for representation learning on documents that naturally occur as graphs, e.g., citation or social networks. However, sensitive personal information, such as documents with…

Social and Information Networks · Computer Science 2022-05-03 Timour Igamberdiev , Ivan Habernal

The use of Natural Language Processing (NLP) in highstakes AI-based applications has increased significantly in recent years, especially since the emergence of Large Language Models (LLMs). However, despite their strong performance, LLMs…

How can we learn a representation with high predictive power while preserving user privacy? We present an adversarial representation learning method for sanitizing sensitive content from the learned representation. Specifically, we…

Machine Learning · Computer Science 2025-07-15 Tassilo Klein , Moin Nabi

Large data collections required for the training of neural networks often contain sensitive information such as the medical histories of patients, and the privacy of the training data must be preserved. In this paper, we introduce a dropout…

Machine Learning · Statistics 2017-12-06 Beyza Ermis , Ali Taylan Cemgil

The notion that collaborative machine learning can ensure privacy by just withholding the raw data is widely acknowledged to be flawed. Over the past seven years, the literature has revealed several privacy attacks that enable adversaries…

Cryptography and Security · Computer Science 2024-09-27 Federico Mazzone , Ahmad Al Badawi , Yuriy Polyakov , Maarten Everts , Florian Hahn , Andreas Peter

As a booming research area in the past decade, deep learning technologies have been driven by big data collected and processed on an unprecedented scale. However, privacy concerns arise due to the potential leakage of sensitive information…

Cryptography and Security · Computer Science 2024-02-05 Guangsheng Zhang , Bo Liu , Huan Tian , Tianqing Zhu , Ming Ding , Wanlei Zhou

This paper addresses the privacy and security concerns associated with deep neural language models, which serve as crucial components in various modern AI-based applications. These models are often used after being pre-trained and…

Cryptography and Security · Computer Science 2024-01-01 Abhijit Mishra , Mingda Li , Soham Deo

Machine learning has been proven to be susceptible to carefully crafted samples, known as adversarial examples. The generation of these adversarial examples helps to make the models more robust and gives us an insight into the underlying…

Computation and Language · Computer Science 2020-12-29 Sachin Saxena

As the tide of Big Data continues to influence the landscape of Natural Language Processing (NLP), the utilization of modern NLP methods has grounded itself in this data, in order to tackle a variety of text-based tasks. These methods…

Computation and Language · Computer Science 2022-08-18 Oleksandra Klymenko , Stephen Meisenbacher , Florian Matthes