English
Related papers

Related papers: Membership Inference Attacks against Machine Learn…

200 papers

Adapting Large Language Models (LLMs) to specific tasks introduces concerns about computational efficiency, prompting an exploration of efficient methods such as In-Context Learning (ICL). However, the vulnerability of ICL to privacy…

Cryptography and Security · Computer Science 2024-09-04 Rui Wen , Zheng Li , Michael Backes , Yang Zhang

Artificial intelligence, machine learning, and deep learning as a service have become the status quo for many industries, leading to the widespread deployment of models that handle sensitive data. Well-performing models, the industry seeks,…

This paper presents how to leak private information from a wireless signal classifier by launching an over-the-air membership inference attack (MIA). As machine learning (ML) algorithms are used to process wireless signals to make decisions…

Signal Processing · Electrical Eng. & Systems 2020-06-26 Yi Shi , Kemal Davaslioglu , Yalin E. Sagduyu

Recent research shows that large language models are susceptible to privacy attacks that infer aspects of the training data. However, it is unclear if simpler generative models, like topic models, share similar vulnerabilities. In this…

Cryptography and Security · Computer Science 2024-09-24 Nico Manzonelli , Wanrong Zhang , Salil Vadhan

As industrial applications are increasingly automated by machine learning models, enforcing personal data ownership and intellectual property rights requires tracing training data back to their rightful owners. Membership inference…

Machine Learning · Computer Science 2023-06-02 Yuxin Wen , Arpit Bansal , Hamid Kazemi , Eitan Borgnia , Micah Goldblum , Jonas Geiping , Tom Goldstein

Machine learning models are vulnerable to adversarial attacks, including attacks that leak information about the model's training data. There has recently been an increase in interest about how to best address privacy concerns, especially…

Machine Learning · Computer Science 2024-05-30 Keltin Grimes , Collin Abidi , Cole Frank , Shannon Gallagher

Large Language Models (LLMs) are prone to memorizing training data, which poses serious privacy risks. Two of the most prominent concerns are training data extraction and Membership Inference Attacks (MIAs). Prior research has shown that…

Machine Learning · Computer Science 2026-03-02 Ali Al Sahili , Ali Chehab , Razane Tajeddine

Deep learning models often raise privacy concerns as they leak information about their training data. This enables an adversary to determine whether a data point was in a model's training set by conducting a membership inference attack…

Machine Learning · Computer Science 2020-06-11 Yigitcan Kaya , Sanghyun Hong , Tudor Dumitras

Large language models (LLMs) have become the backbone of modern natural language processing but pose privacy concerns about leaking sensitive training data. Membership inference attacks (MIAs), which aim to infer whether a sample is…

Machine Learning · Computer Science 2025-06-03 Toan Tran , Ruixuan Liu , Li Xiong

We show that remotely hosted applications employing in-context learning when augmented with a retrieval function to select in-context examples can be vulnerable to membership-inference attacks even when the service provider and users are…

Cryptography and Security · Computer Science 2026-05-07 Tejas Kulkarni , Antti Koskela , Laith Zumot

Diffusion models have attracted attention in recent years as innovative generative models. In this paper, we investigate whether a diffusion model is resistant to a membership inference attack, which evaluates the privacy leakage of a…

Cryptography and Security · Computer Science 2023-03-23 Tomoya Matsumoto , Takayuki Miura , Naoto Yanai

In distributed learning settings, models are iteratively updated with shared gradients computed from potentially sensitive user data. While previous work has studied various privacy risks of sharing gradients, our paper aims to provide a…

Machine Learning · Computer Science 2024-09-02 Zhuohang Li , Andrew Lowy , Jing Liu , Toshiaki Koike-Akino , Kieran Parsons , Bradley Malin , Ye Wang

Federated Contrastive Learning (FCL) represents a burgeoning approach for learning from decentralized unlabeled data while upholding data privacy. In FCL, participant clients collaborate in learning a global encoder using unlabeled data,…

Cryptography and Security · Computer Science 2024-04-29 Kongyang Chen , Wenfeng Wang , Zixin Wang , Wangjun Zhang , Zhipeng Li , Yao Huang

Membership Inference Attack (MIA) determines the presence of a record in a machine learning model's training data by querying the model. Prior work has shown that the attack is feasible when the model is overfitted to its training data or…

Cryptography and Security · Computer Science 2018-02-15 Yunhui Long , Vincent Bindschaedler , Lei Wang , Diyue Bu , Xiaofeng Wang , Haixu Tang , Carl A. Gunter , Kai Chen

The privacy of machine learning models has become a significant concern in many emerging Machine-Learning-as-a-Service applications, where prediction services based on well-trained models are offered to users via pay-per-query. The lack of…

Machine Learning · Computer Science 2022-06-24 Xun Xian , Mingyi Hong , Jie Ding

Many machine learning models are vulnerable to adversarial examples: inputs that are specially crafted to cause a machine learning model to produce an incorrect output. Adversarial examples that affect one model often affect another model,…

Cryptography and Security · Computer Science 2016-05-25 Nicolas Papernot , Patrick McDaniel , Ian Goodfellow

Membership Inference attacks (MIAs) aim to predict whether a data sample was present in the training data of a machine learning model or not, and are widely used for assessing the privacy risks of language models. Most existing attacks rely…

Computation and Language · Computer Science 2023-08-08 Justus Mattern , Fatemehsadat Mireshghallah , Zhijing Jin , Bernhard Schölkopf , Mrinmaya Sachan , Taylor Berg-Kirkpatrick

Machine learning models are vulnerable to both security attacks (e.g., adversarial examples) and privacy attacks (e.g., private attribute inference). We take the first step to mitigate both the security and privacy attacks, and maintain…

Machine Learning · Computer Science 2024-12-17 Binghui Zhang , Sayedeh Leila Noorbakhsh , Yun Dong , Yuan Hong , Binghui Wang

Hierarchical text classification consists in classifying text documents into a hierarchy of classes and sub-classes. Although artificial neural networks have proved useful to perform this task, unfortunately they can leak training data…

Cryptography and Security · Computer Science 2021-12-10 Dominik Wunderlich , Daniel Bernau , Francesco Aldà , Javier Parra-Arnau , Thorsten Strufe

Membership inference attacks (MIA) try to detect if data samples were used to train a neural network model, e.g. to detect copyright abuses. We show that models with higher dimensional input and output are more vulnerable to MIA, and…

Machine Learning · Computer Science 2021-08-19 Avital Shafran , Shmuel Peleg , Yedid Hoshen