English
Related papers

Related papers: Membership Inference on Word Embedding and Beyond

200 papers

The raise of machine learning and deep learning led to significant improvement in several domains. This change is supported by both the dramatic rise in computation power and the collection of large datasets. Such massive datasets often…

Machine Learning · Computer Science 2022-11-24 Hamid Jalalzai , Elie Kadoche , Rémi Leluc , Vincent Plassier

We study the membership inference (MI) attack against classifiers, where the attacker's goal is to determine whether a data instance was used for training the classifier. Through systematic cataloging of existing MI attacks and extensive…

Cryptography and Security · Computer Science 2021-02-04 Jiacheng Li , Ninghui Li , Bruno Ribeiro

Membership inference attacks are designed to determine, using black box access to trained models, whether a particular example was used in training or not. Membership inference can be formalized as a hypothesis testing problem. The most…

Machine Learning · Computer Science 2023-07-10 Martin Bertran , Shuai Tang , Michael Kearns , Jamie Morgenstern , Aaron Roth , Zhiwei Steven Wu

Machine learning models have been shown to leak information violating the privacy of their training set. We focus on membership inference attacks on machine learning models which aim to determine whether a data point was used to train the…

Cryptography and Security · Computer Science 2020-09-02 Shadi Rahimian , Tribhuvanesh Orekondy , Mario Fritz

Membership inference attacks (MIAs) attempt to predict whether a particular datapoint is a member of a target model's training data. Despite extensive research on traditional machine learning models, there has been limited work studying MIA…

We present two information leakage attacks that outperform previous work on membership inference against generative models. The first attack allows membership inference without assumptions on the type of the generative model. Contrary to…

Cryptography and Security · Computer Science 2019-06-10 Benjamin Hilprecht , Martin Härterich , Daniel Bernau

Text embedding has become a foundational technology in natural language processing (NLP) during the deep learning era, driving advancements across a wide array of downstream tasks. While many natural language understanding challenges can…

Computation and Language · Computer Science 2025-10-22 Zhijie Nie , Zhangchi Feng , Mingxin Li , Cunwang Zhang , Yanzhao Zhang , Dingkun Long , Richong Zhang

Membership inference (MI) attacks try to determine if a data sample was used to train a machine learning model. For foundation models trained on unknown Web data, MI attacks are often used to detect copyrighted training materials, measure…

Cryptography and Security · Computer Science 2025-04-01 Debeshee Das , Jie Zhang , Florian Tramèr

Large language model (LLM)-powered multi-agent systems (MAS) enable agents to communicate and share information, achieving strong performance on complex tasks. However, this communication also creates an attack surface where malicious…

Cryptography and Security · Computer Science 2026-05-05 Lingxi Zhang , Guangtao Zheng , Hanjie Chen

The usage of deep learning is being escalated in many applications. Due to its outstanding performance, it is being used in a variety of security and privacy-sensitive areas in addition to conventional applications. One of the key aspects…

Cryptography and Security · Computer Science 2022-05-17 Zhaoxi Zhang , Leo Yu Zhang , Xufei Zheng , Bilal Hussain Abbasi , Shengshan Hu

Machine learning models are vulnerable to membership inference attacks in which an adversary aims to predict whether or not a particular sample was contained in the target model's training dataset. Existing attack methods have commonly…

Cryptography and Security · Computer Science 2022-09-01 Yiyong Liu , Zhengyu Zhao , Michael Backes , Yang Zhang

With widening deployments of natural language processing (NLP) in daily life, inherited social biases from NLP models have become more severe and problematic. Previous studies have shown that word embeddings trained on human-generated…

Computation and Language · Computer Science 2021-12-13 Lei Ding , Dengdeng Yu , Jinhan Xie , Wenxing Guo , Shenggang Hu , Meichen Liu , Linglong Kong , Hongsheng Dai , Yanchun Bao , Bei Jiang

Deep learning has achieved overwhelming success, spanning from discriminative models to generative models. In particular, deep generative models have facilitated a new level of performance in a myriad of areas, ranging from media…

Machine Learning · Computer Science 2020-11-24 Dingfan Chen , Ning Yu , Yang Zhang , Mario Fritz

Current research in adversarial robustness of LLMs focuses on discrete input manipulations in the natural language space, which can be directly transferred to closed-source models. However, this approach neglects the steady progression of…

Machine Learning · Computer Science 2025-04-17 Leo Schwinn , David Dobre , Sophie Xhonneux , Gauthier Gidel , Stephan Gunnemann

Despite being prevalent in the general field of Natural Language Processing (NLP), pre-trained language models inherently carry privacy and copyright concerns due to their nature of training on large-scale web-scraped data. In this paper,…

Computation and Language · Computer Science 2024-08-21 Yuan Xin , Zheng Li , Ning Yu , Dingfan Chen , Mario Fritz , Michael Backes , Yang Zhang

Membership inference attacks (MIA) attempt to verify the membership of a given data sample in the training set for a model. MIA has become relevant in recent years, following the rapid development of large language models (LLM). Many are…

Computation and Language · Computer Science 2025-02-04 Haritz Puerto , Martin Gubri , Sangdoo Yun , Seong Joon Oh

With an increase in low-cost machine learning APIs, advanced machine learning models may be trained on private datasets and monetized by providing them as a service. However, privacy researchers have demonstrated that these models may leak…

Word embedding is a Natural Language Processing (NLP) technique that automatically maps words from a vocabulary to vectors of real numbers in an embedding space. It has been widely used in recent years to boost the performance of a vari-ety…

Computation and Language · Computer Science 2017-09-25 Arpita Roy , Youngja Park , SHimei Pan

Tabular data typically contains private and important information; thus, precautions must be taken before they are shared with others. Although several methods (e.g., differential privacy and k-anonymity) have been proposed to prevent…

Cryptography and Security · Computer Science 2022-08-26 Jihyeon Hyeong , Jayoung Kim , Noseong Park , Sushil Jajodia

The proliferation of large language models (LLMs) in the real world has come with a rise in copyright cases against companies for training their models on unlicensed data from the internet. Recent works have presented methods to identify if…

Machine Learning · Computer Science 2024-06-11 Pratyush Maini , Hengrui Jia , Nicolas Papernot , Adam Dziedzic