English
Related papers

Related papers: Modelling and Quantifying Membership Information L…

200 papers

Leakage of data from publicly available Machine Learning (ML) models is an area of growing significance as commercial and government applications of ML can draw on multiple sources of data, potentially including users' and clients'…

A membership inference attack allows an adversary to query a trained machine learning model to predict whether or not a particular example was contained in the model's training dataset. These attacks are currently evaluated using…

Cryptography and Security · Computer Science 2022-04-13 Nicholas Carlini , Steve Chien , Milad Nasr , Shuang Song , Andreas Terzis , Florian Tramer

Semi-supervised learning (SSL) leverages both labeled and unlabeled data to train machine learning (ML) models. State-of-the-art SSL methods can achieve comparable performance to supervised learning by leveraging much fewer labeled data.…

Cryptography and Security · Computer Science 2022-07-27 Xinlei He , Hongbin Liu , Neil Zhenqiang Gong , Yang Zhang

Learned recommender systems may inadvertently leak information about their training data, leading to privacy violations. We investigate privacy threats faced by recommender systems through the lens of membership inference. In such attacks,…

Information Retrieval · Computer Science 2022-06-29 Zihan Wang , Na Huang , Fei Sun , Pengjie Ren , Zhumin Chen , Hengliang Luo , Maarten de Rijke , Zhaochun Ren

Determining whether a dataset was part of a machine learning model's training data pool can reveal privacy vulnerabilities, a challenge often addressed through membership inference attacks (MIAs). Traditional MIAs typically require access…

Machine Learning · Computer Science 2025-06-03 Yongchao Huang

Data privacy is an important issue for "machine learning as a service" providers. We focus on the problem of membership inference attacks: given a data sample and black-box access to a model's API, determine whether the sample existed in…

Machine Learning · Computer Science 2020-03-17 Sorami Hisamoto , Matt Post , Kevin Duh

With the development of information science and technology, various industries have generated massive amounts of data, and machine learning is widely used in the analysis of big data. However, if the privacy of machine learning…

Cryptography and Security · Computer Science 2023-01-11 Jingyi Ge

In collaborative learning, clients keep their data private and communicate only the computed gradients of the deep neural network being trained on their local data. Several recent attacks show that one can still extract private information…

Machine Learning · Computer Science 2022-07-26 Fan Mo , Anastasia Borovykh , Mohammad Malekzadeh , Soteris Demetriou , Deniz Gündüz , Hamed Haddadi

In a first part, we present a mathematical analysis of a general methodology of a probabilistic learning inference that allows for estimating a posterior probability model for a stochastic boundary value problem from a prior probability…

Machine Learning · Statistics 2022-06-08 Christian Soize

Membership inference attacks (MIAs) are widely used to assess the privacy risks associated with machine learning models. However, when these attacks are applied to pre-trained large language models (LLMs), they encounter significant…

Cryptography and Security · Computer Science 2026-05-26 Meng Tong , Yuntao Du , Kejiang Chen , Weiming Zhang , Ninghui Li

When building machine learning models using sensitive data, organizations should ensure that the data processed in such systems is adequately protected. For projects involving machine learning on personal data, Article 35 of the GDPR…

Cryptography and Security · Computer Science 2020-07-21 Sasi Kumar Murakonda , Reza Shokri

Recent years have witnessed the tremendous success of diffusion models in data synthesis. However, when diffusion models are applied to sensitive data, they also give rise to severe privacy concerns. In this paper, we systematically present…

Cryptography and Security · Computer Science 2023-01-25 Hailong Hu , Jun Pang

A surprising phenomenon in modern machine learning is the ability of a highly overparameterized model to generalize well (small error on the test data) even when it is trained to memorize the training data (zero error on the training data).…

Machine Learning · Statistics 2022-12-01 Jasper Tan , Blake Mason , Hamid Javadi , Richard G. Baraniuk

Distribution inference, sometimes called property inference, infers statistical properties about a training set from access to a model trained on that data. Distribution inference attacks can pose serious risks when models are trained on…

Machine Learning · Computer Science 2022-07-06 Anshuman Suri , David Evans

Given a trained model and a data sample, membership-inference (MI) attacks predict whether the sample was in the model's training set. A common countermeasure against MI attacks is to utilize differential privacy (DP) during model training…

Cryptography and Security · Computer Science 2022-04-14 Saeed Mahloujifar , Alexandre Sablayrolles , Graham Cormode , Somesh Jha

In this work, we investigate the use of three information-theoretic quantities -- entropy, mutual information with the class variable, and a class selectivity measure based on Kullback-Leibler divergence -- to understand and study the…

Machine Learning · Computer Science 2022-12-02 Rana Ali Amjad , Kairen Liu , Bernhard C. Geiger

The integration of machine learning (ML) in numerous critical applications introduces a range of privacy concerns for individuals who provide their datasets for model training. One such privacy risk is Membership Inference (MI), in which an…

Machine Learning · Computer Science 2024-01-18 Harsh Chaudhari , Giorgio Severi , Alina Oprea , Jonathan Ullman

Artificial intelligence systems are prevalent in everyday life, with use cases in retail, manufacturing, health, and many other fields. With the rise in AI adoption, associated risks have been identified, including privacy risks to the…

Machine Learning · Computer Science 2024-07-19 Shlomit Shachor , Natalia Razinkov , Abigail Goldsteen

Modern machine learning approaches excel in static settings where a large amount of i.i.d. training data are available for a given task. In a dynamic environment, though, an intelligent agent needs to be able to transfer knowledge and…

Machine Learning · Computer Science 2023-03-13 Jonas Wildberger , Siyuan Guo , Arnab Bhattacharyya , Bernhard Schölkopf

Machine unlearning (MU) has emerged as a key mechanism for ensuring data privacy and regulatory compliance by enabling models to forget specific training samples. However, recent studies have shown that the removal of data can inadvertently…

Cryptography and Security · Computer Science 2026-05-05 Jie Fu , Nima Naderloui , Da Zhong , Yuan Hong , Wendy Hui Wang
‹ Prev 1 3 4 5 6 7 10 Next ›