English
Related papers

Related papers: Privacy Leaks by Adversaries: Adversarial Iteratio…

200 papers

Membership Inference Attacks (MIAs) have emerged as a valuable framework for evaluating privacy leakage by machine learning models. Score-based MIAs are distinguished, in particular, by their ability to exploit the confidence scores that…

Machine Learning · Computer Science 2025-02-28 Gauri Pradhan , Joonas Jälkö , Marlon Tobaben , Antti Honkela

Model explanations improve the transparency of black-box machine learning (ML) models and their decisions; however, they can also be exploited to carry out privacy threats such as membership inference attacks (MIA). Existing works have only…

Artificial Intelligence · Computer Science 2024-04-11 Kavita Kumari , Murtuza Jadliwala , Sumit Kumar Jha , Anindya Maiti

Machine learning (ML) has become a core component of many real-world applications and training data is a key factor that drives current progress. This huge success has led Internet companies to deploy machine learning as a service (MLaaS).…

Cryptography and Security · Computer Science 2018-12-18 Ahmed Salem , Yang Zhang , Mathias Humbert , Pascal Berrang , Mario Fritz , Michael Backes

The rise of generative image models leads to privacy concerns when it comes to the huge datasets used to train such models. This paper investigates the possibility of inferring if a set of face images was used for fine-tuning a Latent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Lauritz Christian Holme , Anton Mosquera Storgaard , Siavash Arjomand Bigdeli

How much does a machine learning algorithm leak about its training data, and why? Membership inference attacks are used as an auditing tool to quantify this leakage. In this paper, we present a comprehensive \textit{hypothesis testing…

Machine Learning · Computer Science 2022-09-14 Jiayuan Ye , Aadyaa Maddi , Sasi Kumar Murakonda , Vincent Bindschaedler , Reza Shokri

Membership inference attacks (MIAs) pose a critical privacy threat to fine-tuned large language models (LLMs), especially when models are adapted to domain-specific tasks using sensitive data. While prior black-box MIA techniques rely on…

Cryptography and Security · Computer Science 2025-12-23 Zhexi Lu , Hongliang Chi , Nathalie Baracaldo , Swanand Ravindra Kadhe , Yuseok Jeon , Lei Yu

In recent years, the widespread adoption of Machine Learning as a Service (MLaaS), particularly in sensitive environments, has raised considerable privacy concerns. Of particular importance are membership inference attacks (MIAs), which…

Cryptography and Security · Computer Science 2026-02-16 Osama Zafar , Shaojie Zhan , Tianxi Ji , Erman Ayday

Synthetic tabular data has gained attention for enabling privacy-preserving data sharing. While substantial progress has been made in single-table synthetic generation where data are modeled at the row or item level, most real-world data…

Machine Learning · Computer Science 2026-05-12 Joshua Ward , Chi-Hua Wang , Guang Cheng

Membership Inference Attacks (MIAs) have recently been employed to determine whether a specific text was part of the pre-training data of Large Language Models (LLMs). However, existing methods often misinfer non-members as members, leading…

Machine Learning · Computer Science 2025-05-07 Saleh Zare Zade , Yao Qiang , Xiangyu Zhou , Hui Zhu , Mohammad Amin Roshani , Prashant Khanduri , Dongxiao Zhu

Membership inference (MI) attack is currently the most popular test for measuring privacy leakage in machine learning models. Given a machine learning model, a data point and some auxiliary information, the goal of an MI attack is to…

Machine Learning · Computer Science 2023-03-09 Zhifeng Kong , Amrita Roy Chowdhury , Kamalika Chaudhuri

Multi-domain graph pre-training has emerged as a pivotal technique in developing graph foundation models. While it greatly improves the generalization of graph neural networks, its privacy risks under membership inference attacks (MIAs),…

Machine Learning · Computer Science 2025-11-25 Jiayi Luo , Qingyun Sun , Yuecen Wei , Haonan Yuan , Xingcheng Fu , Jianxin Li

While in-processing fairness approaches show promise in mitigating biased predictions, their potential impact on privacy leakage remains under-explored. We aim to address this gap by assessing the privacy risks of fairness-enhanced binary…

Machine Learning · Computer Science 2025-05-29 Huan Tian , Guangsheng Zhang , Bo Liu , Tianqing Zhu , Ming Ding , Wanlei Zhou

This report summarizes all the MIA experiments (Membership Inference Attacks) of the Embedding Attack Project, including threat models, experimental setup, experimental results, findings and discussion. Current results cover the evaluation…

Machine Learning · Computer Science 2024-01-26 Jiameng Pu , Zafar Takhirov

The rise of Large Language Models (LLMs) has triggered legal and ethical concerns, especially regarding the unauthorized use of copyrighted materials in their training datasets. This has led to lawsuits against tech companies accused of…

Cryptography and Security · Computer Science 2025-01-17 Cédric Eichler , Nathan Champeil , Nicolas Anciaux , Alexandra Bensamoun , Heber Hwang Arcolezi , José Maria De Fuentes

The lack of data transparency in Large Language Models (LLMs) has highlighted the importance of Membership Inference Attack (MIA), which differentiates trained (member) and untrained (non-member) data. Though it shows success in previous…

Computation and Language · Computer Science 2024-12-19 Bowen Chen , Namgi Han , Yusuke Miyao

Generative AI systems are quickly improving, now able to produce believable output in several modalities including images, text, and audio. However, this fast development has prompted increased scrutiny concerning user privacy and the use…

Cryptography and Security · Computer Science 2025-12-29 Kurtis Chow , Omar Samiullah , Vinesh Sridhar , Hewen Zhang

Membership inference attacks aim to infer whether a data record has been used to train a target model by observing its predictions. In sensitive domains such as healthcare, this can constitute a severe privacy violation. In this work we…

Cryptography and Security · Computer Science 2022-12-05 Tomas Chobola , Dmitrii Usynin , Georgios Kaissis

Membership inference attacks (MIAs) test whether a data point was part of a model's training set, posing serious privacy risks. Existing methods often depend on shadow models or heavy query access, which limits their practicality. We…

Machine Learning · Computer Science 2025-10-28 Yongchao Huang , Pengfei Zhang , Shahzad Mumtaz

Membership Inference Attacks (MIAs) pose a significant privacy risk by enabling adversaries to determine if a specific data point was part of a model's training set. This work empirically investigates whether MU algorithms can function as a…

Machine learning (ML) has been widely adopted in various privacy-critical applications, e.g., face recognition and medical image analysis. However, recent research has shown that ML models are vulnerable to attacks against their training…

Machine Learning · Computer Science 2021-09-20 Zheng Li , Yang Zhang