English
Related papers

Related papers: Do Membership Inference Attacks Work on Large Lang…

200 papers

As a long-term threat to the privacy of training data, membership inference attacks (MIAs) emerge ubiquitously in machine learning models. Existing works evidence strong connection between the distinguishability of the training and testing…

Machine Learning · Computer Science 2022-07-14 Dingfan Chen , Ning Yu , Mario Fritz

Machine Learning (ML) has made unprecedented progress in the past several decades. However, due to the memorability of the training data, ML is susceptible to various attacks, especially Membership Inference Attacks (MIAs), the objective of…

Machine Learning · Computer Science 2022-05-16 Shuhao Li , Yajie Wang , Yuanzhang Li , Yu-an Tan

Federated Learning (FL) enables collaborative model training while keeping training data localized, allowing us to preserve privacy in various domains including remote sensing. However, recent studies show that FL models may still leak…

Cryptography and Security · Computer Science 2026-01-13 Anh-Kiet Duong , Petra Gomez-Krämer , Hoàng-Ân Lê , Minh-Tan Pham

Federated Large Language Models (FedLLMs) enable multiple parties to collaboratively fine-tune LLMs without sharing raw data, addressing challenges of limited resources and privacy concerns. Despite data localization, shared gradients can…

Machine Learning · Computer Science 2026-04-24 Guilin Deng , Silong Chen , Yuchuan Luo , Yi Liu , Songlei Wang , Zhiping Cai , Lin Liu , Xiaohua Jia , Shaojing Fu

How much does a machine learning algorithm leak about its training data, and why? Membership inference attacks are used as an auditing tool to quantify this leakage. In this paper, we present a comprehensive \textit{hypothesis testing…

Machine Learning · Computer Science 2022-09-14 Jiayuan Ye , Aadyaa Maddi , Sasi Kumar Murakonda , Vincent Bindschaedler , Reza Shokri

Recently, diffusion models have achieved remarkable success in generating tasks, including image and audio generation. However, like other generative models, diffusion models are prone to privacy issues. In this paper, we propose an…

Sound · Computer Science 2023-10-10 Fei Kong , Jinhao Duan , RuiPeng Ma , Hengtao Shen , Xiaofeng Zhu , Xiaoshuang Shi , Kaidi Xu

Membership inference attacks (MIAs) test whether a data point was part of a model's training set, posing serious privacy risks. Existing methods often depend on shadow models or heavy query access, which limits their practicality. We…

Machine Learning · Computer Science 2025-10-28 Yongchao Huang , Pengfei Zhang , Shahzad Mumtaz

The data used to train deep neural network (DNN) models in applications such as healthcare and finance typically contain sensitive information. A DNN model may suffer from overfitting. Overfitted models have been shown to be susceptible to…

Machine Learning · Computer Science 2022-12-19 Arezoo Rajabi , Dinuka Sahabandu , Luyao Niu , Bhaskar Ramasubramanian , Radha Poovendran

Membership inference (MI) attacks exploit the fact that machine learning algorithms sometimes leak information about their training data through the learned model. In this work, we study membership inference in the white-box setting in…

Machine Learning · Computer Science 2020-06-26 Klas Leino , Matt Fredrikson

Recommender systems have been widely deployed across various domains such as e-commerce and social media, and intelligently suggest items like products and potential friends to users based on their preferences and interaction history, which…

Cryptography and Security · Computer Science 2025-12-11 Xiaoxiao Chi , Xuyun Zhang , Yan Wang , Hongsheng Hu , Wanchun Dou

Machine learning models are known to leak sensitive information, as they inevitably memorize (parts of) their training data. More alarmingly, large language models (LLMs) are now trained on nearly all available data, which amplifies the…

Machine Learning · Computer Science 2025-10-10 Jiashu Tao , Reza Shokri

Membership Inference Attacks (MIAs) have emerged as a valuable framework for evaluating privacy leakage by machine learning models. Score-based MIAs are distinguished, in particular, by their ability to exploit the confidence scores that…

Machine Learning · Computer Science 2025-02-28 Gauri Pradhan , Joonas Jälkö , Marlon Tobaben , Antti Honkela

Recently, large language models (LLMs) have been gaining a lot of interest due to their adaptability and extensibility in emerging applications, including communication networks. It is anticipated that ZSM networks will be able to support…

Cryptography and Security · Computer Science 2025-01-07 Sunder Ali Khowaja , Parus Khuwaja , Kapal Dev , Hussam Al Hamadi , Engin Zeydan

Artificial intelligence systems are prevalent in everyday life, with use cases in retail, manufacturing, health, and many other fields. With the rise in AI adoption, associated risks have been identified, including privacy risks to the…

Machine Learning · Computer Science 2024-07-19 Shlomit Shachor , Natalia Razinkov , Abigail Goldsteen

Membership inference attacks (MIAs) have emerged as the standard tool for evaluating the privacy risks of AI models. However, state-of-the-art attacks require training numerous, often computationally expensive, reference models, limiting…

Machine Learning · Computer Science 2025-10-23 Euodia Dodd , Nataša Krčo , Igor Shilov , Yves-Alexandre de Montjoye

Neural models for vulnerability prediction (VP) have achieved impressive performance by learning from large-scale code repositories. However, their susceptibility to Membership Inference Attacks (MIAs), where adversaries aim to infer…

Cryptography and Security · Computer Science 2025-12-10 Yihan Liao , Jacky Keung , Xiaoxue Ma , Jingyu Zhang , Yicheng Sun

Retrieval-Augmented Generation (RAG) and Supervised Finetuning (SFT) have become the predominant paradigms for equipping Large Language Models (LLMs) with external knowledge for diverse, knowledge-intensive tasks. However, while such…

Cryptography and Security · Computer Science 2025-12-04 Haowei Fu , Bo Ni , Han Xu , Kunpeng Liu , Dan Lin , Tyler Derr

Membership inference attacks aim to infer whether a data record has been used to train a target model by observing its predictions. In sensitive domains such as healthcare, this can constitute a severe privacy violation. In this work we…

Cryptography and Security · Computer Science 2022-12-05 Tomas Chobola , Dmitrii Usynin , Georgios Kaissis

Large language models (LLMs) have achieved remarkable success and are widely adopted for diverse applications. However, fine-tuning these models often involves private or sensitive information, raising critical privacy concerns. In this…

Cryptography and Security · Computer Science 2025-06-13 Kaiyuan Zhang , Siyuan Cheng , Hanxi Guo , Yuetian Chen , Zian Su , Shengwei An , Yuntao Du , Charles Fleming , Ashish Kundu , Xiangyu Zhang , Ninghui Li

Data is the foundation of most science. Unfortunately, sharing data can be obstructed by the risk of violating data privacy, impeding research in fields like healthcare. Synthetic data is a potential solution. It aims to generate data that…

Machine Learning · Computer Science 2023-02-27 Boris van Breugel , Hao Sun , Zhaozhi Qian , Mihaela van der Schaar