English
Related papers

Related papers: Membership Inference Attacks on Large-Scale Models…

200 papers

Membership Inference Attacks (MIAs) aim to estimate whether a specific data point was used in the training of a given model. Existing state-of-the-art attacks typically rely on training multiple reference models to approximate the…

Machine Learning · Computer Science 2026-05-26 Zhenlong Liu , Wenyu Jiang , Feng Zhou , Hongxin Wei

Large language models (LLMs) have transformed natural language processing, but their ability to memorize training data poses significant privacy risks. This paper investigates model inversion attacks on the Llama 3.2 model, a multilingual…

Machine Learning · Computer Science 2025-07-08 Sathesh P. Sivashanmugam

Large vision-language models (LVLMs) derive their capabilities from extensive training on vast corpora of visual and textual data. Empowered by large-scale parameters, these models often exhibit strong memorization of their training data,…

Cryptography and Security · Computer Science 2025-11-05 Jinhua Yin , Peiru Yang , Chen Yang , Huili Wang , Zhiyang Hu , Shangguang Wang , Yongfeng Huang , Tao Qi

Large Language Models (LLMs) have demonstrated extraordinary capabilities and contributed to multiple fields, such as generating and summarizing text, language translation, and question-answering. Nowadays, LLM is becoming a very popular…

Computation and Language · Computer Science 2024-11-18 Badhan Chandra Das , M. Hadi Amini , Yanzhao Wu

Membership inference attacks (MIAs) are widely used to empirically assess privacy risks in machine learning models, both providing model-level vulnerability metrics and identifying the most vulnerable training samples. State-of-the-art…

Machine Learning · Computer Science 2025-06-13 Joseph Pollock , Igor Shilov , Euodia Dodd , Yves-Alexandre de Montjoye

Federated Large Language Models (FedLLMs) enable multiple parties to collaboratively fine-tune LLMs without sharing raw data, addressing challenges of limited resources and privacy concerns. Despite data localization, shared gradients can…

Machine Learning · Computer Science 2026-04-24 Guilin Deng , Silong Chen , Yuchuan Luo , Yi Liu , Songlei Wang , Zhiping Cai , Lin Liu , Xiaohua Jia , Shaojing Fu

Safety classifiers are essential safeguards within generative AI systems, filtering harmful content or identifying at-risk users when interacting with large language models. Despite their necessity, these models are trained on sensitive…

Machine Learning · Computer Science 2026-05-25 Anthony Hughes , Alexander Goldberg , Prince Jha , Adam Perer , Nikolaos Aletras , Niloofar Mireshghallah

Model Inversion Attacks (MIAs) pose a significant threat to data privacy by reconstructing sensitive training samples from the knowledge embedded in trained machine learning models. Despite recent progress in enhancing the effectiveness of…

Cryptography and Security · Computer Science 2025-12-03 Hongyao Yu , Yixiang Qiu , Hao Fang , Tianqu Zhuang , Bin Chen , Sijin Yu , Bin Wang , Shu-Tao Xia , Ke Xu

Large Language Models (LLMs) have shown greatly enhanced performance in recent years, attributed to increased size and extensive training data. This advancement has led to widespread interest and adoption across industries and the public.…

Computation and Language · Computer Science 2024-06-19 Victoria Smith , Ali Shahin Shamsabadi , Carolyn Ashurst , Adrian Weller

Since machine learning model is often trained on a limited data set, the model is trained multiple times on the same data sample, which causes the model to memorize most of the training set data. Membership Inference Attacks (MIAs) exploit…

Machine Learning · Computer Science 2024-11-19 Depeng Chen , Xiao Liu , Jie Cui , Hong Zhong

Recent work in the privacy literature shows that sample-targeted membership inference attacks (MIAs) significantly outperform untargeted approaches by a wide margin. Motivated by this observation, we address the following question: can the…

Machine Learning · Statistics 2026-05-27 Valentin Dorseuil , Jamal Atif , Olivier Cappé

Recently, large language models (LLMs) have been gaining a lot of interest due to their adaptability and extensibility in emerging applications, including communication networks. It is anticipated that ZSM networks will be able to support…

Cryptography and Security · Computer Science 2025-01-07 Sunder Ali Khowaja , Parus Khuwaja , Kapal Dev , Hussam Al Hamadi , Engin Zeydan

Large Reasoning Models (LRMs) have rapidly gained prominence for their strong performance in solving complex tasks. Many modern black-box LRMs expose the intermediate reasoning traces through APIs to improve transparency (e.g., Gemini-2.5…

Cryptography and Security · Computer Science 2026-01-21 Ruihan Hu , Yu-Ming Shang , Wei Luo , Ye Tao , Xi Zhang

Membership Inference Attacks (MIAs) have emerged as a valuable framework for evaluating privacy leakage by machine learning models. Score-based MIAs are distinguished, in particular, by their ability to exploit the confidence scores that…

Machine Learning · Computer Science 2025-02-28 Gauri Pradhan , Joonas Jälkö , Marlon Tobaben , Antti Honkela

Large Language Models (LLMs) are trained on large-scale web data, which makes it difficult to grasp the contribution of each text. This poses the risk of leaking inappropriate data such as benchmarks, personal information, and copyrighted…

Computation and Language · Computer Science 2024-04-18 Masahiro Kaneko , Youmi Ma , Yuki Wata , Naoaki Okazaki

Whether LLMs memorize their training data and what this means, from measuring privacy leakage to detecting copyright violations, has become a rapidly growing area of research. In the last few months, more than 10 new methods have been…

Computation and Language · Computer Science 2025-03-10 Matthieu Meeus , Igor Shilov , Shubham Jain , Manuel Faysse , Marek Rei , Yves-Alexandre de Montjoye

A Membership Inference Attack (MIA) assesses how much a trained machine learning model reveals about its training data by determining whether specific query instances were included in the dataset. We classify existing MIAs into adaptive or…

Cryptography and Security · Computer Science 2025-09-09 Yuntao Du , Jiacheng Li , Yuetian Chen , Kaiyuan Zhang , Zhizhen Yuan , Hanshen Xiao , Bruno Ribeiro , Ninghui Li

Large language models (LLMs) have demonstrated great performance across various benchmarks, showing potential as general-purpose task solvers. However, as LLMs are typically trained on vast amounts of data, a significant concern in their…

Computation and Language · Computer Science 2025-05-13 Yujuan Fu , Ozlem Uzuner , Meliha Yetisgen , Fei Xia

Training a machine learning model with data following a meaningful order, i.e., from easy to hard, has been proven to be effective in accelerating the training process and achieving better model performance. The key enabling technique is…

Cryptography and Security · Computer Science 2023-10-17 Joann Qiongna Chen , Xinlei He , Zheng Li , Yang Zhang , Zhou Li

An over-the-air membership inference attack (MIA) is presented to leak private information from a wireless signal classifier. Machine learning (ML) provides powerful means to classify wireless signals, e.g., for PHY-layer authentication. As…

Cryptography and Security · Computer Science 2021-07-27 Yi Shi , Yalin E. Sagduyu