English
Related papers

Related papers: Unstoppable Attack: Label-Only Model Inversion via…

200 papers

The high cost of model training makes it increasingly desirable to develop techniques for unlearning. These techniques seek to remove the influence of a training example without having to retrain the model from scratch. Intuitively, once a…

Machine Learning · Computer Science 2024-05-22 Jamie Hayes , Ilia Shumailov , Eleni Triantafillou , Amr Khalifa , Nicolas Papernot

Large language models (LLMs) are trained on massive corpora that may contain sensitive information, creating privacy risks under membership inference attacks (MIAs). Knowledge distillation is widely used to compress LLMs into smaller…

Machine Learning · Computer Science 2026-01-13 Ziyao Cui , Minxing Zhang , Jian Pei

Collaborative inference (CI) improves computational efficiency for edge devices by transmitting intermediate features to cloud models. However, this process inevitably exposes feature representations to model inversion attacks (MIAs),…

Cryptography and Security · Computer Science 2025-06-23 Rongke Liu , Youwen Zhu , Dong Wang , Gaoning Pan , Xingyu He , Weizhi Meng

Analyzing time-series data that contains personal information, particularly in the medical field, presents serious privacy concerns. Sensitive health data from patients is often used to train machine learning models for diagnostics and…

Machine Learning · Computer Science 2024-09-24 Noam Koren , Abigail Goldsteen , Guy Amit , Ariel Farkash

Model Inversion attacks aim to reconstruct information from private training data by exploiting access to a target model. Nearly all recent MI studies evaluate attack success using a standard framework that computes attack accuracy through…

Machine Learning · Computer Science 2026-05-15 Sy-Tuyen Ho , Koh Jun Hao , Ngoc-Bao Nguyen , Alexander Binder , Ngai-Man Cheung

Membership Inference Attacks (MIAs) have emerged as a principled framework for auditing the privacy of synthetic data generated by tabular generative models, where many diverse methods have been proposed that each exploit different privacy…

Cryptography and Security · Computer Science 2025-09-09 Joshua Ward , Yuxuan Yang , Chi-Hua Wang , Guang Cheng

Growing concerns over data privacy and security highlight the importance of machine unlearning--removing specific data influences from trained models without full retraining. Techniques like Membership Inference Attacks (MIAs) are widely…

Machine Learning · Computer Science 2025-06-09 Cheng-Long Wang , Qi Li , Zihang Xiang , Yinzhi Cao , Di Wang

Diffusion models are vulnerable to backdoor attacks, where malicious attackers inject backdoors by poisoning certain training samples during the training stage. This poses a significant threat to real-world applications in the…

Cryptography and Security · Computer Science 2025-02-05 Zihan Guan , Mengxuan Hu , Sheng Li , Anil Vullikanti

Model inversion attacks are a type of privacy attack that reconstructs private data used to train a machine learning model, solely by accessing the model. Recently, white-box model inversion attacks leveraging Generative Adversarial…

Machine Learning · Computer Science 2023-04-11 Gyojin Han , Jaehyun Choi , Haeil Lee , Junmo Kim

The rise of Large Language Models (LLMs) has triggered legal and ethical concerns, especially regarding the unauthorized use of copyrighted materials in their training datasets. This has led to lawsuits against tech companies accused of…

Cryptography and Security · Computer Science 2025-01-17 Cédric Eichler , Nathan Champeil , Nicolas Anciaux , Alexandra Bensamoun , Heber Hwang Arcolezi , José Maria De Fuentes

Membership Inference Attacks (MIAs) are widely used to quantify training data memorization and assess privacy risks. Standard evaluation requires repeated retraining, which is computationally costly for large models. One-run methods (single…

Machine Learning · Computer Science 2026-02-06 Mathieu Even , Clément Berenfeld , Linus Bleistein , Tudor Cebere , Julie Josse , Aurélien Bellet

The increasing use of diffusion models for image generation, especially in sensitive areas like medical imaging, has raised significant privacy concerns. Membership Inference Attack (MIA) has emerged as a potential approach to determine if…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Xinkai Zhao , Yuta Tokuoka , Junichiro Iwasawa , Keita Oda

The vulnerability of machine learning models to Membership Inference Attacks (MIAs) has garnered considerable attention in recent years. These attacks determine whether a data sample belongs to the model's training set or not. Recent…

Cryptography and Security · Computer Science 2024-09-05 Yu He , Boheng Li , Yao Wang , Mengda Yang , Juan Wang , Hongxin Hu , Xingyu Zhao

Training a machine learning model with data following a meaningful order, i.e., from easy to hard, has been proven to be effective in accelerating the training process and achieving better model performance. The key enabling technique is…

Cryptography and Security · Computer Science 2023-10-17 Joann Qiongna Chen , Xinlei He , Zheng Li , Yang Zhang , Zhou Li

Recent works have demonstrated that machine learning models are vulnerable to model inversion attacks, which lead to the exposure of sensitive information contained in their training dataset. While some model inversion attacks have been…

Machine Learning · Computer Science 2019-09-27 Ulrich Aïvodji , Sébastien Gambs , Timon Ther

Membership inference attacks (MIAs) aim to determine whether a sample was part of a model's training set, posing serious privacy risks for modern machine-learning systems. Existing MIAs primarily rely on static indicators, such as loss or…

Artificial Intelligence · Computer Science 2026-02-06 Amit Kravchik Taub , Fred M. Grabovski , Guy Amit , Yisroel Mirsky

This report summarizes all the MIA experiments (Membership Inference Attacks) of the Embedding Attack Project, including threat models, experimental setup, experimental results, findings and discussion. Current results cover the evaluation…

Machine Learning · Computer Science 2024-01-26 Jiameng Pu , Zafar Takhirov

Advanced text-to-image diffusion models raise safety concerns regarding identity privacy violation, copyright infringement, and Not Safe For Work content generation. Towards this, unlearning methods have been developed to erase these…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Xiaoxuan Han , Songlin Yang , Wei Wang , Yang Li , Jing Dong

Image AutoRegressive generation has emerged as a new powerful paradigm with image autoregressive models (IARs) matching state-of-the-art diffusion models (DMs) in image quality (FID: 1.48 vs. 1.58) while allowing for a higher generation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Antoni Kowalczuk , Jan Dubiński , Franziska Boenisch , Adam Dziedzic

We demonstrate how a target model's generalization gap leads directly to an effective deterministic black box membership inference attack (MIA). This provides an upper bound on how secure a model can be to MIA based on a simple metric.…

Machine Learning · Computer Science 2020-09-15 Jason W. Bentley , Daniel Gibney , Gary Hoppenworth , Sumit Kumar Jha