English
Related papers

Related papers: Privacy Attacks on Image AutoRegressive Models

200 papers

In the age of agentic AI, the growing deployment of multi-modal models (MMs) has introduced new attack vectors that can leak sensitive training data in MMs, causing privacy leakage. This paper investigates a black-box privacy attack, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 David Amebley , Sayanton Dibbo

The utilization of personal sensitive data in training face recognition (FR) models poses significant privacy concerns, as adversaries can employ model inversion attacks (MIA) to infer the original training data. Existing defense methods,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Yinggui Wang , Yuanqing Huang , Jianshu Li , Le Yang , Kai Song , Lei Wang

The advances in machine learning (ML) have greatly improved AI-based diagnosis aid systems in medical imaging. However, being based on collecting medical data specific to individuals induces several security issues, especially in terms of…

Cryptography and Security · Computer Science 2022-06-09 Mounia Hamidouche , Reda Bellafqira , Gwenolé Quellec , Gouenou Coatrieux

Spiking Neural Networks (SNNs) are increasingly explored for their energy efficiency and robustness in real-world applications, yet their privacy risks remain largely unexamined. In this work, we investigate the susceptibility of SNNs to…

Machine Learning · Computer Science 2025-06-12 Junyi Guan , Abhijith Sharma , Chong Tian , Salem Lahlou

Learned recommender systems may inadvertently leak information about their training data, leading to privacy violations. We investigate privacy threats faced by recommender systems through the lens of membership inference. In such attacks,…

Information Retrieval · Computer Science 2022-06-29 Zihan Wang , Na Huang , Fei Sun , Pengjie Ren , Zhumin Chen , Hengliang Luo , Maarten de Rijke , Zhaochun Ren

Membership Inference Attacks (MIAs) are widely used to quantify training data memorization and assess privacy risks. Standard evaluation requires repeated retraining, which is computationally costly for large models. One-run methods (single…

Machine Learning · Computer Science 2026-02-06 Mathieu Even , Clément Berenfeld , Linus Bleistein , Tudor Cebere , Julie Josse , Aurélien Bellet

Multimodal retrieval-augmented generation (RAG) systems enhance large vision-language models by integrating cross-modal knowledge, enabling their increasing adoption across real-world multimodal tasks. These knowledge databases may contain…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Peiru Yang , Jinhua Yin , Haoran Zheng , Xueying Bai , Huili Wang , Yufei Sun , Xintian Li , Shangguang Wang , Yongfeng Huang , Tao Qi

Large vision-language models (VLLMs) exhibit promising capabilities for processing multi-modal tasks across various application scenarios. However, their emergence also raises significant data security concerns, given the potential…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Zhan Li , Yongtao Wu , Yihang Chen , Francesco Tonin , Elias Abad Rocamora , Volkan Cevher

Machine learning (ML) models have the potential to transform military battlefields, presenting a large external pressure to rapidly incorporate them into operational settings. However, it is well-established that these ML models are…

Cryptography and Security · Computer Science 2025-09-05 Tyler Shumaker , Jessica Carpenter , David Saranchak , Nathaniel D. Bastian

Membership inference attacks (MIAs) threaten the privacy of machine learning models by revealing whether a specific data point was used during training. Existing MIAs often rely on impractical assumptions such as access to public datasets,…

Machine Learning · Computer Science 2026-02-24 Abdullah Caglar Oksuz , Anisa Halimi , Erman Ayday

In membership inference attacks (MIAs), an adversary observes the predictions of a model to determine whether a sample is part of the model's training data. Existing MIA defenses conceal the presence of a target sample through strong…

Cryptography and Security · Computer Science 2022-03-03 Ismat Jarin , Birhanu Eshete

The membership inference attack (MIA) is a popular paradigm for compromising the privacy of a machine learning (ML) model. MIA exploits the natural inclination of ML models to overfit upon the training data. MIAs are trained to distinguish…

Membership inference attacks (MIAs) are currently considered one of the main privacy attack strategies, and their defense mechanisms have also been extensively explored. However, there is still a gap between the existing defense approaches…

Machine Learning · Computer Science 2024-05-30 Xingli Fang , Jung-Eun Kim

To address the scarcity and privacy concerns of network traffic data, various generative models have been developed to produce synthetic traffic. However, synthetic traffic is not inherently privacy-preserving, and the extent to which it…

Artificial Intelligence · Computer Science 2025-11-26 Van Tran , Shinan Liu , Tian Li , Nick Feamster

While location data is extremely valuable for various applications, disclosing it prompts serious threats to individuals' privacy. To limit such concerns, organizations often provide analysts with aggregate time-series that indicate, e.g.,…

Cryptography and Security · Computer Science 2020-04-28 Apostolos Pyrgelis , Carmela Troncoso , Emiliano De Cristofaro

This work investigates and evaluates multiple defense strategies against property inference attacks (PIAs), a privacy attack against machine learning models. Given a trained machine learning model, PIAs aim to extract statistical properties…

Cryptography and Security · Computer Science 2023-10-10 Joshua Stock , Jens Wettlaufer , Daniel Demmler , Hannes Federrath

Privacy attacks, particularly membership inference attacks (MIAs), are widely used to assess the privacy of generative models for tabular synthetic data, including those with Differential Privacy (DP) guarantees. These attacks often exploit…

Cryptography and Security · Computer Science 2025-04-15 Georgi Ganev , Meenatchi Sundaram Muthu Selva Annamalai , Sofiane Mahiou , Emiliano De Cristofaro

While being deployed in many critical applications as core components, machine learning (ML) models are vulnerable to various security and privacy attacks. One major privacy attack in this domain is membership inference, where an adversary…

Cryptography and Security · Computer Science 2020-09-11 Yang Zou , Zhikun Zhang , Michael Backes , Yang Zhang

Federated Large Language Models (FedLLMs) enable multiple parties to collaboratively fine-tune LLMs without sharing raw data, addressing challenges of limited resources and privacy concerns. Despite data localization, shared gradients can…

Machine Learning · Computer Science 2026-04-24 Guilin Deng , Silong Chen , Yuchuan Luo , Yi Liu , Songlei Wang , Zhiping Cai , Lin Liu , Xiaohua Jia , Shaojing Fu

Recently, adapting the idea of self-supervised learning (SSL) on continuous speech has started gaining attention. SSL models pre-trained on a huge amount of unlabeled audio can generate general-purpose representations that benefit a wide…

Cryptography and Security · Computer Science 2022-08-16 Wei-Cheng Tseng , Wei-Tsung Kao , Hung-yi Lee