English
Related papers

Related papers: Privacy Attacks on Image AutoRegressive Models

200 papers

Membership Inference Attacks (MIAs) are currently a dominant approach for evaluating privacy in machine learning applications. Despite their significance in identifying records belonging to the training dataset, several concerns remain…

Machine Learning · Computer Science 2026-01-23 Cristina Pêra , Tânia Carvalho , Maxime Cordy , Luís Antunes

Federated Learning enables collaborative learning among clients via a coordinating server while avoiding direct data sharing, offering a perceived solution to preserve privacy. However, recent studies on Membership Inference Attacks (MIAs)…

Cryptography and Security · Computer Science 2025-08-04 Quan Nguyen , Minh N. Vu , Truc Nguyen , My T. Thai

Diffusion models have demonstrated remarkable capabilities in image synthesis, but their recently proven vulnerability to Membership Inference Attacks (MIAs) poses a critical privacy concern. This paper introduces two novel and efficient…

Machine Learning · Computer Science 2024-10-23 Bao Q. Tran , Viet Nguyen , Anh Tran , Toan Tran

In Embedding-as-an-Interface (EaaI) settings, pre-trained models are queried for Intermediate Representations (IRs). The distributional properties of IRs can leak training-set membership signals, enabling Membership Inference Attacks (MIAs)…

Machine Learning · Computer Science 2026-05-12 Jiayang Meng , Tao Huang , Chen Hou , Guolong Zheng , Hong Chen

Membership Inference Attacks (MIA) aim to infer whether a target data record has been utilized for model training or not. Existing MIAs designed for large language models (LLMs) can be bifurcated into two types: reference-free and…

Computation and Language · Computer Science 2024-11-27 Wenjie Fu , Huandong Wang , Chen Gao , Guanghua Liu , Yong Li , Tao Jiang

Image-to-image translation models are shown to be vulnerable to the Membership Inference Attack (MIA), in which the adversary's goal is to identify whether a sample is used to train the model or not. With daily increasing applications based…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Saeed Ranjbar Alvar , Lanjun Wang , Jian Pei , Yong Zhang

The increasing reliance on diffusion models for generating synthetic images has amplified concerns about the unauthorized use of personal data, particularly facial images, in model training. In this paper, we introduce a novel identity…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Jayneel Vora , Aditya Krishnan , Nader Bouacida , Prabhu RV Shankar , Prasant Mohapatra

Recommender systems have been successfully applied in many applications. Nonetheless, recent studies demonstrate that recommender systems are vulnerable to membership inference attacks (MIAs), leading to the leakage of users' membership…

Cryptography and Security · Computer Science 2024-05-14 Xiaoxiao Chi , Xuyun Zhang , Yan Wang , Lianyong Qi , Amin Beheshti , Xiaolong Xu , Kim-Kwang Raymond Choo , Shuo Wang , Hongsheng Hu

Data reconstruction attacks on machine learning models pose a substantial threat to privacy, potentially leaking sensitive information. Although defending against such attacks using differential privacy (DP) provides theoretical guarantees,…

Machine Learning · Computer Science 2025-03-11 Kristian Schwethelm , Johannes Kaiser , Moritz Knolle , Sarah Lockfisch , Daniel Rueckert , Alexander Ziller

Diffusion Models (DMs) benefit from large and diverse datasets for their training. Since this data is often scraped from the Internet without permission from the data owners, this raises concerns about copyright and intellectual property…

Machine Learning · Computer Science 2025-06-24 Jan Dubiński , Antoni Kowalczuk , Franziska Boenisch , Adam Dziedzic

Recently, diffusion models have achieved remarkable success in generating tasks, including image and audio generation. However, like other generative models, diffusion models are prone to privacy issues. In this paper, we propose an…

Sound · Computer Science 2023-10-10 Fei Kong , Jinhao Duan , RuiPeng Ma , Hengtao Shen , Xiaofeng Zhu , Xiaoshuang Shi , Kaidi Xu

Model inversion attacks (MIAs) aim to create synthetic images that reflect the class-wise characteristics from a target classifier's private training data by exploiting the model's learned knowledge. Previous research has developed…

Machine Learning · Computer Science 2022-06-10 Lukas Struppek , Dominik Hintersdorf , Antonio De Almeida Correia , Antonia Adler , Kristian Kersting

Membership inference attacks (MIAs) against Diffusion Models (DMs) raise pressing privacy concerns by revealing whether a sample was part of the training set. While existing methods typically rely on measuring reconstruction error across…

Machine Learning · Computer Science 2026-04-27 Mingxing Rao , Bowen Qu , Daniel Moyer

The potential of transformer-based LLMs risks being hindered by privacy concerns due to their reliance on extensive datasets, possibly including sensitive information. Regulatory measures like GDPR and CCPA call for using robust auditing…

Cryptography and Security · Computer Science 2024-06-25 Filippo Galli , Luca Melis , Tommaso Cucinotta

Model inversion attacks (MIAs) aim to reconstruct class-representative samples from trained models. Recent generative MIAs utilize generative adversarial networks to learn image priors that guide the inversion process, yielding…

Machine Learning · Computer Science 2025-09-25 Xiong Peng , Bo Han , Fengfei Yu , Tongliang Liu , Feng Liu , Mingyuan Zhou

The arms race between attacks and defenses for machine learning models has come to a forefront in recent years, in both the security community and the privacy community. However, one big limitation of previous research is that the security…

Machine Learning · Statistics 2019-08-27 Liwei Song , Reza Shokri , Prateek Mittal

The rapid adoption of deep learning in sensitive domains has brought tremendous benefits. However, this widespread adoption has also given rise to serious vulnerabilities, particularly model inversion (MI) attacks, posing a significant…

Cryptography and Security · Computer Science 2025-05-01 Wencheng Yang , Song Wang , Di Wu , Taotao Cai , Yanming Zhu , Shicheng Wei , Yiying Zhang , Xu Yang , Zhaohui Tang , Yan Li

Retrieval-Augmented Generation (RAG) and Supervised Finetuning (SFT) have become the predominant paradigms for equipping Large Language Models (LLMs) with external knowledge for diverse, knowledge-intensive tasks. However, while such…

Cryptography and Security · Computer Science 2025-12-04 Haowei Fu , Bo Ni , Han Xu , Kunpeng Liu , Dan Lin , Tyler Derr

The primary promise of decentralized learning is to allow users to engage in the training of machine learning models in a collaborative manner while keeping their data on their premises and without relying on any central entity. However,…

Machine Learning · Computer Science 2025-11-14 Ousmane Touat , Jezekael Brunon , Yacine Belal , Julien Nicolas , César Sabater , Mohamed Maouche , Sonia Ben Mokhtar

Large Language Models (LLMs) pose significant privacy risks, potentially leaking training data due to implicit memorization. Existing privacy attacks primarily focus on membership inference attacks (MIAs) or data extraction attacks, but…

Computation and Language · Computer Science 2025-06-11 Wenlong Meng , Zhenyuan Guo , Lenan Wu , Chen Gong , Wenyan Liu , Weixian Li , Chengkun Wei , Wenzhi Chen