English
Related papers

Related papers: Membership Inference Attacks against Diffusion Mod…

200 papers

We introduce the concept of deceptive diffusion -- training a generative AI model to produce adversarial images. Whereas a traditional adversarial attack algorithm aims to perturb an existing image to induce a misclassificaton, the…

Machine Learning · Computer Science 2024-07-01 Lucas Beerens , Catherine F. Higham , Desmond J. Higham

Generating the motion of orchestral conductors from a given piece of symphony music is a challenging task since it requires a model to learn semantic music features and capture the underlying distribution of real conducting motion. Prior…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-14 Zhuoran Zhao , Jinbin Bai , Delong Chen , Debang Wang , Yubo Pan

Artificial intelligence and machine learning have been integrated into all aspects of our lives and the privacy of personal data has attracted more and more attention. Since the generation of the model needs to extract the effective…

Cryptography and Security · Computer Science 2022-02-14 Ruikang Yang , Jianfeng Ma , Yinbin Miao , Xindi Ma

This paper introduces a novel approach to membership inference attacks (MIA) targeting stable diffusion computer vision models, specifically focusing on the highly sophisticated Stable Diffusion V2 by StabilityAI. MIAs aim to extract…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Thomas Cilloni , Charles Fleming , Charles Walter

The use of personal data for training machine learning systems comes with a privacy threat and measuring the level of privacy of a model is one of the major challenges in machine learning today. Identifying training data based on a trained…

Machine Learning · Computer Science 2022-03-24 Ganesh Del Grosso , Hamid Jalalzai , Georg Pichler , Catuscia Palamidessi , Pablo Piantanida

Federated learning (FL) is vulnerable to data poisoning attacks due to its distributed nature. Although recent GAN-based data poisoning methods have indicated the potential of using generative AI to generate seemingly legitimate poisoned…

Cryptography and Security · Computer Science 2026-05-18 Wei Sun , Yijun Chen , Bo Gao , Ke Xiong , Yuwei Wang , Pingyi Fan , Khaled Ben Letaief

Many existing adversarial attacks generate $L_p$-norm perturbations on image RGB space. Despite some achievements in transferability and attack success rate, the crafted adversarial examples are easily perceived by human eyes. Towards…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Jianqi Chen , Hao Chen , Keyan Chen , Yilan Zhang , Zhengxia Zou , Zhenwei Shi

Diffusion models (DMs) are advanced deep learning models that achieved state-of-the-art capability on a wide range of generative tasks. However, recent studies have shown their vulnerability regarding backdoor attacks, in which backdoored…

Artificial Intelligence · Computer Science 2024-09-24 Vu Tuan Truong , Long Bao Le

Membership Inference Attacks (MIAs) pose a critical privacy threat by enabling adversaries to determine whether a specific sample was included in a model's training dataset. Despite extensive research on MIAs, systematic comparisons between…

Cryptography and Security · Computer Science 2025-10-21 Owais Makroo , Siva Rajesh Kasa , Sumegh Roychowdhury , Karan Gupta , Nikhil Pattisapu , Santhosh Kasa , Sumit Negi

Robustness of deep learning models is a property that has recently gained increasing attention. We explore a notion of robustness for generative adversarial models that is pertinent to their internal interactive structure, and show that,…

Machine Learning · Computer Science 2019-10-11 Zhi Xu , Chengtao Li , Stefanie Jegelka

In recent years, diffusion models have achieved remarkable success in the realm of high-quality image generation, garnering increased attention. This surge in interest is paralleled by a growing concern over the security threats associated…

Machine Learning · Computer Science 2024-06-04 Sen Li , Junchi Ma , Minhao Cheng

Due to their powerful image generation capabilities, diffusion-based adversarial example generation methods through image editing are rapidly gaining popularity. However, due to reliance on the discriminative capability of the diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Gaozheng Pei , Ke Ma , Dongpeng Zhang , Chengzhi Sun , Qianqian Xu , Qingming Huang

Membership inference attacks are one of the simplest forms of privacy leakage for machine learning models: given a data point and model, determine whether the point was used to train the model. Existing membership inference attacks exploit…

Cryptography and Security · Computer Science 2021-12-07 Christopher A. Choquette-Choo , Florian Tramer , Nicholas Carlini , Nicolas Papernot

Neural networks are known to be susceptible to adversarial samples: small variations of natural examples crafted to deliberately mislead the models. While they can be easily generated using gradient-based techniques in digital and physical…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Haotian Xue , Alexandre Araujo , Bin Hu , Yongxin Chen

Diffusion Probabilistic Models (DPMs) have achieved significant success in generative tasks. However, their training and sampling processes suffer from the issue of distribution mismatch. During the denoising process, the input data…

Machine Learning · Computer Science 2025-02-25 Zekun Wang , Mingyang Yi , Shuchen Xue , Zhenguo Li , Ming Liu , Bing Qin , Zhi-Ming Ma

With an increase in low-cost machine learning APIs, advanced machine learning models may be trained on private datasets and monetized by providing them as a service. However, privacy researchers have demonstrated that these models may leak…

Intrusion Detection Systems (IDSs) are a key component for protecting Internet of Things (IoT) environments. However, in Machine Learning-based (ML-based) IDSs, performance is often degraded by the strong class imbalance between benign and…

Machine Learning · Computer Science 2026-01-26 Estela Sánchez-Carballo , Francisco M. Melgarejo-Meseguer , José Luis Rojo-Álvarez

In the exciting generative AI era, the diffusion model has emerged as a very powerful and widely adopted content generation and editing tool for various data modalities, making the study of their potential security risks very necessary and…

Cryptography and Security · Computer Science 2024-02-06 Yang Sui , Huy Phan , Jinqi Xiao , Tianfang Zhang , Zijie Tang , Cong Shi , Yan Wang , Yingying Chen , Bo Yuan

While many unsupervised learning models focus on one family of tasks, either generative or discriminative, we explore the possibility of a unified representation learner: a model which addresses both families of tasks simultaneously. We…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Soumik Mukhopadhyay , Matthew Gwilliam , Yosuke Yamaguchi , Vatsal Agarwal , Namitha Padmanabhan , Archana Swaminathan , Tianyi Zhou , Jun Ohya , Abhinav Shrivastava

Generative models are gaining significant attention as potential catalysts for a novel industrial revolution. Since automated sample generation can be useful to solve privacy and data scarcity issues that usually affect learned biometric…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Saverio Cavasin , Daniele Mari , Simone Milani , Mauro Conti