English
Related papers

Related papers: Privacy Protection in Personalized Diffusion Model…

200 papers

Protecting personal data against exploitation of machine learning models is crucial. Recently, availability attacks have shown great promise to provide an extra layer of protection against the unauthorized use of data to train neural…

Machine Learning · Computer Science 2024-01-12 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

Adversarial attacks can mislead neural network classifiers. The defense against adversarial attacks is important for AI safety. Adversarial purification is a family of approaches that defend adversarial attacks with suitable pre-processing.…

Machine Learning · Computer Science 2023-10-31 Boya Zhang , Weijian Luo , Zhihua Zhang

The commercialization of text-to-image diffusion models (DMs) brings forth potential copyright concerns. Despite numerous attempts to protect DMs from copyright issues, the vulnerabilities of these solutions are underexplored. In this…

Cryptography and Security · Computer Science 2024-05-28 Haonan Wang , Qianli Shen , Yao Tong , Yang Zhang , Kenji Kawaguchi

The increasing reliance on diffusion models for generating synthetic images has amplified concerns about the unauthorized use of personal data, particularly facial images, in model training. In this paper, we introduce a novel identity…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Jayneel Vora , Aditya Krishnan , Nader Bouacida , Prabhu RV Shankar , Prasant Mohapatra

Latent diffusion models can be used as a powerful augmentation method to artificially extend datasets for enhanced training. To the human eye, these augmented images look very different to the originals. Previous work has suggested to use…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Julian Lorenz , Katja Ludwig , Valentin Haug , Rainer Lienhart

Many physical adversarial patch generation methods are widely proposed to protect personal privacy from malicious monitoring using object detectors. However, they usually fail to generate satisfactory patch images in terms of both…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Shuo-Yen Lin , Ernie Chu , Che-Hsien Lin , Jun-Cheng Chen , Jia-Ching Wang

To protect user privacy in data analysis, a state-of-the-art strategy is differential privacy in which scientific noise is injected into the real analysis output. The noise masks individual's sensitive information contained in the dataset.…

Cryptography and Security · Computer Science 2018-06-20 Xuan-Son Vu , Lili Jiang

Recently, diffusion models have become popular tools for image synthesis because of their high-quality outputs. However, like other large-scale models, they may leak private information about their training data. Here, we demonstrate a…

Machine Learning · Computer Science 2023-12-11 Shuai Tang , Zhiwei Steven Wu , Sergul Aydore , Michael Kearns , Aaron Roth

Recent thrilling progress in large-scale text-to-image (T2I) models has unlocked unprecedented synthesis quality of AI-generated content (AIGC) including image generation, 3D and video composition. Further, personalized techniques enable…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Yanbing Zhang , Mengping Yang , Qin Zhou , Zhe Wang

Text-to-image (T2I) diffusion models have shown exceptional capabilities in generating images that closely correspond to textual prompts. However, the advancement of T2I diffusion models presents significant risks, as the models could be…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Jie Ren , Kangrui Chen , Yingqian Cui , Shenglai Zeng , Hui Liu , Yue Xing , Jiliang Tang , Lingjuan Lyu

Adversarial examples for diffusion models are widely used as solutions for safety concerns. By adding adversarial perturbations to personal images, attackers can not edit or imitate them easily. However, it is essential to note that all…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Haotian Xue , Yongxin Chen

Despite the record-breaking performance in Text-to-Image (T2I) generation by Stable Diffusion, less research attention is paid to its adversarial robustness. In this work, we study the problem of adversarial attack generation for Stable…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Haomin Zhuang , Yihua Zhang , Sijia Liu

Text-to-image (T2I) customization empowers users to adapt the T2I diffusion model to new concepts absent in the pre-training dataset. On this basis, capturing multiple new concepts from a single image has emerged as a new task, allowing the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Junjie Shentu , Matthew Watson , Noura Al Moubayed

The objective of text-to-image (T2I) personalization is to customize a diffusion model to a user-provided reference concept, generating diverse images of the concept aligned with the target prompts. Conventional methods representing the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Jisu Nam , Heesu Kim , DongJae Lee , Siyoon Jin , Seungryong Kim , Seunggyu Chang

Due to their powerful image generation capabilities, diffusion-based adversarial example generation methods through image editing are rapidly gaining popularity. However, due to reliance on the discriminative capability of the diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Gaozheng Pei , Ke Ma , Dongpeng Zhang , Chengzhi Sun , Qianqian Xu , Qingming Huang

Recently, some research show that deep neural networks are vulnerable to the adversarial attacks, the well-trainned samples or patches could be used to trick the neural network detector or human visual perception. However, these adversarial…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Xianyi Chen , Fazhan Liu , Dong Jiang , Kai Yan

Machine learning models have been shown vulnerable to adversarial attacks launched by adversarial examples which are carefully crafted by attacker to defeat classifiers. Deep learning models cannot escape the attack either. Most of…

Computer Vision and Pattern Recognition · Computer Science 2018-12-06 Jinyin Chen , Haibin Zheng , Hui Xiong , Mengmeng Su

Multimodal Large Language Models (MLLMs) have achieved remarkable success in tasks such as image captioning, visual question answering, and cross-modal reasoning by integrating visual and textual modalities. However, their multimodal nature…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Fengling Zhu , Boshi Liu , Jingyu Hua , Sheng Zhong

Text-to-image (T2I) diffusion models are widely adopted for their strong generative capabilities, yet remain vulnerable to backdoor attacks. Existing attacks typically rely on fixed textual triggers and single-entity backdoor targets,…

Cryptography and Security · Computer Science 2026-05-28 Tianxin Chen , Wenbo Jiang , Hongqiao Chen , Zhirun Zheng , Cheng Huang

Recently, Diffusion Models (DMs) boost a wave in AI for Art yet raise new copyright concerns, where infringers benefit from using unauthorized paintings to train DMs to generate novel paintings in a similar style. To address these emerging…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Chumeng Liang , Xiaoyu Wu , Yang Hua , Jiaru Zhang , Yiming Xue , Tao Song , Zhengui Xue , Ruhui Ma , Haibing Guan