English
Related papers

Related papers: Prompt-Agnostic Adversarial Perturbation for Custo…

200 papers

Diffusion-based personalized visual content generation technologies have achieved significant breakthroughs, allowing for the creation of specific objects by just learning from a few reference photos. However, when misused to fabricate fake…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Jing Yang , Runping Xi , Yingxin Lai , Xun Lin , Zitong Yu

Diffusion model (DM) based adversarial purification (AP) has proven to be a powerful defense method that can remove adversarial perturbations and generate a purified example without threats. In principle, the pre-trained DMs can only ensure…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Guang Lin , Zerui Tao , Jianhai Zhang , Toshihisa Tanaka , Qibin Zhao

Diffusion models build a new milestone for image generation yet raising public concerns, for they can be fine-tuned on unauthorized images for customization. Protection based on adversarial attacks rises to encounter this unauthorized…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Boyang Zheng , Chumeng Liang , Xiaoyu Wu

Preference alignment in diffusion models has primarily focused on benign human preferences (e.g., aesthetic). In this paper, we propose a novel perspective: framing unrestricted adversarial example generation as a problem of aligning with…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Kaixun Jiang , Zhaoyu Chen , Haijing Guo , Jinglun Li , Jiyuan Fu , Pinxue Guo , Hao Tang , Bo Li , Wenqiang Zhang

Text-to-image diffusion models have demonstrated remarkable effectiveness in rapid and high-fidelity personalization, even when provided with only a few user images. However, the effectiveness of personalization techniques has lead to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Naresh Kumar Devulapally , Shruti Agarwal , Tejas Gokhale , Vishnu Suresh Lokhande

With the development of diffusion-based customization methods like DreamBooth, individuals now have access to train the models that can generate their personalized images. Despite the convenience, malicious users have misused these…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Yisu Liu , Jinyang An , Wanqian Zhang , Dayan Wu , Jingzi Gu , Zheng Lin , Weiping Wang

The versatility of diffusion models in generating customized images from few samples raises significant privacy concerns, particularly regarding unauthorized modifications of private content. This concerning issue has renewed the efforts in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Xide Xu , Sandesh Kamath , Muhammad Atif Butt , Bogdan Raducanu

With the development of deep learning technology, the facial manipulation system has become powerful and easy to use. Such systems can modify the attributes of the given facial images, such as hair color, gender, and age. Malicious…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Yao Zhu , Yuefeng Chen , Xiaodan Li , Rong Zhang , Xiang Tian , Bolun Zheng , Yaowu Chen

Deep Neural Networks (DNNs) are highly sensitive to imperceptible malicious perturbations, known as adversarial attacks. Following the discovery of this vulnerability in real-world imaging and vision applications, the associated safety…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Tsachi Blau , Roy Ganz , Bahjat Kawar , Alex Bronstein , Michael Elad

The few-shot fine-tuning of Latent Diffusion Models (LDMs) has enabled them to grasp new concepts from a limited number of images. However, given the vast amount of personal images accessible online, this capability raises critical concerns…

Cryptography and Security · Computer Science 2024-06-24 Ang Li , Yichuan Mo , Mingjie Li , Yisen Wang

We introduce a new attack paradigm that embeds hidden adversarial capabilities directly into diffusion models via fine-tuning, without altering their observable behavior or requiring modifications during inference. Unlike prior approaches…

Machine Learning · Computer Science 2025-04-15 Lucas Beerens , Desmond J. Higham

Deep neural networks (DNNs) have been shown to be vulnerable to adversarial examples, which can produce erroneous predictions by injecting imperceptible perturbations. In this work, we study the transferability of adversarial examples,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Zeyu Qin , Yanbo Fan , Yi Liu , Li Shen , Yong Zhang , Jue Wang , Baoyuan Wu

Large pre-trained Vision-Language Models (VLMs) such as Contrastive Language-Image Pre-training (CLIP) have been shown to be susceptible to adversarial attacks, raising concerns about their deployment in safety-critical applications like…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Lin Luo , Xin Wang , Bojia Zi , Shihao Zhao , Xingjun Ma , Yu-Gang Jiang

Diffusion models (DMs) have revolutionized data generation, particularly in text-to-image (T2I) synthesis. However, the widespread use of personalized generative models raises significant concerns regarding privacy violations and copyright…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Xinwei Liu , Xiaojun Jia , Yuan Xun , Hua Zhang , Xiaochun Cao

Personalizing generative models offers a way to guide image generation with user-provided references. Current personalization methods can invert an object or concept into the textual conditioning space and compose new natural sentences for…

Recent advancements in diffusion models revolutionize image generation but pose risks of misuse, such as replicating artworks or generating deepfakes. Existing image protection methods, though effective, struggle to balance protection…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Namhyuk Ahn , KiYoon Yoo , Wonhyuk Ahn , Daesik Kim , Seung-Hun Nam

With the increasing adoption of diffusion models for image generation and personalization, concerns regarding privacy breaches and content misuse have become more pressing. In this study, we conduct a comprehensive comparison of eight…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Kai Ye , Tianyi Chen , Zhen Wang

With the advancement of personalized image generation technologies, concerns about forgery attacks that infringe on portrait rights and privacy are growing. To address these concerns, protection perturbation algorithms have been developed…

Cryptography and Security · Computer Science 2025-08-11 Zelin Li , Ruohan Zong , Yifan Liu , Ruichen Yao , Yaokun Liu , Yang Zhang , Dong Wang

Diffusion models like Stable Diffusion have become prominent in visual synthesis tasks due to their powerful customization capabilities, which also introduce significant security risks, including deepfakes and copyright infringement. In…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Wenkui Yang , Jie Cao , Junxian Duan , Ran He

Stable Diffusion has established itself as a foundation model in generative AI artistic applications, receiving widespread research and application. Some recent fine-tuning methods have made it feasible for individuals to implant…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Zhengyue Zhao , Jinhao Duan , Kaidi Xu , Chenan Wang , Rui Zhang , Zidong Du , Qi Guo , Xing Hu