English
Related papers

Related papers: Privacy Protection in Personalized Diffusion Model…

200 papers

With the development of deep learning technology, the facial manipulation system has become powerful and easy to use. Such systems can modify the attributes of the given facial images, such as hair color, gender, and age. Malicious…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Yao Zhu , Yuefeng Chen , Xiaodan Li , Rong Zhang , Xiang Tian , Bolun Zheng , Yaowu Chen

Recent advancements in diffusion models have made fine-tuning text-to-image models for personalization increasingly accessible, but have also raised significant concerns regarding unauthorized data usage and privacy infringement. Current…

Artificial Intelligence · Computer Science 2025-12-12 Hojun Lee , Mijin Koo , Yeji Song , Nojun Kwak

Recent advances in text-based image editing have enabled fine-grained manipulation of visual content guided by natural language. However, such methods are susceptible to adversarial attacks. In this work, we propose a novel attack that…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Matteo Trippodo , Federico Becattini , Lorenzo Seidenari

Recent progress in diffusion models has profoundly enhanced the fidelity of image generation, but it has raised concerns about copyright infringements. While prior methods have introduced adversarial perturbations to prevent style…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Namhyuk Ahn , Wonhyuk Ahn , KiYoon Yoo , Daesik Kim , Seung-Hun Nam

Model inversion attacks (MIAs) aim to reconstruct private images from a target classifier's training set, thereby raising privacy concerns in AI applications. Previous GAN-based MIAs tend to suffer from inferior generative fidelity due to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Ouxiang Li , Yanbin Hao , Zhicai Wang , Bin Zhu , Shuo Wang , Zaixi Zhang , Fuli Feng

The success of deep learning based face recognition systems has given rise to serious privacy concerns due to their ability to enable unauthorized tracking of users in the digital world. Existing methods for enhancing privacy fail to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Fahad Shamshad , Muzammal Naseer , Karthik Nandakumar

Recently, the text-to-image diffusion model has gained considerable attention from the community due to its exceptional image generation capability. A representative model, Stable Diffusion, amassed more than 10 million users within just…

Cryptography and Security · Computer Science 2024-09-16 Chenyu Zhang , Mingwang Hu , Wenhui Li , Lanjun Wang

Text-to-image (T2I) diffusion models enable high-quality image generation conditioned on textual prompts. However, fine-tuning these pre-trained models for personalization raises concerns about unauthorized dataset usage. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Kuofeng Gao , Yufei Zhu , Yiming Li , Jiawang Bai , Yong Yang , Zhifeng Li , Shu-Tao Xia

Diffusion models have revolutionized customized text-to-image generation, allowing for efficient synthesis of photos from personal data with textual descriptions. However, these advancements bring forth risks including privacy breaches and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Cong Wan , Yuhang He , Xiang Song , Yihong Gong

While text-to-image diffusion models demonstrate impressive generation capabilities, they also exhibit vulnerability to backdoor attacks, which involve the manipulation of model outputs through malicious triggers. In this paper, for the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Zhongqi Wang , Jie Zhang , Shiguang Shan , Xilin Chen

With recent advances in image and video diffusion models for content creation, a plethora of techniques have been proposed for customizing their generated content. In particular, manipulating the cross-attention layers of Text-to-Image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Saman Motamed , Wouter Van Gansbeke , Luc Van Gool

Despite recent significant strides achieved by diffusion-based Text-to-Image (T2I) models, current systems are still less capable of ensuring decent compositional generation aligned with text prompts, particularly for the multi-object…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Zhipeng Bao , Yijun Li , Krishna Kumar Singh , Yu-Xiong Wang , Martial Hebert

Recently, text-to-image diffusion models have been widely used for style mimicry and personalized customization through methods such as DreamBooth and Textual Inversion. This has raised concerns about intellectual property protection and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Yanjie Li , Wenxuan Zhang , Xinqi Lyu , Yihao Liu , Bin Xiao

With the increasing prevalence of diffusion-based malicious image manipulation, existing proactive defense methods struggle to safeguard images against tampering under unknown conditions. To address this, we propose Anti-Inpainting, a…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Yimao Guo , Zuomin Qu , Wei Lu , Xiangyang Luo

Many existing adversarial attacks generate $L_p$-norm perturbations on image RGB space. Despite some achievements in transferability and attack success rate, the crafted adversarial examples are easily perceived by human eyes. Towards…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Jianqi Chen , Hao Chen , Keyan Chen , Yilan Zhang , Zhengxia Zou , Zhenwei Shi

As billions of personal data being shared through social media and network, the data privacy and security have drawn an increasing attention. Several attempts have been made to alleviate the leakage of identity information from face photos,…

Machine Learning · Computer Science 2021-08-17 Xiao Yang , Yinpeng Dong , Tianyu Pang , Hang Su , Jun Zhu , Yuefeng Chen , Hui Xue

Privacy protection has become a top priority as the proliferation of AI techniques has led to widespread collection and misuse of personal data. Anonymization and visual identity information hiding are two important facial privacy…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Xiao He , Mingrui Zhu , Dongxin Chen , Nannan Wang , Xinbo Gao

Existing diffusion-based purification methods aim to disrupt adversarial perturbations by introducing a certain amount of noise through a forward diffusion process, followed by a reverse process to recover clean examples. However, this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Gaozheng Pei , Shaojie Lyu , Gong Chen , Ke Ma , Qianqian Xu , Yingfei Sun , Qingming Huang

Recent advances in deep learning research have shown remarkable achievements across many tasks in computer vision (CV) and natural language processing (NLP). At the intersection of CV and NLP is the problem of image captioning, where the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Jiyao Li , Mingze Ni , Yifei Dong , Tianqing Zhu , Wei Liu

Recently, Text-to-Image (T2I) synthesis technology has made tremendous strides. Numerous representative T2I models have emerged and achieved promising application outcomes, such as DALL-E, Stable Diffusion, Imagen, etc. In practice, it has…

Cryptography and Security · Computer Science 2025-09-24 Wenbo Jiang , Jiaming He , Hongwei Li , Rui Zhang , Hanxiao Chen , Meng Hao , Haomiao Yang , Qingchuan Zhao , Guowen Xu