English
Related papers

Related papers: TrojanEdit: Multimodal Backdoor Attack Against Ima…

200 papers

Diffusion models have achieved notable success in image generation, but they remain highly vulnerable to backdoor attacks, which compromise their integrity by producing specific undesirable outputs when presented with a pre-defined trigger.…

Cryptography and Security · Computer Science 2024-09-10 Yichuan Mo , Hui Huang , Mingjie Li , Ang Li , Yisen Wang

Despite the ability of existing large-scale text-to-image (T2I) models to generate high-quality images from detailed textual descriptions, they often lack the ability to precisely edit the generated or real images. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Chong Mou , Xintao Wang , Jiechong Song , Ying Shan , Jian Zhang

Diffusion models have emerged as state-of-the-art generative frameworks, excelling in producing high-quality multi-modal samples. However, recent studies have revealed their vulnerability to backdoor attacks, where backdoored models…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Vu Tuan Truong , Long Bao Le

Accurate and controllable image editing is a challenging task that has attracted significant attention recently. Notably, DragGAN is an interactive point-based image editing framework that achieves impressive editing results with…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Yujun Shi , Chuhui Xue , Jun Hao Liew , Jiachun Pan , Hanshu Yan , Wenqing Zhang , Vincent Y. F. Tan , Song Bai

Multimodal clothing image editing refers to the precise adjustment and modification of clothing images using data such as textual descriptions and visual images as control conditions, which effectively improves the work efficiency of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Di Cheng , YingJie Shi , ShiXin Sun , JiaFu Zhang , WeiJing Wang , Yu Liu

Talking head generation with arbitrary identities and speech audio remains a crucial problem in the realm of the virtual metaverse. Recently, diffusion models have become a popular generative technique in this field with their strong…

Graphics · Computer Science 2025-08-11 Xinyang Li , Gen Li , Zhihui Lin , Yichen Qian , GongXin Yao , Weinan Jia , Aowen Wang , Weihua Chen , Fan Wang

Current image generation models can effortlessly produce high-quality, highly realistic images, but this also increases the risk of misuse. In various Text-to-Image or Image-to-Image tasks, attackers can generate a series of images…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Hao Cheng , Erjia Xiao , Jiayan Yang , Jiahang Cao , Qiang Zhang , Jize Zhang , Kaidi Xu , Jindong Gu , Renjing Xu

Recent developments in text-to-image models, particularly Stable Diffusion, have marked significant achievements in various applications. With these advancements, there are growing safety concerns about the vulnerability of the model that…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Chenyu Zhang , Lanjun Wang , Anan Liu

To gather a significant quantity of annotated training data for high-performance image classification models, numerous companies opt to enlist third-party providers to label their unlabeled data. This practice is widely regarded as secure,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Dazhong Rong , Guoyao Yu , Shuheng Shen , Xinyi Fu , Peng Qian , Jianhai Chen , Qinming He , Xing Fu , Weiqiang Wang

Text-guided image editing aims to modify specific regions according to the target prompt while preserving the identity of the source image. Recent methods exploit explicit binary masks to constrain editing, but hard mask boundaries…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Yongwen Lai , Chaoqun Wang , Shaobo Min

Advanced text-to-image diffusion models raise safety concerns regarding identity privacy violation, copyright infringement, and Not Safe For Work content generation. Towards this, unlearning methods have been developed to erase these…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Xiaoxuan Han , Songlin Yang , Wei Wang , Yang Li , Jing Dong

Robust invisible watermarks are widely used to support copyright protection, content provenance, and accountability by embedding hidden signals designed to survive common post-processing operations. However, diffusion-based image editing…

Image and Video Processing · Electrical Eng. & Systems 2026-03-16 Qian Qi , Jiangyun Tang , Jim Lee , Emily Davis , Finn Carter

Multimodal learning involves developing models that can integrate information from various sources like images and texts. In this field, multimodal text generation is a crucial aspect that involves processing data from multiple modalities…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Youze Wang , Wenbo Hu , Richang Hong

Recent advances in diffusion models have brought remarkable visual fidelity to instruction-guided image editing. However, their global denoising process inherently entangles the edited region with the entire image context, leading to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Qingyang Mao , Qi Cai , Yehao Li , Yingwei Pan , Mingyue Cheng , Ting Yao , Qi Liu , Tao Mei

Recently, it has been shown that deep learning models are vulnerable to Trojan attacks, where an attacker can install a backdoor during training time to make the resultant model misidentify samples contaminated with a small trigger patch.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Haripriya Harikumar , Vuong Le , Santu Rana , Sourangshu Bhattacharya , Sunil Gupta , Svetha Venkatesh

While text-to-image diffusion models demonstrate impressive generation capabilities, they also exhibit vulnerability to backdoor attacks, which involve the manipulation of model outputs through malicious triggers. In this paper, for the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Zhongqi Wang , Jie Zhang , Shiguang Shan , Xilin Chen

With the swift advancement of deep learning, state-of-the-art algorithms have been utilized in various social situations. Nonetheless, some algorithms have been discovered to exhibit biases and provide unequal results. The current debiasing…

Machine Learning · Computer Science 2024-07-02 Shangxi Wu , Qiuyang He , Jian Yu , Jitao Sang

Multi-Modal Language Models (MLLMs) have transformed artificial intelligence by combining visual and text data, making applications like image captioning, visual question answering, and multi-modal content creation possible. This ability to…

Cryptography and Security · Computer Science 2024-11-11 Pete Janowczyk , Linda Laurier , Ave Giulietta , Arlo Octavia , Meade Cleti

In this study, we aim to enhance the capabilities of diffusion-based text-to-image (T2I) generation models by integrating diverse modalities beyond textual descriptions within a unified framework. To this end, we categorize widely used…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Sungnyun Kim , Junsoo Lee , Kibeom Hong , Daesik Kim , Namhyuk Ahn

Recent advancements in deep learning-based compression techniques have surpassed traditional methods. However, deep neural networks remain vulnerable to backdoor attacks, where pre-defined triggers induce malicious behaviors. This paper…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Yi Yu , Yufei Wang , Wenhan Yang , Lanqing Guo , Shijian Lu , Ling-Yu Duan , Yap-Peng Tan , Alex C. Kot