中文
相关论文

相关论文: TrojanEdit: Multimodal Backdoor Attack Against Ima…

200 篇论文

Diffusion models have achieved notable success in image generation, but they remain highly vulnerable to backdoor attacks, which compromise their integrity by producing specific undesirable outputs when presented with a pre-defined trigger.…

密码学与安全 · 计算机科学 2024-09-10 Yichuan Mo , Hui Huang , Mingjie Li , Ang Li , Yisen Wang

Despite the ability of existing large-scale text-to-image (T2I) models to generate high-quality images from detailed textual descriptions, they often lack the ability to precisely edit the generated or real images. In this paper, we propose…

计算机视觉与模式识别 · 计算机科学 2023-11-21 Chong Mou , Xintao Wang , Jiechong Song , Ying Shan , Jian Zhang

Diffusion models have emerged as state-of-the-art generative frameworks, excelling in producing high-quality multi-modal samples. However, recent studies have revealed their vulnerability to backdoor attacks, where backdoored models…

计算机视觉与模式识别 · 计算机科学 2025-03-04 Vu Tuan Truong , Long Bao Le

Accurate and controllable image editing is a challenging task that has attracted significant attention recently. Notably, DragGAN is an interactive point-based image editing framework that achieves impressive editing results with…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Yujun Shi , Chuhui Xue , Jun Hao Liew , Jiachun Pan , Hanshu Yan , Wenqing Zhang , Vincent Y. F. Tan , Song Bai

Multimodal clothing image editing refers to the precise adjustment and modification of clothing images using data such as textual descriptions and visual images as control conditions, which effectively improves the work efficiency of…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Di Cheng , YingJie Shi , ShiXin Sun , JiaFu Zhang , WeiJing Wang , Yu Liu

Talking head generation with arbitrary identities and speech audio remains a crucial problem in the realm of the virtual metaverse. Recently, diffusion models have become a popular generative technique in this field with their strong…

图形学 · 计算机科学 2025-08-11 Xinyang Li , Gen Li , Zhihui Lin , Yichen Qian , GongXin Yao , Weinan Jia , Aowen Wang , Weihua Chen , Fan Wang

Current image generation models can effortlessly produce high-quality, highly realistic images, but this also increases the risk of misuse. In various Text-to-Image or Image-to-Image tasks, attackers can generate a series of images…

计算机视觉与模式识别 · 计算机科学 2025-05-01 Hao Cheng , Erjia Xiao , Jiayan Yang , Jiahang Cao , Qiang Zhang , Jize Zhang , Kaidi Xu , Jindong Gu , Renjing Xu

Recent developments in text-to-image models, particularly Stable Diffusion, have marked significant achievements in various applications. With these advancements, there are growing safety concerns about the vulnerability of the model that…

计算机视觉与模式识别 · 计算机科学 2024-01-18 Chenyu Zhang , Lanjun Wang , Anan Liu

To gather a significant quantity of annotated training data for high-performance image classification models, numerous companies opt to enlist third-party providers to label their unlabeled data. This practice is widely regarded as secure,…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Dazhong Rong , Guoyao Yu , Shuheng Shen , Xinyi Fu , Peng Qian , Jianhai Chen , Qinming He , Xing Fu , Weiqiang Wang

Text-guided image editing aims to modify specific regions according to the target prompt while preserving the identity of the source image. Recent methods exploit explicit binary masks to constrain editing, but hard mask boundaries…

计算机视觉与模式识别 · 计算机科学 2026-02-10 Yongwen Lai , Chaoqun Wang , Shaobo Min

Advanced text-to-image diffusion models raise safety concerns regarding identity privacy violation, copyright infringement, and Not Safe For Work content generation. Towards this, unlearning methods have been developed to erase these…

计算机视觉与模式识别 · 计算机科学 2024-05-01 Xiaoxuan Han , Songlin Yang , Wei Wang , Yang Li , Jing Dong

Robust invisible watermarks are widely used to support copyright protection, content provenance, and accountability by embedding hidden signals designed to survive common post-processing operations. However, diffusion-based image editing…

图像与视频处理 · 电气工程与系统科学 2026-03-16 Qian Qi , Jiangyun Tang , Jim Lee , Emily Davis , Finn Carter

Multimodal learning involves developing models that can integrate information from various sources like images and texts. In this field, multimodal text generation is a crucial aspect that involves processing data from multiple modalities…

计算机视觉与模式识别 · 计算机科学 2024-01-24 Youze Wang , Wenbo Hu , Richang Hong

Recent advances in diffusion models have brought remarkable visual fidelity to instruction-guided image editing. However, their global denoising process inherently entangles the edited region with the entire image context, leading to…

计算机视觉与模式识别 · 计算机科学 2026-02-09 Qingyang Mao , Qi Cai , Yehao Li , Yingwei Pan , Mingyue Cheng , Ting Yao , Qi Liu , Tao Mei

Recently, it has been shown that deep learning models are vulnerable to Trojan attacks, where an attacker can install a backdoor during training time to make the resultant model misidentify samples contaminated with a small trigger patch.…

计算机视觉与模式识别 · 计算机科学 2020-06-11 Haripriya Harikumar , Vuong Le , Santu Rana , Sourangshu Bhattacharya , Sunil Gupta , Svetha Venkatesh

While text-to-image diffusion models demonstrate impressive generation capabilities, they also exhibit vulnerability to backdoor attacks, which involve the manipulation of model outputs through malicious triggers. In this paper, for the…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Zhongqi Wang , Jie Zhang , Shiguang Shan , Xilin Chen

With the swift advancement of deep learning, state-of-the-art algorithms have been utilized in various social situations. Nonetheless, some algorithms have been discovered to exhibit biases and provide unequal results. The current debiasing…

机器学习 · 计算机科学 2024-07-02 Shangxi Wu , Qiuyang He , Jian Yu , Jitao Sang

Multi-Modal Language Models (MLLMs) have transformed artificial intelligence by combining visual and text data, making applications like image captioning, visual question answering, and multi-modal content creation possible. This ability to…

密码学与安全 · 计算机科学 2024-11-11 Pete Janowczyk , Linda Laurier , Ave Giulietta , Arlo Octavia , Meade Cleti

In this study, we aim to enhance the capabilities of diffusion-based text-to-image (T2I) generation models by integrating diverse modalities beyond textual descriptions within a unified framework. To this end, we categorize widely used…

计算机视觉与模式识别 · 计算机科学 2025-08-27 Sungnyun Kim , Junsoo Lee , Kibeom Hong , Daesik Kim , Namhyuk Ahn

Recent advancements in deep learning-based compression techniques have surpassed traditional methods. However, deep neural networks remain vulnerable to backdoor attacks, where pre-defined triggers induce malicious behaviors. This paper…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Yi Yu , Yufei Wang , Wenhan Yang , Lanqing Guo , Shijian Lu , Ling-Yu Duan , Yap-Peng Tan , Alex C. Kot