English
Related papers

Related papers: MMA-Diffusion: MultiModal Attack on Diffusion Mode…

200 papers

Not Safe/Suitable for Work (NSFW) content is rampant on social networks and poses serious harm to citizens, especially minors. Current detection methods mainly rely on deep learning-based image recognition and classification. However, NSFW…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Han Bao , Qinying Wang , Zhi Chen , Qingming Li , Xuhong Zhang , Changjiang Li , Zonghui Wang , Shouling Ji , Wenzhi Chen

Text-to-image generation (T2I) refers to the text-guided generation of high-quality images. In the past few years, T2I has attracted widespread attention and numerous works have emerged. In this survey, we comprehensively review 141 works…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Pengfei Yang , Ngai-Man Cheung , Xinda Ma

Despite their remarkable image generation capabilities, text-to-image diffusion models inadvertently learn inappropriate concepts from vast and unfiltered training data, which leads to various ethical and business risks. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Die Chen , Zhiwen Li , Mingyuan Fan , Cen Chen , Wenmeng Zhou , Yanhao Wang , Yaliang Li

As recent advances in large-scale Text-to-Image (T2I) diffusion models have yielded remarkable high-quality image generation, diverse downstream Image-to-Image (I2I) applications have emerged. Despite the impressive results achieved by…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Geonung Kim , Beomsu Kim , Eunhyeok Park , Sunghyun Cho

Model editing offers a low-cost technique to inject or correct a particular behavior in a pre-trained model without extensive retraining, supporting applications such as factual correction and bias mitigation. Despite this common practice,…

Artificial Intelligence · Computer Science 2025-06-24 Feng He , Zhenyang Liu , Marco Valentino , Zhixue Zhao

This research focuses on the development and enhancement of text-to-image denoising diffusion models, addressing key challenges such as limited sample diversity and training instability. By incorporating Classifier-Free Guidance (CFG) and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Rajdeep Roshan Sahu

Text-to-image (T2I) models can generate not-safe-for-work (NSFW) content, motivating multi-stage safety pipelines with both text and image filters. Newer LLM-based filters detect latent intent beyond keywords, making token-level…

Machine Learning · Computer Science 2026-05-26 Zixuan Chen , Hao Lin , Ke Xu , Xinghao Jiang , Tanfeng Sun

Text-to-image (T2I) diffusion models have revolutionized generative modeling by producing high-fidelity, diverse, and visually realistic images from textual prompts. Despite these advances, existing models struggle with complex prompts…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Eric Hanchen Jiang , Yasi Zhang , Zhi Zhang , Yixin Wan , Andrew Lizarraga , Shufan Li , Ying Nian Wu

Applying diffusion models to image-to-image translation (I2I) has recently received increasing attention due to its practical applications. Previous attempts inject information from the source image into each denoising step for an iterative…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Mengfei Xia , Yu Zhou , Ran Yi , Yong-Jin Liu , Wenping Wang

Recent studies show that diffusion models (DMs) are vulnerable to backdoor attacks. Existing backdoor attacks impose unconcealed triggers (e.g., a gray box and eyeglasses) that contain evident patterns, rendering remarkable attack effects…

Cryptography and Security · Computer Science 2025-03-03 Yuning Han , Bingyin Zhao , Rui Chu , Feng Luo , Biplab Sikdar , Yingjie Lao

With the rapid advancement of text-to-image (T2I) models, ensuring their safety has become increasingly critical. Existing safety approaches can be categorized into training-time and inference-time methods. While inference-time methods are…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Ruiyang Zhang , Jiahao Luo , Xiaoru Feng , Qiufan Pang , Yaodong Yang , Juntao Dai

The rise in popularity of text-to-image generative artificial intelligence (AI) has attracted widespread public interest. We demonstrate that this technology can be attacked to generate content that subtly manipulates its users. We propose…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Jordan Vice , Naveed Akhtar , Richard Hartley , Ajmal Mian

Recent text-to-video (T2V) models can synthesize complex videos from lightweight natural language prompts, raising urgent concerns about safety alignment in the event of misuse in the real world. Prior jailbreak attacks typically rewrite…

Cryptography and Security · Computer Science 2026-03-10 Moyang Chen , Zonghao Ying , Wenzhuo Xu , Quancheng Zou , Deyue Zhang , Dongdong Yang , Xiangzheng Zhang

Denoising probabilistic diffusion models have shown breakthrough performance to generate more photo-realistic images or human-level illustrations than the prior models such as GANs. This high image-generation capability has stimulated the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Takami Sato , Justin Yue , Nanze Chen , Ningfei Wang , Qi Alfred Chen

We introduce a new attack paradigm that embeds hidden adversarial capabilities directly into diffusion models via fine-tuning, without altering their observable behavior or requiring modifications during inference. Unlike prior approaches…

Machine Learning · Computer Science 2025-04-15 Lucas Beerens , Desmond J. Higham

Recent advances in Diffusion Models have enabled the generation of images from text, with powerful closed-source models like DALL-E and Midjourney leading the way. However, open-source alternatives, such as StabilityAI's Stable Diffusion,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Massine El Khader , Elias Al Bouzidi , Abdellah Oumida , Mohammed Sbaihi , Eliott Binard , Jean-Philippe Poli , Wassila Ouerdane , Boussad Addad , Katarzyna Kapusta

Recent approaches employing imperceptible perturbations in input images have demonstrated promising potential to counter malicious manipulations in diffusion-based image editing systems. However, existing methods suffer from limited…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Jie Zhang , Shuai Dong , Shiguang Shan , Xilin Chen

Text-to-image (T2I) generative models have gained increased popularity in the public domain. While boasting impressive user-guided generative abilities, their black-box nature exposes users to intentionally- and intrinsically-biased…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Jordan Vice , Naveed Akhtar , Richard Hartley , Ajmal Mian

Recent spatial control methods for text-to-image (T2I) diffusion models have shown compelling results. However, these methods still fail to precisely follow the control conditions and generate the corresponding images, especially when…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Jiaze Wang , Rui Chen , Haowang Cui

Text-to-image (T2I) research has grown explosively in the past year, owing to the large-scale pre-trained diffusion models and many emerging personalization and editing approaches. Yet, one pain point persists: the text prompt engineering,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Xingqian Xu , Jiayi Guo , Zhangyang Wang , Gao Huang , Irfan Essa , Humphrey Shi