中文
相关论文

相关论文: SneakyPrompt: Jailbreaking Text-to-image Generativ…

200 篇论文

Recently, stable diffusion (SD) models have typically flourished in the field of image synthesis and personalized editing, with a range of photorealistic and unprecedented images being successfully generated. As a result, widespread…

计算机视觉与模式识别 · 计算机科学 2024-07-22 Zhiyuan Ma , Guoli Jia , Biqing Qi , Bowen Zhou

The rise of deep learning models in the digital era has raised substantial concerns regarding the generation of Not-Safe-for-Work (NSFW) content. Existing defense methods primarily involve model fine-tuning and post-hoc content moderation.…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Xin Zhao , Xiaojun Chen , Yuexin Xuan , Zhendong Zhao , Xiaojun Jia , Xinfeng Li , Xiaofeng Wang

Well-designed prompts can guide text-to-image models to generate amazing images. However, the performant prompts are often model-specific and misaligned with user input. Instead of laborious human engineering, we propose prompt adaptation,…

计算与语言 · 计算机科学 2024-01-01 Yaru Hao , Zewen Chi , Li Dong , Furu Wei

Image generation models (IGMs), while capable of producing impressive and creative content, often memorize a wide range of undesirable concepts from their training data, leading to the reproduction of unsafe content such as NSFW imagery and…

计算机视觉与模式识别 · 计算机科学 2026-05-07 Renyang Liu , Kangjie Chen , Han Qiu , Jie Zhang , Kwok-Yan Lam , Tianwei Zhang , See-Kiong Ng

Recently, various types of Text-to-Image (T2I) models have emerged (such as DALL-E and Stable Diffusion), and showing their advantages in different aspects. Therefore, some third-party service platforms collect different model interfaces…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Ji Guo , Wenbo Jiang , Rui Zhang , Guoming Lu , Hongwei Li

The rapid development of text-to-image generation has brought rising ethical considerations, especially regarding gender bias. Given a text prompt as input, text-to-image models generate images according to the prompt. Pioneering models…

计算机与社会 · 计算机科学 2024-08-22 Yankun Wu , Yuta Nakashima , Noa Garcia

Text-to-image (T2I) diffusion models have drawn attention for their ability to generate high-quality images with precise text alignment. However, these models can also be misused to produce inappropriate content. Existing safety measures,…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Hongxiang Zhang , Yifeng He , Hao Chen

Text-conditioned image generation models have recently achieved astonishing image quality and alignment results. Consequently, they are employed in a fast-growing number of applications. Since they are highly data-driven, relying on…

计算机视觉与模式识别 · 计算机科学 2023-09-22 Manuel Brack , Patrick Schramowski , Kristian Kersting

Text-conditioned image generation models have recently achieved astonishing results in image quality and text alignment and are consequently employed in a fast-growing number of applications. Since they are highly data-driven, relying on…

计算机视觉与模式识别 · 计算机科学 2023-04-27 Patrick Schramowski , Manuel Brack , Björn Deiseroth , Kristian Kersting

Text-to-image diffusion models have achieved remarkable success in generating high-quality contents from text prompts. However, their reliance on publicly available data and the growing trend of data sharing for fine-tuning make these…

计算机视觉与模式识别 · 计算机科学 2025-03-14 Sangwon Jang , June Suk Choi , Jaehyeong Jo , Kimin Lee , Sung Ju Hwang

Warning: this paper contains content that may be inappropriate or offensive. As generative models become available for public use in various applications, testing and analyzing vulnerabilities of these models has become a priority. In this…

Despite the integration of safety alignment and external filters, text-to-image (T2I) generative systems are still susceptible to producing harmful content, such as sexual or violent imagery. This raises serious concerns about unintended…

密码学与安全 · 计算机科学 2025-12-09 Boheng Li , Junjie Wang , Yiming Li , Zhiyang Hu , Leyi Qi , Jianshuo Dong , Run Wang , Han Qiu , Zhan Qin , Tianwei Zhang

Despite the notable advancements and versatility of multi-modal diffusion models, such as text-to-image models, their susceptibility to adversarial inputs remains underexplored. Contrary to expectations, our investigations reveal that the…

计算机视觉与模式识别 · 计算机科学 2025-10-31 Xiaosen Wang , Zhijin Ge , Shaokang Wang

Large-scale text-to-image generative models have been a ground-breaking development in generative AI, with diffusion models showing their astounding ability to synthesize convincing images following an input text prompt. The goal of image…

计算机视觉与模式识别 · 计算机科学 2023-09-28 Kai Wang , Fei Yang , Shiqi Yang , Muhammad Atif Butt , Joost van de Weijer

With the rise of text-to-image (T2I) generative AI models reaching wide audiences, it is critical to evaluate model robustness against non-obvious attacks to mitigate the generation of offensive images. By focusing on ``implicitly…

With the help of conditioning mechanisms, the state-of-the-art diffusion models have achieved tremendous success in guided image generation, particularly in text-to-image synthesis. To gain a better understanding of the training process and…

密码学与安全 · 计算机科学 2023-10-24 Shengfang Zhai , Yinpeng Dong , Qingni Shen , Shi Pu , Yuejian Fang , Hang Su

Recent developments in text-to-image models, particularly Stable Diffusion, have marked significant achievements in various applications. With these advancements, there are growing safety concerns about the vulnerability of the model that…

计算机视觉与模式识别 · 计算机科学 2024-01-18 Chenyu Zhang , Lanjun Wang , Anan Liu

Text-to-image generation models~(e.g., Stable Diffusion) have achieved significant advancements, enabling the creation of high-quality and realistic images based on textual descriptions. Prompt inversion, the task of identifying the textual…

计算机视觉与模式识别 · 计算机科学 2026-03-06 Mingzhe Li , Kejing Xia , Gehao Zhang , Zhenting Wang , Guanhong Tao , Siqi Pan , Juan Zhai , Shiqing Ma

Text-to-image (T2I) models such as Stable Diffusion and DALLE remain susceptible to generating harmful or Not-Safe-For-Work (NSFW) content under jailbreak attacks despite deployed safety filters. Existing jailbreak attacks either rely on…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Haolun Zheng , Yu He , Tailun Chen , Shuo Shao , Zhixuan Chu , Hongbin Zhou , Lan Tao , Zhan Qin , Kui Ren

Large-scale vision-and-language models, such as CLIP, are typically trained on web-scale data, which can introduce inappropriate content and lead to the development of unsafe and biased behavior. This, in turn, hampers their applicability…

计算机视觉与模式识别 · 计算机科学 2024-07-25 Samuele Poppi , Tobia Poppi , Federico Cocchi , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara