中文
相关论文

相关论文: SneakyPrompt: Jailbreaking Text-to-image Generativ…

200 篇论文

To prevent Text-to-Image (T2I) models from generating unethical images, people deploy safety filters to block inappropriate drawing prompts. Previous works have employed token replacement to search adversarial prompts that attempt to bypass…

人工智能 · 计算机科学 2024-11-27 Yimo Deng , Huangxun Chen

Text-to-image models can generate harmful images when presented with unsafe prompts, posing significant safety and societal risks. Alignment methods aim to modify these models to ensure they generate only non-harmful images, even when…

密码学与安全 · 计算机科学 2025-03-03 Yuepeng Hu , Zhengyuan Jiang , Neil Zhenqiang Gong

Despite their remarkable image generation capabilities, text-to-image diffusion models inadvertently learn inappropriate concepts from vast and unfiltered training data, which leads to various ethical and business risks. Specifically,…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Die Chen , Zhiwen Li , Mingyuan Fan , Cen Chen , Wenmeng Zhou , Yanhao Wang , Yaliang Li

Text-to-Image (T2I) models have shown great performance in generating images based on textual prompts. However, these models are vulnerable to unsafe input to generate unsafe content like sexual, harassment and illegal-activity images.…

计算机视觉与模式识别 · 计算机科学 2024-12-13 Zongyu Wu , Hongcheng Gao , Yueze Wang , Xiang Zhang , Suhang Wang

Text-to-image generation models that generate images based on prompt descriptions have attracted an increasing amount of attention during the past few months. Despite their encouraging performance, these models raise concerns about the…

密码学与安全 · 计算机科学 2023-01-10 Zeyang Sha , Zheng Li , Ning Yu , Yang Zhang

Text-to-image models have recently made significant advances in generating realistic and semantically coherent images, driven by advanced diffusion models and large-scale web-crawled datasets. However, these datasets often contain…

机器学习 · 计算机科学 2025-10-29 Byeonghu Na , Mina Kang , Jiseok Kwak , Minsang Park , Jiwoo Shin , SeJoon Jun , Gayoung Lee , Jin-Hwa Kim , Il-Chul Moon

Text-to-Image (T2I) generation is a popular AI-generated content (AIGC) technology enabling diverse and creative image synthesis. However, some outputs may contain Not Safe For Work (NSFW) content (e.g., violence), violating community…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Mingrui Liu , Sixiao Zhang , Cheng Long

Despite the impressive generative capabilities of text-to-image (T2I) diffusion models, they remain vulnerable to generating inappropriate content, especially when confronted with implicit sexual prompts. Unlike explicit harmful prompts,…

计算机视觉与模式识别 · 计算机科学 2025-10-20 Yitong Sun , Yao Huang , Ruochen Zhang , Huanran Chen , Shouwei Ruan , Ranjie Duan , Xingxing Wei

Text-to-Image (T2I) diffusion models are widely recognized for their ability to generate high-quality and diverse images based on text prompts. However, despite recent advances, these models are still prone to generating unsafe images…

计算机视觉与模式识别 · 计算机科学 2024-12-06 Jiangweizhi Peng , Zhiwei Tang , Gaowen Liu , Charles Fleming , Mingyi Hong

Recent text-to-image (T2I) models have had great success, and many benchmarks have been proposed to evaluate their performance and safety. However, they only consider explicit prompts while neglecting implicit prompts (hint at a target…

计算机与社会 · 计算机科学 2024-05-29 Yue Yang , Yuqi Lin , Hong Liu , Wenqi Shao , Runjian Chen , Hailong Shang , Yu Wang , Yu Qiao , Kaipeng Zhang , Ping Luo

Text-to-image diffusion models have gained widespread application across various domains, demonstrating remarkable creative potential. However, the strong generalization capabilities of diffusion models can inadvertently lead to the…

计算机视觉与模式识别 · 计算机科学 2025-10-24 Die Chen , Zhiwen Li , Cen Chen , Yuexiang Xie , Xiaodan Li , Jinyan Ye , Yingda Chen , Yaliang Li

Text-to-Image artificial intelligence (AI) recently saw a major breakthrough with the release of Dall-E and its open-source counterpart, Stable Diffusion. These programs allow anyone to create original visual art pieces by simply providing…

人机交互 · 计算机科学 2023-01-06 Nassim Dehouche , Kullathida Dehouche

Recently, diffusion-based deep generative models (e.g., Stable Diffusion) have shown impressive results in text-to-image synthesis. However, current text-to-image models often require multiple passes of prompt engineering by humans in order…

计算与语言 · 计算机科学 2023-11-14 Tingfeng Cao , Chengyu Wang , Bingyan Liu , Ziheng Wu , Jinhui Zhu , Jun Huang

The recent advancements in Generative AI have significantly advanced the field of text-to-image generation. The state-of-the-art text-to-image model, Stable Diffusion, is now capable of synthesizing high-quality images with a strong sense…

人机交互 · 计算机科学 2024-03-08 Zhijie Wang , Yuheng Huang , Da Song , Lei Ma , Tianyi Zhang

Generative Artificial Intelligence (AI) has created unprecedented opportunities for creative expression, education, and research. Text-to-image systems such as DALL.E, Stable Diffusion, and Midjourney can now convert ideas into visuals…

人工智能 · 计算机科学 2025-12-16 Dang Phuong Nam , Nguyen Kieu , Pham Thanh Hieu

While text-to-image synthesis currently enjoys great popularity among researchers and the general public, the security of these models has been neglected so far. Many text-guided image generation models rely on pre-trained text encoders…

机器学习 · 计算机科学 2023-08-10 Lukas Struppek , Dominik Hintersdorf , Kristian Kersting

Text-to-image (T2I) research has grown explosively in the past year, owing to the large-scale pre-trained diffusion models and many emerging personalization and editing approaches. Yet, one pain point persists: the text prompt engineering,…

计算机视觉与模式识别 · 计算机科学 2023-06-02 Xingqian Xu , Jiayi Guo , Zhangyang Wang , Gao Huang , Irfan Essa , Humphrey Shi

Various (text) prompt filters and (image) safety checkers have been implemented to mitigate the misuse of Text-to-Image (T2I) models in creating Not-Safe-For-Work (NSFW) content. In order to expose potential security vulnerabilities of such…

密码学与安全 · 计算机科学 2025-08-12 Song Yan , Hui Wei , Jinlong Fei , Guoliang Yang , Zhengyu Zhao , Zheng Wang

Text-to-Image(T2I) models typically deploy safety filters to prevent the generation of sensitive images. Unfortunately, recent jailbreaking attack methods manually design instructions for the LLM to generate adversarial prompts, which…

密码学与安全 · 计算机科学 2025-11-24 Chenyu Zhang , Lanjun Wang , Yiwen Ma , Wenhui Li , An-An Liu

It has been shown that many generative models inherit and amplify societal biases. To date, there is no uniform/systematic agreed standard to control/adjust for these biases. This study examines the presence and manipulation of societal…

计算机视觉与模式识别 · 计算机科学 2024-06-11 Philip Wootaek Shin , Jihyun Janice Ahn , Wenpeng Yin , Jack Sampson , Vijaykrishnan Narayanan