English
Related papers

Related papers: PromptGuard: Soft Prompt-Guided Unsafe Content Mod…

200 papers

Generating high-quality images without prompt engineering expertise remains a challenge for text-to-image (T2I) models, which often misinterpret poorly structured prompts, leading to distortions and misalignments. While humans easily…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Nisan Chhetri , Arpan Sainju

With advances in the quality of text-to-image (T2I) models has come interest in benchmarking their prompt faithfulness -- the semantic coherence of generated images to the prompts they were conditioned on. A variety of T2I faithfulness…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Michael Saxon , Fatima Jahara , Mahsa Khoshnoodi , Yujie Lu , Aditya Sharma , William Yang Wang

Text-to-image (T2I) models can be maliciously used to generate harmful content such as sexually explicit, unfaithful, and misleading or Not-Safe-for-Work (NSFW) images. Previous attacks largely depend on the availability of the diffusion…

Cryptography and Security · Computer Science 2025-05-27 Jiachen Ma , Yijiang Li , Zhiqing Xiao , Anda Cao , Jie Zhang , Chao Ye , Junbo Zhao

Text-to-image models have shown remarkable progress in generating high-quality images from user-provided prompts. Despite this, the quality of these images varies due to the models' sensitivity to human language nuances. With advancements…

Artificial Intelligence · Computer Science 2024-06-14 Xinrui Yang , Zhuohan Wang , Anthony Hu

Text-to-Image(T2I) models typically deploy safety filters to prevent the generation of sensitive images. Unfortunately, recent jailbreaking attack methods manually design instructions for the LLM to generate adversarial prompts, which…

Cryptography and Security · Computer Science 2025-11-24 Chenyu Zhang , Lanjun Wang , Yiwen Ma , Wenhui Li , An-An Liu

The rapid advancement of Text-to-Image(T2I) generative models has enabled the synthesis of high-quality images guided by textual descriptions. Despite this significant progress, these models are often susceptible in generating contents that…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Yichen Sun , Zhixuan Chu , Zhan Qin , Kui Ren

Recent text-to-video (T2V) models can synthesize complex videos from lightweight natural language prompts, raising urgent concerns about safety alignment in the event of misuse in the real world. Prior jailbreak attacks typically rewrite…

Cryptography and Security · Computer Science 2026-03-10 Moyang Chen , Zonghao Ying , Wenzhuo Xu , Quancheng Zou , Deyue Zhang , Dongdong Yang , Xiangzheng Zhang

State-of-the-art Diffusion Models (DMs) produce highly realistic images. While prior work has successfully mitigated Not Safe For Work (NSFW) content in the visual domain, we identify a novel threat: the generation of NSFW text embedded…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Aditya Kumar , Tom Blanchard , Adam Dziedzic , Franziska Boenisch

Text-to-image models can generate harmful images when presented with unsafe prompts, posing significant safety and societal risks. Alignment methods aim to modify these models to ensure they generate only non-harmful images, even when…

Cryptography and Security · Computer Science 2025-03-03 Yuepeng Hu , Zhengyuan Jiang , Neil Zhenqiang Gong

Text-to-Image (T2I) generative models have revolutionized content creation but remain highly sensitive to prompt phrasing, often requiring users to repeatedly refine prompts multiple times without clear feedback. While techniques such as…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Chieh-Yun Chen , Min Shi , Gong Zhang , Humphrey Shi

Advanced text-to-image models such as DALL$\cdot$E 2 and Midjourney possess the capacity to generate highly realistic images, raising significant concerns regarding the potential proliferation of unsafe content. This includes adult,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Zhongjie Ba , Jieming Zhong , Jiachen Lei , Peng Cheng , Qinglong Wang , Zhan Qin , Zhibo Wang , Kui Ren

We investigate the generation of minority samples using pretrained text-to-image (T2I) latent diffusion models. Minority instances, in the context of T2I generation, can be defined as ones living on low-density regions of text-conditional…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Soobin Um , Jong Chul Ye

Recent advances in text-to-image (T2I) models, especially diffusion-based architectures, have significantly improved the visual quality of generated images. However, these models continue to struggle with a critical limitation: maintaining…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Yifan Shen , Yangyang Shu , Hye-young Paik , Yulei Sui

Text-to-Image (T2I) models have gained widespread adoption across various applications. Despite the success, the potential misuse of T2I models poses significant risks of generating Not-Safe-For-Work (NSFW) content. To investigate the…

Cryptography and Security · Computer Science 2025-08-07 Xinqi Lyu , Yihao Liu , Yanjie Li , Bin Xiao

Previous work on augmenting large multimodal models (LMMs) for text-to-image (T2I) generation has focused on enriching the input space of in-context learning (ICL). This includes providing a few demonstrations and optimizing image…

Computation and Language · Computer Science 2025-01-14 Yongyu Mu , Hengyu Li , Junxin Wang , Xiaoxuan Zhou , Chenglong Wang , Yingfeng Luo , Qiaozhi He , Tong Xiao , Guocheng Chen , Jingbo Zhu

Recent advancements in Text-to-Image (T2I) diffusion models have demonstrated impressive success in generating high-quality images with zero-shot generalization capabilities. Yet, current models struggle to closely adhere to prompt…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Hyun Kang , Dohae Lee , Myungjin Shin , In-Kwon Lee

Text-to-Image (T2I) models, represented by DALL$\cdot$E and Midjourney, have gained huge popularity for creating realistic images. The quality of these images relies on the carefully engineered prompts, which have become valuable…

Cryptography and Security · Computer Science 2026-01-22 Shiqian Zhao , Chong Wang , Yiming Li , Yihao Huang , Wenjie Qu , Siew-Kei Lam , Yi Xie , Kangjie Chen , Jie Zhang , Tianwei Zhang

With the rapid advancement of large multimodal models (LMMs), recent text-to-image (T2I) models can generate high-quality images and demonstrate great alignment to short prompts. However, they still struggle to effectively understand and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Juntong Wang , Huiyu Duan , Jiarui Wang , Ziheng Jia , Guangtao Zhai , Xiongkuo Min

Text-to-image (T2I) models are capable of generating visually impressive images, yet they often fail to accurately capture specific attributes in user prompts, such as the correct number of objects with the specified colors. The diversity…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Kevin David Hayes , Micah Goldblum , Vikash Sehwag , Gowthami Somepalli , Ashwinee Panda , Tom Goldstein

Recent AI systems have shown extremely powerful performance, even surpassing human performance, on various tasks such as information retrieval, language generation, and image generation based on large language models (LLMs). At the same…

Artificial Intelligence · Computer Science 2024-05-29 Minseon Kim , Hyomin Lee , Boqing Gong , Huishuai Zhang , Sung Ju Hwang