English
Related papers

Related papers: PromptGuard: Soft Prompt-Guided Unsafe Content Mod…

200 papers

Despite impressive recent advances in text-to-image diffusion models, obtaining high-quality images often requires prompt engineering by humans who have developed expertise in using them. In this work, we present NeuroPrompts, an adaptive…

Artificial Intelligence · Computer Science 2024-04-09 Shachar Rosenman , Vasudev Lal , Phillip Howard

Text-to-image (T2I) models commonly incorporate defense mechanisms to prevent the generation of sensitive images. Unfortunately, recent jailbreak attacks have shown that adversarial prompts can effectively bypass these mechanisms and induce…

Cryptography and Security · Computer Science 2026-03-25 Chenyu Zhang , Lanjun Wang , Yiwen Ma , Wenhui Li , Yi Tu , An-An Liu

The generative AI revolution in recent years has been spurred by an expansion in compute power and data quantity, which together enable extensive pre-training of powerful text-to-image (T2I) models. With their greater capabilities to…

The recent advancements in Large Language Models(LLMs) have had a significant impact on a wide range of fields, from general domains to specialized areas. However, these advancements have also significantly increased the potential for…

Cryptography and Security · Computer Science 2025-10-01 Taegyeong Lee , Jeonghwa Yoo , Hyoungseo Cho , Soo Yong Kim , Yunho Maeng

Medical vision-language models (Med-VLMs) trained on large datasets of medical image-text pairs and later fine-tuned for specific tasks have emerged as a mainstream paradigm in medical image analysis. However, recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Noor Hussein , Fahad Shamshad , Muzammal Naseer , Karthik Nandakumar

The recent development of Sora leads to a new era in text-to-video (T2V) generation. Along with this comes the rising concern about its security risks. The generated videos may contain illegal or unethical content, and there is a lack of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Yibo Miao , Yifan Zhu , Yinpeng Dong , Lijia Yu , Jun Zhu , Xiao-Shan Gao

Not Safe/Suitable for Work (NSFW) content is rampant on social networks and poses serious harm to citizens, especially minors. Current detection methods mainly rely on deep learning-based image recognition and classification. However, NSFW…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Han Bao , Qinying Wang , Zhi Chen , Qingming Li , Xuhong Zhang , Changjiang Li , Zonghui Wang , Shouling Ji , Wenzhi Chen

We introduce ShieldGemma 2, a 4B parameter image content moderation model built on Gemma 3. This model provides robust safety risk predictions across the following key harm categories: Sexually Explicit, Violence \& Gore, and Dangerous…

User prompts for generative AI models are often underspecified, leading to a misalignment between the user intent and models' understanding. As a result, users commonly have to painstakingly refine their prompts. We study this alignment…

Artificial Intelligence · Computer Science 2025-10-27 Meera Hahn , Wenjun Zeng , Nithish Kannen , Rich Galt , Kartikeya Badola , Been Kim , Zi Wang

Well-designed prompts can guide text-to-image models to generate amazing images. However, the performant prompts are often model-specific and misaligned with user input. Instead of laborious human engineering, we propose prompt adaptation,…

Computation and Language · Computer Science 2024-01-01 Yaru Hao , Zewen Chi , Li Dong , Furu Wei

The practical use of text-to-image generation has evolved from simple, monolithic models to complex workflows that combine multiple specialized components. While workflow-based approaches can lead to improved image quality, crafting…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Rinon Gal , Adi Haviv , Yuval Alaluf , Amit H. Bermano , Daniel Cohen-Or , Gal Chechik

Generative text-to-image models have gained great popularity among the public for their powerful capability to generate high-quality images based on natural language prompts. However, developing effective prompts for desired images can be…

Artificial Intelligence · Computer Science 2023-11-02 Yingchaojie Feng , Xingbo Wang , Kam Kwai Wong , Sijia Wang , Yuhong Lu , Minfeng Zhu , Baicheng Wang , Wei Chen

Despite the integration of safety alignment and external filters, text-to-image (T2I) generative systems are still susceptible to producing harmful content, such as sexual or violent imagery. This raises serious concerns about unintended…

Cryptography and Security · Computer Science 2025-12-09 Boheng Li , Junjie Wang , Yiming Li , Zhiyang Hu , Leyi Qi , Jianshuo Dong , Run Wang , Han Qiu , Zhan Qin , Tianwei Zhang

We introduce WildGuard -- an open, light-weight moderation tool for LLM safety that achieves three goals: (1) identifying malicious intent in user prompts, (2) detecting safety risks of model responses, and (3) determining model refusal…

Computation and Language · Computer Science 2024-12-11 Seungju Han , Kavel Rao , Allyson Ettinger , Liwei Jiang , Bill Yuchen Lin , Nathan Lambert , Yejin Choi , Nouha Dziri

The advancements in the domain of LLMs in recent years have surprised many, showcasing their remarkable capabilities and diverse applications. Their potential applications in various real-world scenarios have led to significant research on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Sujith Vemishetty , Advitiya Arora , Anupama Sharma

Text-to-image (T2I) models today are capable of producing photorealistic, instruction-following images, yet they still frequently fail on prompts that require implicit world knowledge. Existing evaluation protocols either emphasize…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Tianyang Han , Junhao Su , Junjie Hu , Peizhen Yang , Hengyu Shi , Junfeng Luo , Jialin Gao

Text-to-image (T2I) generative models have revolutionized content creation by transforming textual descriptions into high-quality images. However, these models are vulnerable to jailbreaking attacks, where carefully crafted prompts bypass…

Cryptography and Security · Computer Science 2025-06-26 Yingkai Dong , Xiangtao Meng , Ning Yu , Zheng Li , Shanqing Guo

Text-to-image generative models like DALL-E and Stable Diffusion have revolutionized visual content creation across various applications, including advertising, personalized media, and design prototyping. However, crafting effective textual…

Artificial Intelligence · Computer Science 2025-07-22 Donghoon Kim , Minji Bae , Kyuhong Shim , Byonghyo Shim

The popularization of Text-to-Image (T2I) diffusion models enables the generation of high-quality images from text descriptions. However, generating diverse customized images with reference visual attributes remains challenging. This work…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Brian Nlong Zhao , Yuhang Xiao , Jiashu Xu , Xinyang Jiang , Yifan Yang , Dongsheng Li , Laurent Itti , Vibhav Vineet , Yunhao Ge

As Text-to-Image (T2I) generation becomes widespread, third-party platforms increasingly integrate multiple model APIs for convenient image creation. However, false claims of using official models can mislead users and harm model owners'…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Zidong Zhao , Yihao Huang , Qing Guo , Tianlin Li , Anran Li , Kailong Wang , Jin Song Dong , Geguang Pu