English
Related papers

Related papers: Multimodal Pragmatic Jailbreak on Text-to-image Mo…

200 papers

Although recent personalization methods have democratized high-resolution image synthesis by enabling swift concept acquisition with minimal examples and lightweight computation, they also present an exploitable avenue for high accessible…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Yihao Huang , Felix Juefei-Xu , Qing Guo , Jie Zhang , Yutong Wu , Ming Hu , Tianlin Li , Geguang Pu , Yang Liu

Text-to-image (T2I) models are widespread, but their limited safety guardrails expose end users to harmful content and potentially allow for model misuse. Current safety measures are typically limited to text-based filtering or concept…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Runtao Liu , I Chieh Chen , Jindong Gu , Jipeng Zhang , Renjie Pi , Qifeng Chen , Philip Torr , Ashkan Khakzar , Fabio Pizzati

Current text-to-image (T2I) models often fail to account for diverse human experiences, leading to misaligned systems. We advocate for pluralistic alignment, where an AI understands and is steerable towards diverse, and often conflicting,…

Recently, Text-to-Image (T2I) synthesis technology has made tremendous strides. Numerous representative T2I models have emerged and achieved promising application outcomes, such as DALL-E, Stable Diffusion, Imagen, etc. In practice, it has…

Cryptography and Security · Computer Science 2025-09-24 Wenbo Jiang , Jiaming He , Hongwei Li , Rui Zhang , Hanxiao Chen , Meng Hao , Haomiao Yang , Qingchuan Zhao , Guowen Xu

Text-to-Image (T2I) diffusion models have rapidly advanced, enabling the generation of high-quality images that align closely with textual descriptions. However, this progress has also raised concerns about their misuse for propaganda and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Jaechul Roh , Andrew Yuan , Jinsong Mao

Text-to-Image (T2I) models have shown great performance in generating images based on textual prompts. However, these models are vulnerable to unsafe input to generate unsafe content like sexual, harassment and illegal-activity images.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Zongyu Wu , Hongcheng Gao , Yueze Wang , Xiang Zhang , Suhang Wang

The advancements in the domain of LLMs in recent years have surprised many, showcasing their remarkable capabilities and diverse applications. Their potential applications in various real-world scenarios have led to significant research on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Sujith Vemishetty , Advitiya Arora , Anupama Sharma

Text-to-image (T2I) diffusion models are popular for introducing image manipulation methods, such as editing, image fusion, inpainting, etc. At the same time, image-to-video (I2V) and text-to-video (T2V) models are also built on top of T2I…

The popularization of Text-to-Image (T2I) diffusion models enables the generation of high-quality images from text descriptions. However, generating diverse customized images with reference visual attributes remains challenging. This work…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Brian Nlong Zhao , Yuhang Xiao , Jiashu Xu , Xinyang Jiang , Yifan Yang , Dongsheng Li , Laurent Itti , Vibhav Vineet , Yunhao Ge

Text-to-Image (T2I) diffusion models have demonstrated strong generation ability, but their potential to generate unsafe content raises significant safety concerns. Existing inference-time defense methods typically perform category-agnostic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Binhong Tan , Zhaoxin Wang , Handing Wang

Diffusion-based text-to-image (T2I) models enable high-quality image generation but also pose significant risks of misuse, particularly in producing not-safe-for-work (NSFW) content. While prior detection methods have focused on filtering…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Fan Yang , Yihao Huang , Jiayi Zhu , Ling Shi , Geguang Pu , Jin Song Dong , Kailong Wang

Recent works show that text-to-image generative models are surprisingly vulnerable to a variety of poisoning attacks. Empirical results find that these models can be corrupted by altering associations between individual text prompts and…

Cryptography and Security · Computer Science 2024-09-20 Wenxin Ding , Cathy Y. Li , Shawn Shan , Ben Y. Zhao , Haitao Zheng

With the rise of text-to-image (T2I) generative AI models reaching wide audiences, it is critical to evaluate model robustness against non-obvious attacks to mitigate the generation of offensive images. By focusing on ``implicitly…

Recent advances in text-to-image (T2I) models, especially diffusion-based architectures, have significantly improved the visual quality of generated images. However, these models continue to struggle with a critical limitation: maintaining…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Yifan Shen , Yangyang Shu , Hye-young Paik , Yulei Sui

This paper analyzes the community safety guidelines of five text-to-image (T2I) generation platforms and audits five T2I models, focusing on prompts related to the representation of humans in areas that might lead to societal stigma. While…

Computers and Society · Computer Science 2024-09-27 Piera Riccio , Georgina Curto , Nuria Oliver

The rapid advancement of Text-to-Image(T2I) generative models has enabled the synthesis of high-quality images guided by textual descriptions. Despite this significant progress, these models are often susceptible in generating contents that…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Yichen Sun , Zhixuan Chu , Zhan Qin , Kui Ren

Large Text-to-Image(T2I) diffusion models have shown a remarkable capability to produce photorealistic and diverse images based on text inputs. However, existing works only support limited language input, e.g., English, Chinese, and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Fulong Ye , Guang Liu , Xinya Wu , Ledell Wu

Text-based image generation models, such as Stable Diffusion and DALL-E 3, hold significant potential in content creation and publishing workflows, making them the focus in recent years. Despite their remarkable capability to generate…

Computation and Language · Computer Science 2025-06-04 Wenxuan Wang , Kuiyi Gao , Youliang Yuan , Jen-tse Huang , Qiuzhi Liu , Shuai Wang , Wenxiang Jiao , Zhaopeng Tu

Text-to-image (T2I) diffusion models have become prominent tools for generating high-fidelity images from text prompts. However, when trained on unfiltered internet data, these models can produce unsafe, incorrect, or stylistically…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Rohit Jena , Ali Taghibakhshi , Sahil Jain , Gerald Shen , Nima Tajbakhsh , Arash Vahdat

Recent spatial control methods for text-to-image (T2I) diffusion models have shown compelling results. However, these methods still fail to precisely follow the control conditions and generate the corresponding images, especially when…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Jiaze Wang , Rui Chen , Haowang Cui