English
Related papers

Related papers: SafeGuider: Robust and Practical Content Safety Co…

200 papers

Text-to-image (T2I) models have raised increasing safety concerns due to their capacity to generate NSFW and other banned objects. To mitigate these risks, safety filters and concept removal techniques have been introduced to block…

Cryptography and Security · Computer Science 2026-01-13 Xi Ye , Yiwen Liu , Lina Wang , Run Wang , Geying Yang , Yufei Hou , Jiayi Yu

This paper introduces the first gradient-based framework for prompt optimization in text-to-image diffusion models. We formulate prompt engineering as a discrete optimization problem over the language space. Two major challenges arise in…

Machine Learning · Computer Science 2024-07-03 Ruochen Wang , Ting Liu , Cho-Jui Hsieh , Boqing Gong

Text-to-image generation models that generate images based on prompt descriptions have attracted an increasing amount of attention during the past few months. Despite their encouraging performance, these models raise concerns about the…

Cryptography and Security · Computer Science 2023-01-10 Zeyang Sha , Zheng Li , Ning Yu , Yang Zhang

Warning: this paper contains content that may be inappropriate or offensive. As generative models become available for public use in various applications, testing and analyzing vulnerabilities of these models has become a priority. In this…

Artificial Intelligence · Computer Science 2024-11-11 Ninareh Mehrabi , Palash Goyal , Christophe Dupuy , Qian Hu , Shalini Ghosh , Richard Zemel , Kai-Wei Chang , Aram Galstyan , Rahul Gupta

Text-to-image diffusion models can emit copyrighted, unsafe, or private content. Safety alignment aims to suppress specific concepts, yet evaluations seldom test whether safety persists under benign downstream fine-tuning routinely applied…

Cryptography and Security · Computer Science 2025-11-26 Mohammed Talha Alam , Nada Saadi , Fahad Shamshad , Nils Lukas , Karthik Nandakumar , Fahkri Karray , Samuele Poppi

Text-to-image generative models are becoming increasingly popular and accessible to the general public. As these models see large-scale deployments, it is necessary to deeply investigate their safety and fairness to not disseminate and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Moreno D'Incà , Elia Peruzzo , Massimiliano Mancini , Dejia Xu , Vidit Goel , Xingqian Xu , Zhangyang Wang , Humphrey Shi , Nicu Sebe

Text-to-Image (T2I) generation methods based on diffusion model have garnered significant attention in the last few years. Although these image synthesis methods produce visually appealing results, they frequently exhibit spelling errors…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Yiming Zhao , Zhouhui Lian

Recent works show that text-to-image generative models are surprisingly vulnerable to a variety of poisoning attacks. Empirical results find that these models can be corrupted by altering associations between individual text prompts and…

Cryptography and Security · Computer Science 2024-09-20 Wenxin Ding , Cathy Y. Li , Shawn Shan , Ben Y. Zhao , Haitao Zheng

Text-to-image diffusion models have emerged as an evolutionary for producing creative content in image synthesis. Based on the impressive generation abilities of these models, instruction-guided diffusion models can edit images with simple…

Cryptography and Security · Computer Science 2024-08-21 Ruoxi Chen , Haibo Jin , Yixin Liu , Jinyin Chen , Haohan Wang , Lichao Sun

The rapid proliferation of large-scale text-to-image diffusion (T2ID) models has raised serious concerns about their potential misuse in generating harmful content. Although numerous methods have been proposed for erasing undesired concepts…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Koushik Srivatsan , Fahad Shamshad , Muzammal Naseer , Vishal M. Patel , Karthik Nandakumar

Web agents have emerged as an effective paradigm for automating interactions with complex web environments, yet remain vulnerable to prompt injection attacks that embed malicious instructions into webpage content to induce unintended…

Cryptography and Security · Computer Science 2026-04-29 Mengyao Du , Han Fang , Haokai Ma , Jiahao Chen , Kai Xu , Quanjun Yin , Ee-Chien Chang

The quality of the prompts provided to text-to-image diffusion models determines how faithful the generated content is to the user's intent, often requiring `prompt engineering'. To harness visual concepts from target images without prompt…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Shweta Mahajan , Tanzila Rahman , Kwang Moo Yi , Leonid Sigal

Large-scale pre-trained generative models are taking the world by storm, due to their abilities in generating creative content. Meanwhile, safeguards for these generative models are developed, to protect users' rights and safety, most of…

Cryptography and Security · Computer Science 2024-10-14 Guanlin Li , Kangjie Chen , Shudong Zhang , Jie Zhang , Tianwei Zhang

Text-to-Image (T2I) models have raised security concerns due to their potential to generate inappropriate or harmful images. In this paper, we propose UPAM, a novel framework that investigates the robustness of T2I models from the attack…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Duo Peng , Qiuhong Ke , Jun Liu

Text-to-Image(T2I) models have achieved remarkable success in image generation and editing, yet these models still have many potential issues, particularly in generating inappropriate or Not-Safe-For-Work(NSFW) content. Strengthening…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Sensen Gao , Xiaojun Jia , Yihao Huang , Ranjie Duan , Jindong Gu , Yang Bai , Yang Liu , Qing Guo

Text-to-image models have shown remarkable progress in generating high-quality images from user-provided prompts. Despite this, the quality of these images varies due to the models' sensitivity to human language nuances. With advancements…

Artificial Intelligence · Computer Science 2024-06-14 Xinrui Yang , Zhuohan Wang , Anthony Hu

We develop an approach for text-to-image generation that embraces additional retrieval images, driven by a combination of implicit visual guidance loss and generative objectives. Unlike most existing text-to-image generation methods which…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Xin Yuan , Zhe Lin , Jason Kuen , Jianming Zhang , John Collomosse

Text-conditioned image generation models have recently achieved astonishing results in image quality and text alignment and are consequently employed in a fast-growing number of applications. Since they are highly data-driven, relying on…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Patrick Schramowski , Manuel Brack , Björn Deiseroth , Kristian Kersting

Concept erasure in text-to-image diffusion models is crucial for mitigating harmful content, yet existing methods often compromise generative quality. We introduce Semantic Surgery, a novel training-free, zero-shot framework for concept…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Lexiang Xiong , Chengyu Liu , Jingwen Ye , Yan Liu , Yuecong Xu

Due to the recent success of diffusion models, text-to-image generation is becoming increasingly popular and achieves a wide range of applications. Among them, text-to-image editing, or continuous text-to-image generation, attracts lots of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Zihao Yu , Haoyang Li , Fangcheng Fu , Xupeng Miao , Bin Cui