中文
相关论文

相关论文: NSFW-Classifier Guided Prompt Sanitization for Saf…

200 篇论文

Recent progress in video generative models has enabled the creation of high-quality videos from multimodal prompts that combine text and images. While these systems offer enhanced controllability, they also introduce new safety risks, as…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Ruize Ma , Minghong Cai , Yilei Jiang , Jiaming Han , Yi Feng , Yingshui Tan , Xiaoyong Zhu , Bo Zhang , Bo Zheng , Xiangyu Yue

Text-to-Image models may generate harmful content, such as pornographic images, particularly when unsafe prompts are submitted. To address this issue, safety filters are often added on top of text-to-image models, or the models themselves…

密码学与安全 · 计算机科学 2026-01-09 Zhengyuan Jiang , Yuepeng Hu , Yuchen Yang , Yinzhi Cao , Neil Zhenqiang Gong

Text-to-Image (T2I) models, represented by DALL$\cdot$E and Midjourney, have gained huge popularity for creating realistic images. The quality of these images relies on the carefully engineered prompts, which have become valuable…

密码学与安全 · 计算机科学 2026-01-22 Shiqian Zhao , Chong Wang , Yiming Li , Yihao Huang , Wenjie Qu , Siew-Kei Lam , Yi Xie , Kangjie Chen , Jie Zhang , Tianwei Zhang

Large-scale text-to-image (T2I) diffusion models have revolutionized image generation, enabling the synthesis of highly detailed visuals from textual descriptions. However, these models may inadvertently generate inappropriate content, such…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Huiqiang Chen , Tianqing Zhu , Linlin Wang , Xin Yu , Longxiang Gao , Wanlei Zhou

State-of-the-art Text-to-Image models like Stable Diffusion and DALLE$\cdot$2 are revolutionizing how people generate visual content. At the same time, society has serious concerns about how adversaries can exploit such models to generate…

计算机视觉与模式识别 · 计算机科学 2023-08-17 Yiting Qu , Xinyue Shen , Xinlei He , Michael Backes , Savvas Zannettou , Yang Zhang

Owe to the powerful generative priors, the pre-trained text-to-image (T2I) diffusion models have become increasingly popular in solving the real-world image super-resolution problem. However, as a consequence of the heavy quality…

计算机视觉与模式识别 · 计算机科学 2024-06-05 Rongyuan Wu , Tao Yang , Lingchen Sun , Zhengqiang Zhang , Shuai Li , Lei Zhang

Text-to-Image (T2I) models have achieved remarkable success in generating visual content from text inputs. Although multiple safety alignment strategies have been proposed to prevent harmful outputs, they often lead to overly cautious…

机器学习 · 计算机科学 2025-10-28 Ziheng Cheng , Yixiao Huang , Hui Xu , Somayeh Sojoudi , Xuandong Zhao , Dawn Song , Song Mei

Text-to-image generation models that generate images based on prompt descriptions have attracted an increasing amount of attention during the past few months. Despite their encouraging performance, these models raise concerns about the…

密码学与安全 · 计算机科学 2023-01-10 Zeyang Sha , Zheng Li , Ning Yu , Yang Zhang

We present Infinite-Story, a training-free framework for consistent text-to-image (T2I) generation tailored for multi-prompt storytelling scenarios. Built upon a scale-wise autoregressive model, our method addresses two key challenges in…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Jihun Park , Kyoungmin Lee , Jongmin Gim , Hyeonseo Jo , Minseok Oh , Wonhyeok Choi , Kyumin Hwang , Jaeyeul Kim , Minwoo Choi , Sunghoon Im

Various (text) prompt filters and (image) safety checkers have been implemented to mitigate the misuse of Text-to-Image (T2I) models in creating Not-Safe-For-Work (NSFW) content. In order to expose potential security vulnerabilities of such…

密码学与安全 · 计算机科学 2025-08-12 Song Yan , Hui Wei , Jinlong Fei , Guoliang Yang , Zhengyu Zhao , Zheng Wang

Text-to-Image (T2I) models have advanced significantly, but their growing popularity raises security concerns due to their potential to generate harmful images. To address these issues, we propose UPAM, a novel framework to evaluate the…

计算机视觉与模式识别 · 计算机科学 2025-02-25 Duo Peng , Qiuhong Ke , Mark He Huang , Ping Hu , Jun Liu

Text-to-image (T2I) generative models have revolutionized content creation by transforming textual descriptions into high-quality images. However, these models are vulnerable to jailbreaking attacks, where carefully crafted prompts bypass…

密码学与安全 · 计算机科学 2025-06-26 Yingkai Dong , Xiangtao Meng , Ning Yu , Zheng Li , Shanqing Guo

Text-to-image (T2I) models have achieved remarkable progress, yet they continue to struggle with complex prompts that require simultaneously handling multiple objects, relations, and attributes. Existing inference-time strategies, such as…

计算机视觉与模式识别 · 计算机科学 2026-01-22 Shantanu Jaiswal , Mihir Prabhudesai , Nikash Bhardwaj , Zheyang Qin , Amir Zadeh , Chuan Li , Katerina Fragkiadaki , Deepak Pathak

Text-driven diffusion models have significantly advanced the image editing performance by using text prompts as inputs. One crucial step in text-driven image editing is to invert the original image into a latent noise code conditioned on…

计算机视觉与模式识别 · 计算机科学 2024-07-08 Ruibin Li , Ruihuang Li , Song Guo , Lei Zhang

The spread of toxic content online is an important problem that has adverse effects on user experience online and in our society at large. Motivated by the importance and impact of the problem, research focuses on developing solutions to…

计算与语言 · 计算机科学 2023-08-11 Xinlei He , Savvas Zannettou , Yun Shen , Yang Zhang

Text-to-Image (T2I) generation is primarily driven by Diffusion Models (DM) which rely on random Gaussian noise. Thus, like playing the slots at a casino, a DM will produce different results given the same user-defined inputs. This imposes…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Joong Ho Kim , Nicholas Thai , Souhardya Saha Dip , Dong Lao , Keith G. Mills

Due to the subtleness, implicity, and different possible interpretations perceived by different people, detecting undesirable content from text is a nuanced difficulty. It is a long-known risk that language models (LMs), once trained on…

计算与语言 · 计算机科学 2022-05-26 Yau-Shian Wang , Yingshan Chang

Despite the notable advancements and versatility of multi-modal diffusion models, such as text-to-image models, their susceptibility to adversarial inputs remains underexplored. Contrary to expectations, our investigations reveal that the…

计算机视觉与模式识别 · 计算机科学 2025-10-31 Xiaosen Wang , Zhijin Ge , Shaokang Wang

Recent advancements in text-to-image diffusion models have brought them to the public spotlight, becoming widely accessible and embraced by everyday users. However, these models have been shown to generate harmful content such as…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Anubhav Jain , Yuya Kobayashi , Takashi Shibuya , Yuhta Takida , Nasir Memon , Julian Togelius , Yuki Mitsufuji

Text-to-image diffusion models excel at generating high-quality, diverse images from natural language prompts. However, they often fail to produce semantically accurate results when the prompt contains concept combinations that contradict…

图形学 · 计算机科学 2026-03-25 Saar Huberman , Or Patashnik , Omer Dahary , Ron Mokady , Daniel Cohen-Or