中文
相关论文

相关论文: PromptGuard: Soft Prompt-Guided Unsafe Content Mod…

200 篇论文

Despite recent progress in text-to-image (T2I) generation, existing models often struggle to faithfully capture user intentions from short and under-specified prompts. While prior work has attempted to enhance prompts using large language…

Recently, text-to-image (T2I) synthesis has undergone significant advancements, particularly with the emergence of Large Language Models (LLM) and their enhancement in Large Vision Models (LVM), greatly enhancing the instruction-following…

计算机视觉与模式识别 · 计算机科学 2025-03-27 Weijin Cheng , Jianzhi Liu , Jiawen Deng , Fuji Ren

Text-to-Image (T2I) diffusion models enable high quality open ended synthesis, but practical use requires suppressing unsafe generations while preserving behavior on benign prompts. We study this tension relative to the frozen generator,…

人工智能 · 计算机科学 2026-05-14 Minhyuk Lee , Hyekyung Yoon , Myungjoo Kang

Web agents have emerged as an effective paradigm for automating interactions with complex web environments, yet remain vulnerable to prompt injection attacks that embed malicious instructions into webpage content to induce unintended…

密码学与安全 · 计算机科学 2026-04-29 Mengyao Du , Han Fang , Haokai Ma , Jiahao Chen , Kai Xu , Quanjun Yin , Ee-Chien Chang

The recent advancements in Generative AI have significantly advanced the field of text-to-image generation. The state-of-the-art text-to-image model, Stable Diffusion, is now capable of synthesizing high-quality images with a strong sense…

人机交互 · 计算机科学 2024-03-08 Zhijie Wang , Yuheng Huang , Da Song , Lei Ma , Tianyi Zhang

Text-to-image models have shown remarkable capabilities in generating high-quality images from natural language descriptions. However, these models are highly vulnerable to adversarial prompts, which can bypass safety measures and produce…

密码学与安全 · 计算机科学 2025-10-16 Peigui Qi , Kunsheng Tang , Wenbo Zhou , Weiming Zhang , Nenghai Yu , Tianwei Zhang , Qing Guo , Jie Zhang

Recently, various types of Text-to-Image (T2I) models have emerged (such as DALL-E and Stable Diffusion), and showing their advantages in different aspects. Therefore, some third-party service platforms collect different model interfaces…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Ji Guo , Wenbo Jiang , Rui Zhang , Guoming Lu , Hongwei Li

Text-to-image diffusion models, e.g. Stable Diffusion (SD), lately have shown remarkable ability in high-quality content generation, and become one of the representatives for the recent wave of transformative AI. Nevertheless, such advance…

计算与语言 · 计算机科学 2026-01-15 Zhi-Yi Chin , Chieh-Ming Jiang , Ching-Chun Huang , Pin-Yu Chen , Wei-Chen Chiu

The emerging capabilities of large language models (LLMs) have sparked concerns about their immediate potential for harmful misuse. The core approach to mitigate these concerns is the detection of harmful queries to the model. Current…

计算与语言 · 计算机科学 2025-12-10 Sahil Verma , Keegan Hines , Jeff Bilmes , Charlotte Siska , Luke Zettlemoyer , Hila Gonen , Chandan Singh

Text-to-image (T2I) models have rapidly advanced, enabling the generation of high-quality images from text prompts across various domains. However, these models present notable safety concerns, including the risk of generating harmful,…

计算与语言 · 计算机科学 2025-07-28 Lijun Li , Zhelun Shi , Xuhao Hu , Bowen Dong , Yiran Qin , Xihui Liu , Lu Sheng , Jing Shao

Despite the impressive generative capabilities of text-to-image (T2I) diffusion models, they remain vulnerable to generating inappropriate content, especially when confronted with implicit sexual prompts. Unlike explicit harmful prompts,…

计算机视觉与模式识别 · 计算机科学 2025-10-20 Yitong Sun , Yao Huang , Ruochen Zhang , Huanran Chen , Shouwei Ruan , Ranjie Duan , Xingxing Wei

Text-to-Video (T2V) models have demonstrated remarkable capability in generating temporally coherent videos from natural language prompts, yet they also risk producing unsafe content such as violence or explicit material. Existing…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Quanchen Zou , Nizhang Li , Wenxin Zhang , Jiaye Lin , Yangchen Zeng , Xiangzheng Zhang , Zonghao Ying

In recent years, Text-to-Image (T2I) models have garnered significant attention due to their remarkable advancements. However, security concerns have emerged due to their potential to generate inappropriate or Not-Safe-For-Work (NSFW)…

计算机视觉与模式识别 · 计算机科学 2025-02-11 Yihao Huang , Le Liang , Tianlin Li , Xiaojun Jia , Run Wang , Weikai Miao , Geguang Pu , Yang Liu

Recent advances in text-to-image generative models have raised concerns about their potential to produce harmful content when provided with malicious input text prompts. To address this issue, two main approaches have emerged: (1)…

机器学习 · 计算机科学 2025-11-13 Jiwoo Shin , Byeonghu Na , Mina Kang , Wonhyeok Choi , Il-Chul Moon

Text-to-image (T2I) models such as Stable Diffusion have advanced rapidly and are now widely used in content creation. However, these models can be misused to generate harmful content, including nudity or violence, posing significant safety…

密码学与安全 · 计算机科学 2025-06-13 Zilong Wang , Xiang Zheng , Xiaosen Wang , Bo Wang , Xingjun Ma , Yu-Gang Jiang

Text-to-Image (T2I) models have achieved remarkable success in generating visual content from text inputs. Although multiple safety alignment strategies have been proposed to prevent harmful outputs, they often lead to overly cautious…

机器学习 · 计算机科学 2025-10-28 Ziheng Cheng , Yixiao Huang , Hui Xu , Somayeh Sojoudi , Xuandong Zhao , Dawn Song , Song Mei

Uncertainty quantification in text-to-image (T2I) generative models is crucial for understanding model behavior and improving output reliability. In this paper, we are the first to quantify and evaluate the uncertainty of T2I models with…

人工智能 · 计算机科学 2024-12-05 Gianni Franchi , Dat Nguyen Trong , Nacim Belkhir , Guoxuan Xia , Andrea Pilzer

The steady improvements of text-to-image (T2I) generative models lead to slow deprecation of automatic evaluation benchmarks that rely on static datasets, motivating researchers to seek alternative ways to evaluate the T2I progress. In this…

计算机视觉与模式识别 · 计算机科学 2025-05-14 Jiahui Chen , Candace Ross , Reyhane Askari-Hemmat , Koustuv Sinha , Melissa Hall , Michal Drozdzal , Adriana Romero-Soriano

Text to image generation methods (T2I) are widely popular in generating art and other creative artifacts. While visual hallucinations can be a positive factor in scenarios where creativity is appreciated, such artifacts are poorly suited…

计算机视觉与模式识别 · 计算机科学 2023-05-30 Rodrigo Valerio , Joao Bordalo , Michal Yarom , Yonatan Bitton , Idan Szpektor , Joao Magalhaes

Text-to-Image (T2I) models have recently achieved remarkable success in generating images from textual descriptions. However, challenges still persist in accurately rendering complex scenes where actions and interactions form the primary…

计算机视觉与模式识别 · 计算机科学 2025-09-22 Vatsal Malaviya , Agneet Chatterjee , Maitreya Patel , Yezhou Yang , Chitta Baral