中文
相关论文

相关论文: Iterative Prompt Refinement for Safer Text-to-Imag…

200 篇论文

The increasing integration of Visual Language Models (VLMs) into AI systems necessitates robust model alignment, especially when handling multimodal content that combines text and images. Existing evaluation datasets heavily lean towards…

计算与语言 · 计算机科学 2026-03-05 Gabriel Downer , Sean Craven , Damian Ruck , Jake Thomas

Text-to-image (T2I) models such as Stable Diffusion have advanced rapidly and are now widely used in content creation. However, these models can be misused to generate harmful content, including nudity or violence, posing significant safety…

密码学与安全 · 计算机科学 2025-06-13 Zilong Wang , Xiang Zheng , Xiaosen Wang , Bo Wang , Xingjun Ma , Yu-Gang Jiang

Feedback is crucial for every design process, such as user interface (UI) design, and automating design critiques can significantly improve the efficiency of the design workflow. Although existing multimodal large language models (LLMs)…

人工智能 · 计算机科学 2025-05-26 Peitong Duan , Chin-Yi Cheng , Bjoern Hartmann , Yang Li

Using risky text prompts, such as pornography and violent prompts, to test the safety of text-to-image (T2I) models is a critical task. However, existing risky prompt datasets are limited in three key areas: 1) limited risky categories, 2)…

密码学与安全 · 计算机科学 2025-11-24 Chenyu Zhang , Tairen Zhang , Lanjun Wang , Ruidong Chen , Wenhui Li , Anan Liu

Text-to-Image(T2I) models typically deploy safety filters to prevent the generation of sensitive images. Unfortunately, recent jailbreaking attack methods manually design instructions for the LLM to generate adversarial prompts, which…

密码学与安全 · 计算机科学 2025-11-24 Chenyu Zhang , Lanjun Wang , Yiwen Ma , Wenhui Li , An-An Liu

Text-to-Image (T2I) models have shown great performance in generating images based on textual prompts. However, these models are vulnerable to unsafe input to generate unsafe content like sexual, harassment and illegal-activity images.…

计算机视觉与模式识别 · 计算机科学 2024-12-13 Zongyu Wu , Hongcheng Gao , Yueze Wang , Xiang Zhang , Suhang Wang

The steady improvements of text-to-image (T2I) generative models lead to slow deprecation of automatic evaluation benchmarks that rely on static datasets, motivating researchers to seek alternative ways to evaluate the T2I progress. In this…

计算机视觉与模式识别 · 计算机科学 2025-05-14 Jiahui Chen , Candace Ross , Reyhane Askari-Hemmat , Koustuv Sinha , Melissa Hall , Michal Drozdzal , Adriana Romero-Soriano

Text-to-image (T2I) models have significantly advanced in producing high-quality images. However, such models have the ability to generate images containing not-safe-for-work (NSFW) content, such as pornography, violence, political content,…

密码学与安全 · 计算机科学 2025-05-15 Longtian Wang , Xiaofei Xie , Tianlin Li , Yuhan Zhi , Chao Shen

In the text-to-image generation field, recent remarkable progress in Stable Diffusion makes it possible to generate rich kinds of novel photorealistic images. However, current models still face misalignment issues (e.g., problematic spatial…

计算机视觉与模式识别 · 计算机科学 2023-08-15 Leigang Qu , Shengqiong Wu , Hao Fei , Liqiang Nie , Tat-Seng Chua

Text-to-image (T2I) generation model has made significant advancements, resulting in high-quality images aligned with an input prompt. However, despite T2I generation's ability to generate fine-grained images, it still faces challenges in…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Taekyung Lee , Donggyu Lee , Myungjoo Kang

Text-to-Image (T2I) diffusion models are widely recognized for their ability to generate high-quality and diverse images based on text prompts. However, despite recent advances, these models are still prone to generating unsafe images…

计算机视觉与模式识别 · 计算机科学 2024-12-06 Jiangweizhi Peng , Zhiwei Tang , Gaowen Liu , Charles Fleming , Mingyi Hong

Text-to-Image models may generate harmful content, such as pornographic images, particularly when unsafe prompts are submitted. To address this issue, safety filters are often added on top of text-to-image models, or the models themselves…

密码学与安全 · 计算机科学 2026-01-09 Zhengyuan Jiang , Yuepeng Hu , Yuchen Yang , Yinzhi Cao , Neil Zhenqiang Gong

Contemporary Text-to-Image (T2I) models frequently depend on qualitative human evaluations to assess the consistency between synthesized images and the text prompts. There is a demand for quantitative and automatic evaluation tools, given…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Ziyuan Qin , Dongjie Cheng , Haoyu Wang , Huahui Yi , Yuting Shao , Zhiyuan Fan , Kang Li , Qicheng Lao

TIPO (Text-to-Image Prompt Optimization) introduces an efficient approach for automatic prompt refinement in text-to-image (T2I) generation. Starting from simple user prompts, TIPO leverages a lightweight pre-trained model to expand these…

计算机视觉与模式识别 · 计算机科学 2026-02-10 Shih-Ying Yeh , Yi Li , Sang-Hyun Park , Giyeong Oh , Xuehai Wang , Min Song , Youngjae Yu , Shang-Hong Lai

Recent advancements in Text-to-Image (T2I) models have raised significant safety concerns about their potential misuse for generating inappropriate or Not-Safe-For-Work (NSFW) contents, despite existing countermeasures such as NSFW…

计算机视觉与模式识别 · 计算机科学 2024-10-31 Yijun Yang , Ruiyuan Gao , Xiao Yang , Jianyuan Zhong , Qiang Xu

By simply composing prompts, developers can prototype novel generative applications with Large Language Models (LLMs). To refine prototypes into products, however, developers must iteratively revise prompts by evaluating outputs to diagnose…

人机交互 · 计算机科学 2024-02-28 Tae Soo Kim , Yoonjoo Lee , Jamin Shin , Young-Ho Kim , Juho Kim

Text-to-image generative models are a new and powerful way to generate visual artwork. However, the open-ended nature of text as interaction is double-edged; while users can input anything and have access to an infinite range of…

人机交互 · 计算机科学 2023-09-29 Vivian Liu , Lydia B. Chilton

Progress in Text-to-Image (T2I) models has significantly improved the generation of images from textual descriptions. However, existing evaluation metrics do not adequately assess the models' ability to handle a diverse range of textual…

计算机视觉与模式识别 · 计算机科学 2024-11-18 Jingtao Cao , Zheng Zhang , Hongru Wang , Kam-Fai Wong

The progress in the generation of synthetic images has made it crucial to assess their quality. While several metrics have been proposed to assess the rendering of images, it is crucial for Text-to-Image (T2I) models, which generate images…

计算机视觉与模式识别 · 计算机科学 2024-01-04 Paul Grimal , Hervé Le Borgne , Olivier Ferret , Julien Tourille

With AI-generated content becoming ubiquitous across the web, social media, and other digital platforms, it is vital to examine how such content are inspired and generated. The creation of AI-generated images often involves refining the…

人工智能 · 计算机科学 2025-04-30 Khoi Trinh , Scott Seidenberger , Raveen Wijewickrama , Murtuza Jadliwala , Anindya Maiti