中文
相关论文

相关论文: GenBreak: Red Teaming Text-to-Image Generators Usi…

200 篇论文

Despite their impressive capabilities, diffusion-based text-to-image (T2I) models can lack faithfulness to the text prompt, where generated images may not contain all the mentioned objects, attributes or relations. To alleviate these…

计算机视觉与模式识别 · 计算机科学 2023-05-23 Shyamgopal Karthik , Karsten Roth , Massimiliano Mancini , Zeynep Akata

Text-to-Image (T2I) Diffusion Models (DMs) have shown impressive abilities in generating high-quality images based on simple text descriptions. However, as is common with many Deep Learning (DL) models, DMs are subject to a lack of…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Yi Zhang , Yun Tang , Wenjie Ruan , Xiaowei Huang , Siddartha Khastgir , Paul Jennings , Xingyu Zhao

Recent text-to-image (T2I) models have had great success, and many benchmarks have been proposed to evaluate their performance and safety. However, they only consider explicit prompts while neglecting implicit prompts (hint at a target…

计算机与社会 · 计算机科学 2024-05-29 Yue Yang , Yuqi Lin , Hong Liu , Wenqi Shao , Runjian Chen , Hailong Shang , Yu Wang , Yu Qiao , Kaipeng Zhang , Ping Luo

Text-to-Image (T2I) models have raised security concerns due to their potential to generate inappropriate or harmful images. In this paper, we propose UPAM, a novel framework that investigates the robustness of T2I models from the attack…

计算机视觉与模式识别 · 计算机科学 2024-05-28 Duo Peng , Qiuhong Ke , Jun Liu

We propose T2I-ReasonBench, a benchmark evaluating reasoning capabilities of text-to-image (T2I) models. It consists of four dimensions: Idiom Interpretation, Textual Image Design, Entity-Reasoning and Scientific-Reasoning. We propose a…

计算机视觉与模式识别 · 计算机科学 2025-08-26 Kaiyue Sun , Rongyao Fang , Chengqi Duan , Xian Liu , Xihui Liu

The revolution of artificial intelligence content generation has been rapidly accelerated with the booming text-to-image (T2I) diffusion models. Within just two years of development, it was unprecedentedly of high-quality, diversity, and…

人工智能 · 计算机科学 2023-10-16 Zeqiang Lai , Xizhou Zhu , Jifeng Dai , Yu Qiao , Wenhai Wang

Text-to-image (T2I) models such as Stable Diffusion and DALLE remain susceptible to generating harmful or Not-Safe-For-Work (NSFW) content under jailbreak attacks despite deployed safety filters. Existing jailbreak attacks either rely on…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Haolun Zheng , Yu He , Tailun Chen , Shuo Shao , Zhixuan Chu , Hongbin Zhou , Lan Tao , Zhan Qin , Kui Ren

Generative modeling is widely regarded as one of the most essential problems in today's AI community, with text-to-image generation having gained unprecedented real-world impacts. Among various approaches, diffusion models have achieved…

计算机视觉与模式识别 · 计算机科学 2026-01-26 Xuyang Guo , Jiayan Huo , Yingyu Liang , Zhenmei Shi , Zhao Song , Jiahao Zhang , Zhen Zhuang

Text-to-Image (T2I) generation has advanced rapidly in recent years, but they also raise safety concerns due to the potential production of harmful content. In the practical deployments, T2I services typically adopt full-chain defenses that…

计算机视觉与模式识别 · 计算机科学 2026-03-12 Jiangtao Liu , Zhaoxin Wang , Handing Wang , Cong Tian , Yaochu Jin

Text-to-Image (T2I) generation is enabling new applications that support creators, designers, and general end users of productivity software by generating illustrative content with high photorealism starting from a given descriptive text as…

计算机与社会 · 计算机科学 2023-04-14 Ranjita Naik , Besmira Nushi

Generative AI leaderboards are central to evaluating model capabilities, but remain vulnerable to manipulation. Among key adversarial objectives is rank manipulation, where an attacker must first deanonymize the models behind displayed…

机器学习 · 计算机科学 2025-10-09 Ali Naseh , Anshuman Suri , Yuefeng Peng , Harsh Chaudhari , Alina Oprea , Amir Houmansadr

Recent text-to-image (T2I) models have exhibited remarkable performance in generating high-quality images from text descriptions. However, these models are vulnerable to misuse, particularly generating not-safe-for-work (NSFW) content, such…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Lingzhi Yuan , Xinfeng Li , Chejian Xu , Guanhong Tao , Xiaojun Jia , Yihao Huang , Wei Dong , Yang Liu , Bo Li

Neural image classifiers are known to undergo severe performance degradation when exposed to inputs that are sampled from environmental conditions that differ from their training data. Given the recent progress in Text-to-Image (T2I)…

计算机视觉与模式识别 · 计算机科学 2024-06-05 Jianhao Yuan , Francesco Pinto , Adam Davies , Philip Torr

Modern text-to-image (T2I) generation systems (e.g., DALL$\cdot$E 3) exploit the memory mechanism, which captures key information in multi-turn interactions for faithful generation. Despite its practicality, the security analyses of this…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Shiqian Zhao , Jiayang Liu , Yiming Li , Runyi Hu , Xiaojun Jia , Wenshu Fan , Xiao Bao , Xinfeng Li , Jie Zhang , Wei Dong , Tianwei Zhang , Luu Anh Tuan

Recent advances in diffusion models have notably enhanced text-to-image (T2I) generation quality, but they also raise the risk of generating unsafe content. Traditional safety methods like text blacklisting or harmful content classification…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Zongsheng Cao , Yangfan He , Anran Liu , Jun Xie , Feng Chen , Zepeng Wang

Text-to-Image (T2I) models have recently gained significant attention due to their ability to generate high-quality images and are consequently used in a wide range of applications. However, there are concerns about the gender bias of these…

计算机视觉与模式识别 · 计算机科学 2025-07-28 Yunbo Lyu , Zhou Yang , Yuqing Niu , Jing Jiang , David Lo

The rapid proliferation of multimodal generative models has sparked critical discussions on their reliability, fairness and potential for misuse. While text-to-image models excel at producing high-fidelity, user-guided content, they often…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Jordan Vice , Naveed Akhtar , Leonid Sigal , Richard Hartley , Ajmal Mian

Text-to-image (T2I) models have advanced creative content generation, yet their reliance on large uncurated datasets often reproduces societal biases. We present FairT2I, a training-free and interactive framework grounded in a…

计算机视觉与模式识别 · 计算机科学 2026-01-08 Jinya Sakurai , Yuki Koyama , Issei Sato

Text-to-image (T2I) generative models have revolutionized content creation by transforming textual descriptions into high-quality images. However, these models are vulnerable to jailbreaking attacks, where carefully crafted prompts bypass…

密码学与安全 · 计算机科学 2025-06-26 Yingkai Dong , Xiangtao Meng , Ning Yu , Zheng Li , Shanqing Guo

Recent progress in text-to-image (T2I) diffusion models (DMs) has enabled high-quality visual synthesis from diverse textual prompts. Yet, most existing T2I DMs, even those equipped with large language model (LLM)-based text encoders,…

计算机视觉与模式识别 · 计算机科学 2026-01-16 Siqi Kou , Jiachun Jin , Zetong Zhou , Ye Ma , Yugang Wang , Quan Chen , Peng Jiang , Xiao Yang , Jun Zhu , Kai Yu , Zhijie Deng