English
Related papers

Related papers: Unified Prompt Attack Against Text-to-Image Genera…

200 papers

Large Language Models (LLMs) are increasingly used for automated software development, making their ability to preserve secure coding practices critical. In practice, however, many security requirements are implicit or underspecified,…

Cryptography and Security · Computer Science 2026-05-12 Yue Li , Xiao Li , Hao Wu , Yue Zhang , Yechao Zhang , Yating Liu , Fengyuan Xu , Sheng Zhong

In recent years, Text-to-Image (T2I) models have seen remarkable advancements, gaining widespread adoption. However, this progress has inadvertently opened avenues for potential misuse, particularly in generating inappropriate or…

Cryptography and Security · Computer Science 2024-04-02 Yijun Yang , Ruiyuan Gao , Xiaosen Wang , Tsung-Yi Ho , Nan Xu , Qiang Xu

With the ability to generate high-quality images, text-to-image (T2I) models can be exploited for creating inappropriate content. To prevent misuse, existing safety measures are either based on text blacklists, which can be easily…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Runtao Liu , Ashkan Khakzar , Jindong Gu , Qifeng Chen , Philip Torr , Fabio Pizzati

Text-to-image (T2I) generation models have made significant strides but still struggle with prompt sensitivity: even minor changes in prompt wording can yield inconsistent or inaccurate outputs. To address this challenge, we introduce a…

Machine Learning · Computer Science 2025-07-31 Mohammad Abdul Hafeez Khan , Yash Jain , Siddhartha Bhattacharyya , Vibhav Vineet

Text-to-image (T2I) generation has advanced rapidly, yet faithfully capturing spatial relationships described in natural language prompts remains a major challenge. Prior efforts have addressed this issue through prompt optimization,…

Artificial Intelligence · Computer Science 2025-09-22 Sander Schildermans , Chang Tian , Ying Jiao , Marie-Francine Moens

Jailbreak attacks can circumvent model safety guardrails and reveal critical blind spots. Prior attacks on text-to-video (T2V) models typically add adversarial perturbations to obviously unsafe prompts, which are often easy to detect and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Zonghao Ying , Moyang Chen , Nizhang Li , Zhiqiang Wang , Wenxin Zhang , Quanchen Zou , Zonglei Jing , Aishan Liu , Xianglong Liu

Text-to-Image (T2I) generation has made significant advancements with diffusion models, yet challenges persist in handling complex instructions, ensuring fine-grained content control, and maintaining deep semantic consistency. Existing T2I…

Machine Learning · Computer Science 2025-08-08 Xiaoqi Dong , Xiangyu Zhou , Nicholas Evans , Yujia Lin

A hallmark of modern large language models (LLMs) is their impressive general zero-shot and few-shot abilities, often elicited through in-context learning (ICL) via prompting. However, while highly coveted and being the most general,…

Computation and Language · Computer Science 2023-10-24 Xingchen Wan , Ruoxi Sun , Hootan Nakhost , Hanjun Dai , Julian Martin Eisenschlos , Sercan O. Arik , Tomas Pfister

With the rapid advancement of deep learning, the model robustness has become a significant research hotspot, \ie, adversarial attacks on deep neural networks. Existing works primarily focus on image classification tasks, aiming to alter the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Yufei Song , Ziqi Zhou , Minghui Li , Xianlong Wang , Hangtao Zhang , Menghao Deng , Wei Wan , Shengshan Hu , Leo Yu Zhang

We introduce Universal and Transferable Adversarial Perturbations (UTAP) for pathology foundation models that reveal critical vulnerabilities in their capabilities. Optimized using deep learning, UTAP comprises a fixed and weak noise…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Yuntian Wang , Xilin Yang , Che-Yung Shen , Nir Pillar , Aydogan Ozcan

While text-to-image diffusion models demonstrate impressive generation capabilities, they also exhibit vulnerability to backdoor attacks, which involve the manipulation of model outputs through malicious triggers. In this paper, for the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Zhongqi Wang , Jie Zhang , Shiguang Shan , Xilin Chen

Large Vision-Language Models (LVLMs) are susceptible to typographic attacks, which are misclassifications caused by an attack text that is added to an image. In this paper, we introduce a multi-image setting for studying typographic…

Cryptography and Security · Computer Science 2025-02-13 Xiaomeng Wang , Zhengyu Zhao , Martha Larson

Although text-to-image (T2I) models have recently thrived as visual generative priors, their reliance on high-quality text-image pairs makes scaling up expensive. We argue that grasping the cross-modality alignment is not a necessity for a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Shuailei Ma , Kecheng Zheng , Ying Wei , Wei Wu , Fan Lu , Yifei Zhang , Chen-Wei Xie , Biao Gong , Jiapeng Zhu , Yujun Shen

As Text-to-Image (T2I) generation becomes widespread, third-party platforms increasingly integrate multiple model APIs for convenient image creation. However, false claims of using official models can mislead users and harm model owners'…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Zidong Zhao , Yihao Huang , Qing Guo , Tianlin Li , Anran Li , Kailong Wang , Jin Song Dong , Geguang Pu

Recent advances in text-to-image generative models have raised concerns about their potential to produce harmful content when provided with malicious input text prompts. To address this issue, two main approaches have emerged: (1)…

Machine Learning · Computer Science 2025-11-13 Jiwoo Shin , Byeonghu Na , Mina Kang , Wonhyeok Choi , Il-Chul Moon

The vulnerability of Convolutional Neural Networks (CNNs) to adversarial samples has recently garnered significant attention in the machine learning community. Furthermore, recent studies have unveiled the existence of universal adversarial…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Juanjuan Weng , Zhiming Luo , Dazhen Lin , Shaozi Li

Text-to-image (T2I) models have become prevalent across numerous applications, making their robust evaluation against adversarial attacks a critical priority. Continuous access to new and challenging adversarial prompts across diverse…

Machine Learning · Computer Science 2025-07-25 Jessica Quaye , Charvi Rastogi , Alicia Parrish , Oana Inel , Minsuk Kahng , Lora Aroyo , Vijay Janapa Reddi

While deep learning models have achieved remarkable success in time series forecasting, their vulnerability to adversarial examples remains a critical security concern. However, existing attack methods in the forecasting field typically…

Machine Learning · Computer Science 2026-02-13 Ruixian Su , Yukun Bao , Xinze Zhang

Text-to-image (T2I) models achieve high-fidelity generation through extensive training on large datasets. However, these models may unintentionally pick up undesirable biases of their training data, such as over-representation of particular…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Shufan Li , Harkanwar Singh , Aditya Grover

Text-to-Image (T2I) generation has made significant advancements with the advent of diffusion models. These models exhibit remarkable abilities to produce images based on textual prompts. Current T2I models allow users to specify object…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Muhammad Atif Butt , Kai Wang , Javier Vazquez-Corral , Joost van de Weijer