English
Related papers

Related papers: Efficient Input-level Backdoor Defense on Text-to-…

200 papers

Vision-Language Models (VLMs) are increasingly susceptible to sophisticated adversarial attacks, including adaptive strategies specifically designed to bypass existing defenses. To address this vulnerability, we propose MirrorCheck, a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Samar Fares , Klea Ziu , Toluwani Aremu , Nikita Durasov , Martin Takáč , Pascal Fua , Ivan Laptev , Karthik Nandakumar

Diffusion models have advanced rapidly in recent years, producing high-fidelity images while raising concerns about intellectual property protection and the misuse of generative AI. Image watermarking for diffusion models, particularly…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Jindong Yang , Han Fang , Weiming Zhang , Nenghai Yu , Kejiang Chen

The rise of text-to-image (T2I) models has increasingly raised concerns regarding the generation of risky content, such as sexual, violent, and copyright-protected images, highlighting the need for effective safeguards within the models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Chenyu Zhang

In recent years, fueled by the rapid advancement of diffusion models, text-to-video (T2V) generation models have achieved remarkable progress, with notable examples including Pika, Luma, Kling, and Open-Sora. Although these models exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Jiayang Liu , Siyuan Liang , Shiqian Zhao , Rongcheng Tu , Wenbo Zhou , Aishan Liu , Dacheng Tao , Siew Kei Lam

Text-to-image (T2I) models, such as Stable Diffusion, have exhibited remarkable performance in generating high-quality images from text descriptions in recent years. However, text-to-image models may be tricked into generating…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Xinfeng Li , Yuchen Yang , Jiangyi Deng , Chen Yan , Yanjiao Chen , Xiaoyu Ji , Wenyuan Xu

Text-to-image (T2I) models have raised increasing safety concerns due to their capacity to generate NSFW and other banned objects. To mitigate these risks, safety filters and concept removal techniques have been introduced to block…

Cryptography and Security · Computer Science 2026-01-13 Xi Ye , Yiwen Liu , Lina Wang , Run Wang , Geying Yang , Yufei Hou , Jiayi Yu

Recent text-to-image (T2I) diffusion and flow-matching models can produce highly realistic images from natural language prompts. In practical scenarios, T2I systems are often run in a ``generate--then--select'' mode: many seeds are sampled…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Huanlei Guo , Hongxin Wei , Bingyi Jing

Recent studies show that text-to-image (T2I) models are vulnerable to adversarial attacks, especially with noun perturbations in text prompts. In this study, we investigate the impact of adversarial attacks on different POS tags within text…

Computation and Language · Computer Science 2024-09-25 G M Shahariar , Jia Chen , Jiachen Li , Yue Dong

Text-to-image models (T2I) offer a new level of flexibility by allowing users to guide the creative process through natural language. However, personalizing these models to align with user-provided visual concepts remains a challenging…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Yoad Tewel , Rinon Gal , Gal Chechik , Yuval Atzmon

The generative AI revolution in recent years has been spurred by an expansion in compute power and data quantity, which together enable extensive pre-training of powerful text-to-image (T2I) models. With their greater capabilities to…

Text-to-Image (T2I) models, represented by DALL$\cdot$E and Midjourney, have gained huge popularity for creating realistic images. The quality of these images relies on the carefully engineered prompts, which have become valuable…

Cryptography and Security · Computer Science 2026-01-22 Shiqian Zhao , Chong Wang , Yiming Li , Yihao Huang , Wenjie Qu , Siew-Kei Lam , Yi Xie , Kangjie Chen , Jie Zhang , Tianwei Zhang

When humans read a specific text, they often visualize the corresponding images, and we hope that computers can do the same. Text-to-image synthesis (T2I), which focuses on generating high-quality images from textual descriptions, has…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Nonghai Zhang , Hao Tang

Backdoor attacks are a kind of emergent training-time threat to deep neural networks (DNNs). They can manipulate the output of DNNs and possess high insidiousness. In the field of natural language processing, some attack methods have been…

Computation and Language · Computer Science 2021-11-05 Fanchao Qi , Yangyi Chen , Mukai Li , Yuan Yao , Zhiyuan Liu , Maosong Sun

Recent text-to-image (T2I) diffusion models show outstanding performance in generating high-quality images conditioned on textual prompts. However, they fail to semantically align the generated images with the prompts due to their limited…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Ruichen Wang , Zekang Chen , Chen Chen , Jian Ma , Haonan Lu , Xiaodong Lin

Modern text-to-image (T2I) generation systems (e.g., DALL$\cdot$E 3) exploit the memory mechanism, which captures key information in multi-turn interactions for faithful generation. Despite its practicality, the security analyses of this…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Shiqian Zhao , Jiayang Liu , Yiming Li , Runyi Hu , Xiaojun Jia , Wenshu Fan , Xiao Bao , Xinfeng Li , Jie Zhang , Wei Dong , Tianwei Zhang , Luu Anh Tuan

Text-to-Image (T2I) diffusion models have rapidly advanced, enabling the generation of high-quality images that align closely with textual descriptions. However, this progress has also raised concerns about their misuse for propaganda and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Jaechul Roh , Andrew Yuan , Jinsong Mao

Text-to-image (T2I) generation aims at producing realistic images corresponding to text descriptions. Generative Adversarial Network (GAN) has proven to be successful in this task. Typical T2I GANs are 2 phase methods that first pretrain an…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Yibin Liu , Jianyu Zhang , Li Zhang , Shijian Li , Gang Pan

Current text-to-image (T2I) generation models achieve promising results, but they fail on the scenarios where the knowledge implied in the text prompt is uncertain. For example, a T2I model released in February would struggle to generate a…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Chuanhao Li , Jianwen Sun , Yukang Feng , Mingliang Zhai , Yifan Chang , Kaipeng Zhang

The rapid development of generative artificial intelligence has made text to video models essential for building future multimodal world simulators. However, these models remain vulnerable to jailbreak attacks, where specially crafted…

Cryptography and Security · Computer Science 2025-04-29 Siyuan Liang , Jiayang Liu , Jiecheng Zhai , Tianmeng Fang , Rongcheng Tu , Aishan Liu , Xiaochun Cao , Dacheng Tao

Recent advances in large text-conditional diffusion models have revolutionized image generation by enabling users to create realistic, high-quality images from textual prompts, significantly enhancing artistic creation and visual…

Machine Learning · Computer Science 2025-07-08 Ali Naseh , Jaechul Roh , Eugene Bagdasarian , Amir Houmansadr