English
Related papers

Related papers: T2VShield: Model-Agnostic Jailbreak Defense for Te…

200 papers

Text-to-image (T2I) models have significantly advanced in producing high-quality images. However, such models have the ability to generate images containing not-safe-for-work (NSFW) content, such as pornography, violence, political content,…

Cryptography and Security · Computer Science 2025-05-15 Longtian Wang , Xiaofei Xie , Tianlin Li , Yuhan Zhi , Chao Shen

Text-to-Video (T2V) generation has attracted significant attention for its ability to synthesize realistic videos from textual descriptions. However, existing models struggle to balance computational efficiency and high visual quality,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Takashi Isobe , He Cui , Dong Zhou , Mengmeng Ge , Dong Li , Emad Barsoum

The adoption of large language models (LLMs) in many applications, from customer service chat bots and software development assistants to more capable agentic systems necessitates research into how to secure these systems. Attacks like…

Cryptography and Security · Computer Science 2024-12-03 Erick Galinkin , Martin Sablotny

Large Language Models (LLMs) have evolved into Multimodal Large Language Models (MLLMs), significantly enhancing their capabilities by integrating visual information and other types, thus aligning more closely with the nature of human…

Cryptography and Security · Computer Science 2025-06-03 Youze Wang , Wenbo Hu , Yinpeng Dong , Jing Liu , Hanwang Zhang , Richang Hong

Thanks to recent advancements in scalable deep architectures and large-scale pretraining, text-to-video generation has achieved unprecedented capabilities in producing high-fidelity, instruction-following content across a wide range of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Xuyang Guo , Jiayan Huo , Zhenmei Shi , Zhao Song , Jiahao Zhang , Jiale Zhao

Recent advances in text-to-image generative models have raised concerns about their potential to produce harmful content when provided with malicious input text prompts. To address this issue, two main approaches have emerged: (1)…

Machine Learning · Computer Science 2025-11-13 Jiwoo Shin , Byeonghu Na , Mina Kang , Wonhyeok Choi , Il-Chul Moon

Recent progress in video generative models has enabled the creation of high-quality videos from multimodal prompts that combine text and images. While these systems offer enhanced controllability, they also introduce new safety risks, as…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Ruize Ma , Minghong Cai , Yilei Jiang , Jiaming Han , Yi Feng , Yingshui Tan , Xiaoyong Zhu , Bo Zhang , Bo Zheng , Xiangyu Yue

Recent advances in Multimodal Large Language Models (MLLMs) have significantly enhanced the naturalness and flexibility of human computer interaction by enabling seamless understanding across text, vision, and audio modalities. Among these,…

Computation and Language · Computer Science 2025-05-27 Binhao Ma , Hanqing Guo , Zhengping Jay Luo , Rui Duan

The increasing sophistication of large vision-language models (LVLMs) has been accompanied by advances in safety alignment mechanisms designed to prevent harmful content generation. However, these defenses remain vulnerable to sophisticated…

Cryptography and Security · Computer Science 2026-04-09 Quanchen Zou , Zonghao Ying , Moyang Chen , Wenzhuo Xu , Yisong Xiao , Yakai Li , Deyue Zhang , Dongdong Yang , Zhao Liu , Xiangzheng Zhang

Large Language Models (LLMs) are widely deployed in diverse real-world settings, yet remain vulnerable to jailbreaking, where prompt-based attacks bypass safety filters. We present THREAT (Targeted Harmful generation via Reframing and…

Cryptography and Security · Computer Science 2026-05-22 Shahnewaz Karim Sakib , Swati Kar , Anindya Bijoy Das

As the use of large language models (LLMs) continues to expand, ensuring their safety and robustness has become a critical challenge. In particular, jailbreak attacks that bypass built-in safety mechanisms are increasingly recognized as a…

Cryptography and Security · Computer Science 2025-11-19 Hajun Kim , Hyunsik Na , Daeseon Choi

Text-to-video (T2V) generative models have rapidly advanced and found widespread applications across fields like entertainment, education, and marketing. However, the adversarial vulnerabilities of these models remain rarely explored. We…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Ruotong Wang , Mingli Zhu , Jiarong Ou , Rui Chen , Xin Tao , Pengfei Wan , Baoyuan Wu

Large Vision-Language Models (LVLMs) are increasingly equipped with robust safety safeguards to prevent responses to harmful or disallowed prompts. However, these defenses often focus on analyzing explicit textual inputs or relevant visual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yihang Chen , Zhao Xu , Youyuan Jiang , Tianle Zheng , Cho-Jui Hsieh

With the ability to generate high-quality images, text-to-image (T2I) models can be exploited for creating inappropriate content. To prevent misuse, existing safety measures are either based on text blacklists, which can be easily…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Runtao Liu , Ashkan Khakzar , Jindong Gu , Qifeng Chen , Philip Torr , Fabio Pizzati

Iterative jailbreak methods that repeatedly rewrite and input prompts into large language models (LLMs) to induce harmful outputs -- using the model's previous responses to guide each new iteration -- have been found to be a highly…

Computation and Language · Computer Science 2025-10-21 Masahiro Kaneko , Zeerak Talat , Timothy Baldwin

Text-to-image (T2I) models such as Stable Diffusion and DALLE remain susceptible to generating harmful or Not-Safe-For-Work (NSFW) content under jailbreak attacks despite deployed safety filters. Existing jailbreak attacks either rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Haolun Zheng , Yu He , Tailun Chen , Shuo Shao , Zhixuan Chu , Hongbin Zhou , Lan Tao , Zhan Qin , Kui Ren

Text-to-image diffusion models (T2I DMs) have achieved remarkable success in generating high-quality and diverse images from text prompts, yet recent studies have revealed their vulnerability to backdoor attacks. Existing attack methods…

Cryptography and Security · Computer Science 2025-08-05 Haoran Dai , Jiawen Wang , Ruo Yang , Manali Sharma , Zhonghao Liao , Yuan Hong , Binghui Wang

We introduce new jailbreak attacks on vision language models (VLMs), which use aligned LLMs and are resilient to text-only jailbreak attacks. Specifically, we develop cross-modality attacks on alignment where we pair adversarial images…

Cryptography and Security · Computer Science 2023-10-12 Erfan Shayegani , Yue Dong , Nael Abu-Ghazaleh

As text-to-image (T2I) models advance and gain widespread adoption, their associated safety concerns are becoming increasingly critical. Malicious users exploit these models to generate Not-Safe-for-Work (NSFW) images using harmful or…

Cryptography and Security · Computer Science 2025-12-10 Yiming Wang , Jiahao Chen , Qingming Li , Tong Zhang , Rui Zeng , Xing Yang , Shouling Ji

Text-to-Image (T2I) models generate high-quality images but are vulnerable to malicious backdoor attacks that inject harmful biases (e.g., trigger-activated gender or racial stereotypes). Existing debiasing methods, often designed for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Hongyi Cai , Mohammad Mahdinur Rahman , Mingkang Dong , Muxin Pu , Moqyad Alqaily , Jie Li , Xinfeng Li , Jialie Shen , Meikang Qiu , Qingsong Wen