English
Related papers

Related papers: Simulated Ensemble Attack: Transferring Jailbreaks…

200 papers

Recent advances in Multimodal Large Language Models (MLLMs) have significantly enhanced the naturalness and flexibility of human computer interaction by enabling seamless understanding across text, vision, and audio modalities. Among these,…

Computation and Language · Computer Science 2025-05-27 Binhao Ma , Hanqing Guo , Zhengping Jay Luo , Rui Duan

Safety-aligned LLMs suffer from two failure modes: jailbreak (answering harmful inputs) and over-refusal (declining benign queries). Existing vector steering methods adjust the magnitude of answer vectors, but this creates a fundamental…

Machine Learning · Computer Science 2026-05-05 Haonan Zhang , Dongxia Wang , Yi Liu , Kexin Chen , Wenhai Wang

Large Language Models (LLMs) have become increasingly popular for their advanced text generation capabilities across various domains. However, like any software, they face security challenges, including the risk of 'jailbreak' attacks that…

Cryptography and Security · Computer Science 2024-01-31 Jie Li , Yi Liu , Chongyang Liu , Ling Shi , Xiaoning Ren , Yaowen Zheng , Yang Liu , Yinxing Xue

Vision-language pre-training (VLP) models have shown vulnerability to adversarial examples in multimodal tasks. Furthermore, malicious adversaries can be deliberately transferred to attack other black-box models. However, existing work has…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Dong Lu , Zhiqiang Wang , Teng Wang , Weili Guan , Hongchang Gao , Feng Zheng

LLM jailbreaks are a widespread safety challenge. Given this problem has not yet been tractable, we suggest targeting a key failure mechanism: the failure of safety to generalize across semantically equivalent inputs. We further focus the…

Adversarial examples (AEs) have been extensively studied due to their potential for privacy protection and inspiring robust neural networks. Yet, making a targeted AE transferable across unknown models remains challenging. In this paper, to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Hui Zeng , Biwei Chen , Anjie Peng

Recently, there has been a surge of interest in integrating vision into Large Language Models (LLMs), exemplified by Visual Language Models (VLMs) such as Flamingo and GPT-4. This paper sheds light on the security and safety implications of…

Cryptography and Security · Computer Science 2023-08-21 Xiangyu Qi , Kaixuan Huang , Ashwinee Panda , Peter Henderson , Mengdi Wang , Prateek Mittal

Recent advancements in Large Language Model (LLM) safety have primarily focused on mitigating attacks crafted in natural language or common ciphers (e.g. Base64), which are likely integrated into newer models' safety training. However, we…

Computation and Language · Computer Science 2025-10-15 Divij Handa , Zehua Zhang , Amir Saeidi , Shrinidhi Kumbhar , Md Nayem Uddin , Aswin RRV , Chitta Baral

Jailbreaking is an essential adversarial technique for red-teaming these models to uncover and patch security flaws. However, existing jailbreak methods face significant drawbacks. Token-level jailbreak attacks often produce incoherent or…

Cryptography and Security · Computer Science 2026-04-16 Jiecong Wang , Haoran Li , Hao Peng , Ziqian Zeng , Zihao Wang , Haohua Du , Zhengtao Yu

Large Vision Language Models (LVLMs) demonstrate strong capabilities in multimodal reasoning and many real-world applications, such as visual question answering. However, LVLMs are highly vulnerable to jailbreaking attacks. This paper…

Artificial Intelligence · Computer Science 2025-11-19 Badhan Chandra Das , Md Tasnim Jawad , Md Jueal Mia , M. Hadi Amini , Yanzhao Wu

As the integration of the Large Language Models (LLMs) into various applications increases, so does their susceptibility to misuse, raising significant security concerns. Numerous jailbreak attacks have been proposed to assess the security…

Cryptography and Security · Computer Science 2025-05-30 Bijoy Ahmed Saiem , MD Sadik Hossain Shanto , Rakib Ahsan , Md Rafi ur Rashid

The growing misuse of Vision-Language Models (VLMs) has led providers to deploy multiple safeguards, including alignment tuning, system prompts, and content moderation. However, the real-world robustness of these defenses against…

Cryptography and Security · Computer Science 2025-11-21 Yijun Yang , Lichao Wang , Jianping Zhang , Chi Harold Liu , Lanqing Hong , Qiang Xu

Current approaches using sequential networks have shown promise in estimating field variables for dynamical systems, but they are often limited by high rollout errors. The unresolved issue of rollout error accumulation results in unreliable…

Machine Learning · Computer Science 2024-10-31 Parsa Esmati , Amirhossein Dadashzadeh , Vahid Goodarzi , Nicolas Larrosa , Nicolò Grilli

As large language models (LLMs) continue to advance in capability and influence, ensuring their security and preventing harmful outputs has become crucial. A promising approach to address these concerns involves training models to…

Computation and Language · Computer Science 2024-12-24 Muxi Diao , Rumei Li , Shiyang Liu , Guogang Liao , Jingang Wang , Xunliang Cai , Weiran Xu

In recent years, learning-based underwater image enhancement (UIE) techniques have rapidly evolved. However, distribution shifts between high-quality enhanced outputs and natural images can hinder semantic cue extraction for downstream…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Guodong Fan , Shengning Zhou , Genji Yuan , Huiyu Li , Jingchun Zhou , Jinjiang Li

Large Language Models (LLMs) have revolutionized natural language processing but remain vulnerable to jailbreak attacks, especially multi-turn jailbreaks that distribute malicious intent across benign exchanges and bypass alignment…

Cryptography and Security · Computer Science 2025-10-22 Javad Rafiei Asl , Sidhant Narula , Mohammad Ghasemigol , Eduardo Blanco , Daniel Takabi

Large language models (LLMs) are increasingly utilized in healthcare applications. However, their deployment in clinical practice raises significant safety concerns, including the potential spread of harmful information. This study…

Cryptography and Security · Computer Science 2025-03-05 Hang Zhang , Qian Lou , Yanshan Wang

Large Language Models (LLMs) face prominent security risks from jailbreaking, a practice that manipulates models to bypass built-in security constraints and generate unethical or unsafe content. Among various jailbreak techniques,…

Cryptography and Security · Computer Science 2026-04-14 Yihao Zhang , Kai Wang , Jiangrong Wu , Haolin Wu , Yuxuan Zhou , Zeming Wei , Dongxian Wu , Xun Chen , Jun Sun , Meng Sun

Large Language Models (LLMs) have demonstrated remarkable performance across diverse tasks. Nevertheless, they still pose notable safety risks due to potential misuse for malicious purposes. Jailbreaking, which seeks to induce models to…

Computation and Language · Computer Science 2025-09-30 Hua Tang , Lingyong Yan , Yukun Zhao , Shuaiqiang Wang , Jizhou Huang , Dawei Yin

Large language models (LLMs) are widely used for task understanding and action planning in embodied intelligence (EI) systems, but their adoption substantially increases vulnerability to jailbreak attacks. While recent work explores…

Cryptography and Security · Computer Science 2026-01-06 Jirui Yang , Zheyu Lin , Zhihui Lu , Yinggui Wang , Lei Wang , Tao Wei , Qiang Duan , Xin Du , Shuhan Yang
‹ Prev 1 3 4 5 6 7 10 Next ›