English
Related papers

Related papers: RoboJailBench: Benchmarking Adversarial Attacks an…

200 papers

The rapid evolution of Vision-Language Models (VLMs) has catalyzed unprecedented capabilities in artificial intelligence; however, this continuous modal expansion has inadvertently exposed a vastly broadened and unconstrained adversarial…

Artificial Intelligence · Computer Science 2026-04-15 Jianhao Chen , Haoyang Chen , Hanjie Zhao , Haozhe Liang , Tieyun Qian

As vision-language models (VLMs) gain prominence, their multimodal interfaces also introduce new safety vulnerabilities, making the safety evaluation challenging and critical. Existing red-teaming efforts are either restricted to a narrow…

Artificial Intelligence · Computer Science 2025-10-06 Zhaorun Chen , Xun Liu , Mintong Kang , Jiawei Zhang , Minzhou Pan , Shuang Yang , Bo Li

Embodied AI systems (e.g., autonomous vehicles, service robots, and LLM-driven interactive agents) are rapidly transitioning from controlled environments to safety critical real-world deployments. Unlike disembodied AI, failures in embodied…

Cryptography and Security · Computer Science 2026-02-20 Boyang Ma , Hechuan Guo , Peizhuo Lv , Minghui Xu , Xuelong Dai , YeChao Zhang , Yijun Yang , Yue Zhang

Medical Large Language Models (LLMs) are increasingly deployed for clinical decision support across diverse specialties, yet systematic evaluation of their robustness to adversarial misuse and privacy leakage remains inaccessible to most…

Cryptography and Security · Computer Science 2025-12-10 Jinghao Wang , Ping Zhang , Carter Yagemann

Developing autonomous home robots controlled by natural language has long been a pursuit of humanity. While advancements in large language models (LLMs) and embodied intelligence make this goal closer, several challenges persist: the lack…

Robotics · Computer Science 2025-05-16 Dongping Li , Tielong Cai , Tianci Tang , Wenhao Chai , Katherine Rose Driggs-Campbell , Gaoang Wang

Jailbreaking -- bypassing built-in safety mechanisms in AI models -- has traditionally required complex technical procedures or specialized human expertise. In this study, we show that the persuasive capabilities of large reasoning models…

Computation and Language · Computer Science 2026-02-10 Thilo Hagendorff , Erik Derner , Nuria Oliver

As Large Language Models (LLMs) advance toward embodied AI agents operating in physical environments, a fundamental question emerges: can models trained on text corpora reliably reason about complex physics while adhering to safety…

Artificial Intelligence · Computer Science 2026-04-13 Yalun Wu , Haotian Liu , Zhoujun Li , Boyang Wang

Despite extensive pre-training in moral alignment to prevent generating harmful information, large language models (LLMs) remain vulnerable to jailbreak attacks. In this paper, we propose AutoDefense, a multi-agent defense framework that…

Machine Learning · Computer Science 2024-11-15 Yifan Zeng , Yiran Wu , Xiao Zhang , Huazheng Wang , Qingyun Wu

As artificial intelligence (AI) systems are increasingly deployed across critical domains, their security vulnerabilities pose growing risks of high-profile exploits and consequential system failures. Yet systematic approaches to evaluating…

Cryptography and Security · Computer Science 2026-04-28 Mikko Lempinen , Joni Kemppainen , Niklas Raesalmi

The enhancement of generalization in robots by large vision-language models (LVLMs) is increasingly evident. Therefore, the embodied cognitive abilities of LVLMs based on egocentric videos are of great interest. However, current datasets…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Ronghao Dang , Yuqian Yuan , Wenqi Zhang , Yifei Xin , Boqiang Zhang , Long Li , Liuyi Wang , Qinyang Zeng , Xin Li , Lidong Bing

We present MultiBreak, a scalable and diverse multi-turn jailbreak benchmark to evaluate large language model (LLM) safety. Multi-turn jailbreaks mimic natural conversational settings, making them easier to bypass safety-aligned LLM than…

Computation and Language · Computer Science 2026-05-05 Jialin Song , Xiaodong Liu , Weiwei Yang , Wuyang Chen , Mingqian Feng , Xuekai Zhu , Jianfeng Gao

Despite their superb capabilities, Vision-Language Models (VLMs) have been shown to be vulnerable to jailbreak attacks. While recent jailbreaks have achieved notable progress, their effectiveness and efficiency can still be improved. In…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Yunhan Zhao , Xiang Zheng , Xingjun Ma

Large language models (LLMs) are increasingly deployed in a wide range of applications, yet remain vulnerable to adversarial jailbreak attacks that circumvent their safety guardrails. Existing evaluation frameworks typically report binary…

Cryptography and Security · Computer Science 2026-05-14 Zvi Topol

Vision-language models (VLMs) extend large language models (LLMs) with vision encoders, enabling text generation conditioned on both images and text. However, this multimodal integration expands the attack surface by exposing the model to…

Machine Learning · Computer Science 2026-02-03 Kaiyuan Cui , Yige Li , Yutao Wu , Xingjun Ma , Sarah Erfani , Christopher Leckie , Hanxun Huang

We introduce WildTeaming, an automatic LLM safety red-teaming framework that mines in-the-wild user-chatbot interactions to discover 5.7K unique clusters of novel jailbreak tactics, and then composes multiple tactics for systematic…

The integration of new modalities into frontier AI systems offers exciting capabilities, but also increases the possibility such systems can be adversarially manipulated in undesirable ways. In this work, we focus on a popular class of…

Object detection models are critical components of automated systems, such as autonomous vehicles and perception-based robots, but their sensitivity to adversarial attacks poses a serious security risk. Progress in defending these models…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Alexis Winter , Jean-Vincent Martini , Romaric Audigier , Angelique Loesch , Bertrand Luvison

Coordinating multiple embodied agents in dynamic environments remains a core challenge in artificial intelligence, requiring both perception-driven reasoning and scalable cooperation strategies. While recent works have leveraged large…

Artificial Intelligence · Computer Science 2026-01-23 Li Kang , Xiufeng Song , Heng Zhou , Yiran Qin , Jie Yang , Xiaohong Liu , Philip Torr , Lei Bai , Zhenfei Yin

The rapid proliferation of LLM-based autonomous agents in real operating system environments introduces a new category of safety risk beyond content safety: behavior jailbreak, where an adversary induces an agent to execute dangerous…

Cryptography and Security · Computer Science 2026-05-12 Chiyu Zhang , Huiqin Yang , Bendong Jiang , Xiaolei Zhang , Yiran Zhao , Ruyi Chen , Lu Zhou , Xiaogang Xu , Jiafei Wu , Liming Fang , Zhe Liu

Large Vision-Language Models (LVLMs), trained on multimodal big datasets, have significantly advanced AI by excelling in vision-language tasks. However, these models remain vulnerable to adversarial attacks, particularly jailbreak attacks,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Md Zarif Hossain , Ahmed Imteaj