English
Related papers

Related papers: Multimodal Situational Safety

200 papers

The security concerns surrounding Large Language Models (LLMs) have been extensively explored, yet the safety of Multimodal Large Language Models (MLLMs) remains understudied. In this paper, we observe that Multimodal Large Language Models…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Xin Liu , Yichen Zhu , Jindong Gu , Yunshi Lan , Chao Yang , Yu Qiao

Multimodal large language models (MLLMs) are increasingly deployed as assistants that interact through text and images, making it crucial to evaluate contextual safety when risk depends on both the visual scene and the evolving dialogue.…

Computation and Language · Computer Science 2026-01-13 Zheyuan Liu , Dongwhi Kim , Yixin Wan , Xiangchi Yuan , Zhaoxuan Tan , Fengran Mo , Meng Jiang

Attracted by the impressive power of Multimodal Large Language Models (MLLMs), the public is increasingly utilizing them to improve the efficiency of daily work. Nonetheless, the vulnerabilities of MLLMs to unsafe instructions bring huge…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Xin Liu , Yichen Zhu , Yunshi Lan , Chao Yang , Yu Qiao

Safety concerns of Multimodal large language models (MLLMs) have gradually become an important problem in various applications. Surprisingly, previous works indicate a counterintuitive phenomenon that using textual unlearning to align MLLMs…

Cryptography and Security · Computer Science 2025-05-20 Xuhao Hu , Dongrui Liu , Hao Li , Xuanjing Huang , Jing Shao

Multimodal Large Language Models (MLLMs) are showing strong safety concerns (e.g., generating harmful outputs for users), which motivates the development of safety evaluation benchmarks. However, we observe that existing safety benchmarks…

Cryptography and Security · Computer Science 2024-10-25 Zonghao Ying , Aishan Liu , Siyuan Liang , Lei Huang , Jinyang Guo , Wenbo Zhou , Xianglong Liu , Dacheng Tao

As Multimodal Large Language Models (MLLMs) become an indispensable assistant in human life, the unsafe content generated by MLLMs poses a danger to human behavior, perpetually overhanging human society like a sword of Damocles. To…

Computation and Language · Computer Science 2026-04-21 Xinyue Lou , Jinan Xu , Jingyi Yin , Xiaolong Wang , Zhaolu Kang , Youwei Liao , Yixuan Wang , Xiangyu Shi , Fengran Mo , Su Yao , Kaiyu Huang

Multimodal Large Language Models (MLLMs) have expanded the capabilities of traditional language models by enabling interaction through both text and images. However, ensuring the safety of these models remains a significant challenge,…

Computation and Language · Computer Science 2025-06-04 Wenxuan Wang , Xiaoyuan Liu , Kuiyi Gao , Jen-tse Huang , Youliang Yuan , Pinjia He , Shuai Wang , Zhaopeng Tu

The robust safety of Vision-Language Large Models (VLLMs) against joint multilingual and multimodal threats remains severely underexplored. Current benchmarks typically isolate these dimensions, being either multilingual but text-only, or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Enyi Shi , Pengyang Shao , Yanxin Zhang , Chenhang Cui , Jiayi Lyu , Xiaobo Xia , Fei Shen , Tat-Seng Chua

Powered by remarkable advancements in Large Language Models (LLMs), Multimodal Large Language Models (MLLMs) demonstrate impressive capabilities in manifold tasks. However, the practical application scenarios of MLLMs are intricate,…

Computation and Language · Computer Science 2024-06-18 Tianle Gu , Zeyang Zhou , Kexin Huang , Dandan Liang , Yixu Wang , Haiquan Zhao , Yuanqi Yao , Xingge Qiao , Keqing Wang , Yujiu Yang , Yan Teng , Yu Qiao , Yingchun Wang

Humans are prone to cognitive distortions -- biased thinking patterns that lead to exaggerated responses to specific stimuli, albeit in very different contexts. This paper demonstrates that advanced Multimodal Large Language Models (MLLMs)…

Computation and Language · Computer Science 2024-06-27 Xirui Li , Hengguang Zhou , Ruochen Wang , Tianyi Zhou , Minhao Cheng , Cho-Jui Hsieh

Traffic safety remains a critical global challenge, with traditional Advanced Driver-Assistance Systems (ADAS) often struggling in dynamic real-world scenarios due to fragmented sensor processing and susceptibility to adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Mohammad Abu Tami , Mohammed Elhenawy , Huthaifa I. Ashqar

Multimodal large language models (MLLMs) enable interaction over both text and images, but their safety behavior can be driven by unimodal shortcuts instead of true joint intent understanding. We introduce CSR-Bench, a benchmark for…

Artificial Intelligence · Computer Science 2026-02-04 Yuxuan Liu , Yuntian Shi , Kun Wang , Haoting Shen , Kun Yang

As Multimodal Large Language Models (MLLMs) acquire stronger reasoning capabilities to handle complex, multi-image instructions, this advancement may pose new safety risks. We study this problem by introducing MIR-SafetyBench, the first…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Renmiao Chen , Yida Lu , Shiyao Cui , Xuan Ouyang , Victor Shea-Jay Huang , Shumin Zhang , Chengwei Pan , Han Qiu , Minlie Huang

Multimodal Large Language Models (MLLMs) have enabled transformative advancements across diverse applications but remain susceptible to safety threats, especially jailbreak attacks that induce harmful outputs. To systematically evaluate and…

With the widespread use of multi-modal Large Language models (MLLMs), safety issues have become a growing concern. Multi-turn dialogues, which are more common in everyday interactions, pose a greater risk than single prompts; however,…

Computation and Language · Computer Science 2025-10-15 Han Zhu , Juntao Dai , Jiaming Ji , Haoran Li , Chengkun Cai , Pengcheng Wen , Chi-Min Chan , Boyuan Chen , Yaodong Yang , Sirui Han , Yike Guo

Multi-modal Large Language Models (MLLMs) have achieved remarkable performance across a wide range of visual reasoning tasks, yet their vulnerability to safety risks remains a pressing concern. While prior research primarily focuses on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Ce Zhang , Jinxi He , Junyi He , Katia Sycara , Yaqi Xie

As large language models (LLMs) are increasingly deployed as agents, their integration into interactive environments and tool use introduce new safety challenges beyond those associated with the models themselves. However, the absence of…

Computation and Language · Computer Science 2025-05-21 Zhexin Zhang , Shiyao Cui , Yida Lu , Jingzhuo Zhou , Junxiao Yang , Hongning Wang , Minlie Huang

Multimodal large language models (MLLMs) have shown satisfactory effects in many autonomous driving tasks. In this paper, MLLMs are utilized to solve joint semantic scene understanding and risk localization tasks, while only relying on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Jiaqi Fan , Jianhua Wu , Jincheng Gao , Jianhao Yu , Yafei Wang , Hongqing Chu , Bingzhao Gao

As Large Language Models (LLMs) continue to advance in understanding and generating long sequences, new safety concerns have been introduced through the long context. However, the safety of LLMs in long-context tasks remains under-explored,…

Computation and Language · Computer Science 2025-02-25 Yida Lu , Jiale Cheng , Zhexin Zhang , Shiyao Cui , Cunxiang Wang , Xiaotao Gu , Yuxiao Dong , Jie Tang , Hongning Wang , Minlie Huang

With the rapid development of Large Language Models (LLMs), increasing attention has been paid to their safety concerns. Consequently, evaluating the safety of LLMs has become an essential task for facilitating the broad applications of…

Computation and Language · Computer Science 2024-06-25 Zhexin Zhang , Leqi Lei , Lindong Wu , Rui Sun , Yongkang Huang , Chong Long , Xiao Liu , Xuanyu Lei , Jie Tang , Minlie Huang
‹ Prev 1 2 3 10 Next ›