English
Related papers

Related papers: OOD-MMSafe: Advancing MLLM Safety from Harmful Int…

200 papers

The rapid development of Multimodal Large Reasoning Models (MLRMs) has demonstrated broad application potential, yet their safety and reliability remain critical concerns that require systematic exploration. To address this gap, we conduct…

Computation and Language · Computer Science 2025-10-14 Xinyue Lou , You Li , Jinan Xu , Xiangyu Shi , Chi Chen , Kaiyu Huang

As large language models (LLMs) are increasingly applied across various domains, enhancing safety while maintaining the helpfulness of LLMs has become a critical challenge. Recent studies solve this problem through safety-constrained online…

Computation and Language · Computer Science 2025-06-04 Yupeng Qi , Ziyu Lyu , Min Yang , Yanlin Wang , Lu Bai , Lixin Cui

Multimodal large language models (MLLMs) face safety misalignment, where visual inputs enable harmful outputs. To address this, existing methods require explicit safety labels or contrastive data; yet, threat-related concepts are concrete…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Qishun Yang , Shu Yang , Lijie Hu , Di Wang

Large Vision-Language Models (VLMs) have achieved remarkable performance across a wide range of tasks. However, their deployment in safety-critical domains poses significant challenges. Existing safety fine-tuning methods, which focus on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Yi Ding , Lijun Li , Bing Cao , Jing Shao

Safety alignment of large language models remains brittle under domain shift and noisy preference supervision. Most existing robust alignment methods focus on uncertainty in alignment data, while overlooking optimization-induced fragility…

Machine Learning · Computer Science 2026-05-22 Yonghui Yang , Wenjian Tao , Jilong Liu , Xingyu Zhu , Junfeng Fang , Weibiao Huang , Le Wu , Richang Hong , Tat-Sent Chua

Recent studies on the safety alignment of large language models (LLMs) have revealed that existing approaches often operate superficially, leaving models vulnerable to various adversarial attacks. Despite their significance, these studies…

Cryptography and Security · Computer Science 2025-06-02 Jianwei Li , Jung-Eun Kim

Many safety and alignment failures of large language models (LLMs) occur due to out-of-distribution (OOD) situations: unusual prompt or response patterns that are unforeseen by model developers. We systematically study whether LLM…

Artificial Intelligence · Computer Science 2026-05-26 Dylan Feng , Pragya Srivastava , Anca Dragan , Cassidy Laidlaw

With the integration of an additional modality, large vision-language models (LVLMs) exhibit greater vulnerability to safety risks (e.g., jailbreaking) compared to their language-only predecessors. Although recent studies have devoted…

Machine Learning · Computer Science 2025-01-07 Ziwei Zheng , Junyao Zhao , Le Yang , Lijun He , Fan Li

Despite the remarkable versatility of Large Language Models (LLMs) and Multimodal LLMs (MLLMs) to generalize across both language and vision tasks, LLMs and MLLMs have shown vulnerability to jailbreaking, generating textual outputs that…

Cryptography and Security · Computer Science 2025-03-28 Joonhyun Jeong , Seyun Bae , Yeonsung Jung , Jaeryong Hwang , Eunho Yang

Multimodal Large Language Models (MLLMs) exacerbate safety risks by introducing vulnerabilities across multiple modalities, such as language and vision. Current MLLM safety evaluation tools, however, suffer from major limitations: 1)…

Computation and Language · Computer Science 2026-05-28 Yongwoo Kim , Sojung An , Yunjin Park , Jungwon Yoon , Dujin Lee , HyunBeom Cho , Jaewon Lee , Wonhyuk Lee , Youngchol Kim , JeongYeop Kim , Donghyun Kim

Large Language Models (LLMs) are increasingly used in healthcare, yet ensuring their safety and trustworthiness remains a barrier to deployment. Conversational medical assistants must avoid unsafe compliance without over-refusing benign…

Artificial Intelligence · Computer Science 2025-12-05 Huy Nghiem , Swetasudha Panda , Devashish Khatwani , Huy V. Nguyen , Krishnaram Kenthapadi , Hal Daumé

With the increasing use of large language models (LLMs) in medical decision-support, it is essential to evaluate not only their final answers but also the reliability of their reasoning. Two key risks are Chain-of-Thought (CoT) faithfulness…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Kaiyuan Ji , Yijin Guo , Zicheng Zhang , Xiangyang Zhu , Yuan Tian , Ning Liu , Guangtao Zhai

Traditional autonomous driving systems often struggle to connect high-level reasoning with low-level control, leading to suboptimal and sometimes unsafe behaviors. Recent advances in multimodal large language models (MLLMs), which process…

Robotics · Computer Science 2025-06-09 Jiawei Zhang , Xuan Yang , Taiqi Wang , Yu Yao , Aleksandr Petiushko , Bo Li

Large Language Models (LLMs) are increasingly integrated into high-stakes applications, making robust safety guarantees a central practical and commercial concern. Existing safety evaluations predominantly rely on fixed collections of…

Computation and Language · Computer Science 2026-03-23 Zafir Shamsi , Nikhil Chekuru , Zachary Guzman , Shivank Garg

Traffic safety remains a critical global challenge, with traditional Advanced Driver-Assistance Systems (ADAS) often struggling in dynamic real-world scenarios due to fragmented sensor processing and susceptibility to adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Mohammad Abu Tami , Mohammed Elhenawy , Huthaifa I. Ashqar

Traditional approaches to safety event analysis in autonomous systems have relied on complex machine learning models and extensive datasets for high accuracy and reliability. However, the advent of Multimodal Large Language Models (MLLMs)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Mohammad Abu Tami , Huthaifa I. Ashqar , Mohammed Elhenawy

Benefiting from the powerful capabilities of Large Language Models (LLMs), pre-trained visual encoder models connected to an LLMs can realize Vision Language Models (VLMs). However, existing research shows that the visual modality of VLMs…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Zhendong Liu , Yuanbi Nie , Yingshui Tan , Xiangyu Yue , Qiushi Cui , Chongjun Wang , Xiaoyong Zhu , Bo Zheng

Safety alignment is critical for deploying large language models (LLMs) in real-world applications, yet most existing approaches rely on large human-annotated datasets and static red-teaming benchmarks that are costly, difficult to scale,…

Computation and Language · Computer Science 2026-03-10 Punyajoy Saha , Sudipta Halder , Debjyoti Mondal , Subhadarshi Panda

While the safety risks of image-based large language models (Image LLMs) have been extensively studied, their video-based counterparts (Video LLMs) remain critically under-examined. To systematically study this problem, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yiwei Sun , Peiqi Jiang , Chuanbin Liu , Luohao Lin , Zhiying Lu , Hongtao Xie

Despite Multimodal Large Language Models (MLLMs) having shown impressive capabilities, they may suffer from hallucinations. Empirically, we find that MLLMs attend disproportionately to task-irrelevant background regions compared with…

Computation and Language · Computer Science 2025-12-01 Peizheng Guo , Jingyao Wang , Wenwen Qiang , Jiahuan Zhou , Changwen Zheng , Gang Hua