English
Related papers

Related papers: OOD-MMSafe: Advancing MLLM Safety from Harmful Int…

200 papers

Large reasoning models often reach correct answers through flawed intermediate steps, creating a gap between final accuracy and reasoning reliability. Existing alignment strategies address this with external verifiers or massive sampling,…

Artificial Intelligence · Computer Science 2026-05-11 Kejia Chen , Jiawen Zhang , Yihong Wu , Kewei Gao , Jian Lou , Zunlei Feng , Mingli Song , Ruoxi Jia

Large Language Models (LLMs) exhibit remarkable capabilities but remain vulnerable to adversarial manipulations such as jailbreaking, where crafted prompts bypass safety mechanisms. Understanding the causal factors behind such…

Cryptography and Security · Computer Science 2025-12-05 Wei Zhao , Zhe Li , Jun Sun

As vision-language models (VLMs) become increasingly capable, maintaining a balance between safety and usefulness remains a central challenge. Safety mechanisms, while essential, can backfire, causing over-refusal, where models decline…

Computation and Language · Computer Science 2026-03-20 Kaixuan Ren , Preslav Nakov , Usman Naseem

Large Language Models (LLMs) require careful safety alignment to prevent malicious outputs. While significant research focuses on mitigating harmful content generation, the enhanced safety often come with the side effect of over-refusal,…

Computation and Language · Computer Science 2025-06-17 Justin Cui , Wei-Lin Chiang , Ion Stoica , Cho-Jui Hsieh

Prepending model inputs with safety prompts is a common practice for safeguarding large language models (LLMs) against queries with harmful intents. However, the underlying working mechanisms of safety prompts have not been unraveled yet,…

Machine Learning · Computer Science 2024-06-04 Chujie Zheng , Fan Yin , Hao Zhou , Fandong Meng , Jie Zhou , Kai-Wei Chang , Minlie Huang , Nanyun Peng

Large language models (LLMs) have recently shown strong potential in vulnerability detection (VD). However, accurately detecting vulnerabilities in real-world repositories requires reasoning over complex contextual interactions. Existing…

Cryptography and Security · Computer Science 2026-05-28 Youpeng Li , Fuxun Yu , Weiliang Qi , Xinda Wang

While the wide adoption of refusal training in large language models (LLMs) has showcased improvements in model safety, recent works have highlighted shortcomings due to the shallow nature of these alignment methods. To this end, the work…

Machine Learning · Computer Science 2026-04-17 Pankayaraj Pathmanathan , Furong Huang

Current vision large language models (VLLMs) exhibit remarkable capabilities yet are prone to generate harmful content and are vulnerable to even the simplest jailbreaking attacks. Our initial analysis finds that this is due to the presence…

Machine Learning · Computer Science 2024-06-19 Yongshuo Zong , Ondrej Bohdal , Tingyang Yu , Yongxin Yang , Timothy Hospedales

Multimodal large language models (MLLMs) enable interaction over both text and images, but their safety behavior can be driven by unimodal shortcuts instead of true joint intent understanding. We introduce CSR-Bench, a benchmark for…

Artificial Intelligence · Computer Science 2026-02-04 Yuxuan Liu , Yuntian Shi , Kun Wang , Haoting Shen , Kun Yang

Despite significant advances in alignment techniques, we demonstrate that state-of-the-art language models remain vulnerable to carefully crafted conversational scenarios that can induce various forms of misalignment without explicit…

Computation and Language · Computer Science 2025-08-07 Siddhant Panpatil , Hiskias Dingeto , Haon Park

Reinforcement learning with verifiable reward has recently emerged as a central paradigm for post-training large language models (LLMs); however, prevailing mean-based methods, such as Group Relative Policy Optimization (GRPO), suffer from…

Machine Learning · Computer Science 2025-10-02 Tao Ren , Jinyang Jiang , Hui Yang , Wan Tian , Minhao Zou , Guanghao Li , Zishi Zhang , Qinghao Wang , Shentao Qin , Yanjun Zhao , Rui Tao , Hui Shao , Yijie Peng

Autonomous landing is essential for drones deployed in emergency deliveries, post-disaster response, and other large-scale missions. By enabling self-docking on charging platforms, it facilitates continuous operation and significantly…

Robotics · Computer Science 2025-05-13 Siwei Cai , Yuwei Wu , Lifeng Zhou

Multimodal Large Language Models (MLLMs) pose unique safety challenges due to their integration of visual and textual data, thereby introducing new dimensions of potential attacks and complex risk combinations. In this paper, we begin with…

Ensuring the safety of Large Language Models (LLMs) is critical for real-world deployment. However, current safety measures often fail to address implicit, domain-specific risks. To investigate this gap, we introduce a dataset of 3,000…

Artificial Intelligence · Computer Science 2026-01-09 Liang Shan , Kaicheng Shen , Wen Wu , Zhenyu Ying , Chaochao Lu , Yan Teng , Jingqi Huang , Guangze Ye , Guoqing Wang , Liang He

Vision-language models (VLMs) are increasingly applied to identify unsafe or inappropriate images due to their internal ethical standards and powerful reasoning abilities. However, it is still unclear whether they can recognize various…

Cryptography and Security · Computer Science 2025-07-16 Yiting Qu , Michael Backes , Yang Zhang

Reward-based alignment methods for large language models (LLMs) face two key limitations: vulnerability to reward hacking, where models exploit flaws in the reward signal; and reliance on brittle, labor-intensive prompt engineering when…

Computation and Language · Computer Science 2025-05-20 Zae Myung Kim , Chanwoo Park , Vipul Raheja , Suin Kim , Dongyeop Kang

Safety alignment in Large Language Models is critical for healthcare; however, reliance on binary refusal boundaries often results in \emph{over-refusal} of benign queries or \emph{unsafe compliance} with harmful ones. While existing…

Artificial Intelligence · Computer Science 2026-01-27 Zhihao Zhang , Liting Huang , Guanghao Wu , Preslav Nakov , Heng Ji , Usman Naseem

The security concerns surrounding Large Language Models (LLMs) have been extensively explored, yet the safety of Multimodal Large Language Models (MLLMs) remains understudied. In this paper, we observe that Multimodal Large Language Models…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Xin Liu , Yichen Zhu , Jindong Gu , Yunshi Lan , Chao Yang , Yu Qiao

As Video Large Multimodal Models (VLMMs) rapidly advance, their inherent complexity introduces significant safety challenges, particularly the issue of mismatched generalization where static safety alignments fail to transfer to dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Yixu Wang , Jiaxin Song , Yifeng Gao , Xin Wang , Yang Yao , Yan Teng , Xingjun Ma , Yingchun Wang , Yu-Gang Jiang

Large Language Models (LLMs) excel in various natural language processing tasks but remain vulnerable to generating harmful content or being exploited for malicious purposes. Although safety alignment datasets have been introduced to…

Computation and Language · Computer Science 2026-04-20 Xiaorui Wu , Xiaofeng Mao , Fei Li , Xin Zhang , Xuanhong Li , Chong Teng , Donghong Ji , Zhuang Li
‹ Prev 1 3 4 5 6 7 10 Next ›