English
Related papers

Related papers: Think in Safety: Unveiling and Mitigating Safety A…

200 papers

We present MultiBreak, a scalable and diverse multi-turn jailbreak benchmark to evaluate large language model (LLM) safety. Multi-turn jailbreaks mimic natural conversational settings, making them easier to bypass safety-aligned LLM than…

Computation and Language · Computer Science 2026-05-05 Jialin Song , Xiaodong Liu , Weiwei Yang , Wuyang Chen , Mingqian Feng , Xuekai Zhu , Jianfeng Gao

Large language models increasingly rely on explicit chain-of-thought reasoning to solve complex tasks, yet the safety of the reasoning process itself remains largely unaddressed. Existing work focuses predominantly on content safety (i.e.,…

Artificial Intelligence · Computer Science 2026-05-07 Xunguang Wang , Yuguang Zhou , Qingyue Wang , Zongjie Li , Ruixuan Huang , Zhenlan Ji , Pingchuan Ma , Shuai Wang

Despite the remarkable proficiency of \textit{Large Reasoning Models} (LRMs) in handling complex reasoning tasks, their reliability in safety-critical scenarios remains uncertain. Existing evaluations primarily assess response-level safety,…

Artificial Intelligence · Computer Science 2025-05-27 Baihui Zheng , Boren Zheng , Kerui Cao , Yingshui Tan , Zhendong Liu , Weixun Wang , Jiaheng Liu , Jian Yang , Wenbo Su , Xiaoyong Zhu , Bo Zheng , Kaifu Zhang

Current safety alignment techniques for large language models (LLMs) face two key challenges: (1) under-generalization, which leaves models vulnerable to novel jailbreak attacks, and (2) over-alignment, which leads to the excessive refusal…

Computation and Language · Computer Science 2025-04-15 Yutao Mou , Yuxiao Luo , Shikun Zhang , Wei Ye

Large Reasoning Models (LRMs) have emerged as a powerful advancement in multi-step reasoning tasks, offering enhanced transparency and logical consistency through explicit chains of thought (CoT). However, these models introduce novel…

Cryptography and Security · Computer Science 2026-04-15 Jiawei Chen , Yang Yang , Chao Yu , Yu Tian , Zhi Cao , Xue Yang , Linghao Li , Hang Su , Zhaoxia Yin

Large Language Models have shown impressive generative capabilities across diverse tasks, but their safety remains a critical concern. Existing post-training alignment methods, such as SFT and RLHF, reduce harmful outputs yet leave LLMs…

Cryptography and Security · Computer Science 2025-10-21 Zhengyue Zhao , Yingzi Ma , Somesh Jha , Marco Pavone , Patrick McDaniel , Chaowei Xiao

Multimodal Large Language Models (MLLMs) are rapidly evolving, demonstrating impressive capabilities as multimodal assistants that interact with both humans and their environments. However, this increased sophistication introduces…

Artificial Intelligence · Computer Science 2025-04-24 Kaiwen Zhou , Chengzhi Liu , Xuandong Zhao , Anderson Compalas , Dawn Song , Xin Eric Wang

Multi-modal Large Language Models (MLLMs) have achieved remarkable performance across a wide range of visual reasoning tasks, yet their vulnerability to safety risks remains a pressing concern. While prior research primarily focuses on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Ce Zhang , Jinxi He , Junyi He , Katia Sycara , Yaqi Xie

Safeguarding vision-language models (VLMs) is a critical challenge, as existing methods often suffer from over-defense, which harms utility, or rely on shallow alignment, failing to detect complex threats that require deep reasoning. To…

Cryptography and Security · Computer Science 2026-04-03 Nanxi Li , Zhengyue Zhao , G. Edward Suh , Marco Pavone , Chaowei Xiao

Multimodal large language models (MLLMs) have become integral to a wide range of real-world applications by jointly reasoning over text and visual inputs. However, despite recent advances in safety alignment, MLLMs remain vulnerable to…

Cryptography and Security · Computer Science 2026-03-10 Xinkai Wang , Beibei Li , Zerui Shao , Ao Liu , Guangquan Xu , Shouling Ji

Reasoning Language Models (RLMs) have gained traction for their ability to perform complex, multi-step reasoning tasks through mechanisms such as Chain-of-Thought (CoT) prompting or fine-tuned reasoning traces. While these capabilities…

Computation and Language · Computer Science 2025-07-04 Riccardo Cantini , Nicola Gabriele , Alessio Orsino , Domenico Talia

In this paper, we present a holistic multimodal benchmark that evaluates the reasoning capabilities of MLLMs with an explicit focus on reasoning width, a complementary dimension to the more commonly studied reasoning depth. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Mingrui Chen , Hexiong Yang , Haogeng Liu , Huaibo Huang , Ran He

Large reasoning models (LRMs) increasingly expose chain-of-thought-like reasoning for transparency, verification, and deliberate problem solving. This creates a safety blind spot: harmful or policy-violating content may appear in reasoning…

Artificial Intelligence · Computer Science 2026-05-08 Xiaomin Li , Jianheng Hou , Zheyuan Deng , Zhiwei Zhang , Taoran Li , Binghang Lu , Bing Hu , Yunhan Zhao , Yuexing Hao

Studying the robustness of Large Language Models (LLMs) to unsafe behaviors is an important topic of research today. Building safety classification models or guard models, which are fine-tuned models for input/output safety classification…

Computation and Language · Computer Science 2025-07-30 Sowmya Vajjala

Multimodal large language models (MLLMs) are increasingly deployed as the core reasoning engine for web-facing systems, powering GUI agents and front-end automation that must interpret page structure, select actionable widgets, and execute…

Artificial Intelligence · Computer Science 2026-03-05 Junliang Liu , Jingyu Xiao , Wenxin Tang , Zhixian Wang , Zipeng Xie , Wenxuan Wang , Minrui Zhang , Shuanghe Yu

Large reasoning models (LRMs) achieve strong performance on complex reasoning tasks but often generate harmful responses to malicious user queries. This paper investigates the underlying cause of these safety risks and shows that the issue…

Artificial Intelligence · Computer Science 2026-04-22 Yeonjun In , Wonjoong Kim , Sangwu Park , Chanyoung Park

Large language models (LLMs) are increasingly deployed in a wide range of applications, yet remain vulnerable to adversarial jailbreak attacks that circumvent their safety guardrails. Existing evaluation frameworks typically report binary…

Cryptography and Security · Computer Science 2026-05-14 Zvi Topol

Large language models (LLMs) possess strong semantic understanding, driving significant progress in data mining applications. This is further enhanced by large reasoning models (LRMs), which provide explicit multi-step reasoning traces. On…

Machine Learning · Computer Science 2026-04-07 Aobo Chen , Chenxu Zhao , Chenglin Miao , Mengdi Huai

Multimodal large reasoning models (MLRMs) are increasingly deployed for vision-language tasks that produce explicit intermediate rationales. However, reasoning traces can contain unsafe content even when the final answer is non-harmful,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Yuxiao Xiang , Junchi Chen , Zhenchao Jin , Changtao Miao , Haojie Yuan , Qi Chu , Tao Gong , Nenghai Yu

Large Reasoning Models (LRMs) have demonstrated impressive performance in reasoning-intensive tasks, but they remain vulnerable to harmful content generation, particularly in the mid-to-late steps of their reasoning processes. Current…

Computation and Language · Computer Science 2026-05-07 Yuquan Wang , Mi Zhang , Yining Wang , Geng Hong , Mi Wen , Xiaoyu You , Min Yang