English
Related papers

Related papers: Think in Safety: Unveiling and Mitigating Safety A…

200 papers

The rapid advancement of multi-modal large reasoning models (MLRMs) -- enhanced versions of multimodal language models (MLLMs) equipped with reasoning capabilities -- has revolutionized diverse applications. However, their safety…

Machine Learning · Computer Science 2025-04-15 Junfeng Fang , Yukai Wang , Ruipeng Wang , Zijun Yao , Kun Wang , An Zhang , Xiang Wang , Tat-Seng Chua

Large Reasoning Models (LRMs) have significantly improved problem-solving through explicit Chain-of-Thought (CoT) reasoning. However, this capability creates a Safety-Helpfulness Paradox: the reasoning process itself can be misused to…

Artificial Intelligence · Computer Science 2026-01-27 Xin Gao , Shaohan Yu , Zerui Chen , Yueming Lyu , Weichen Yu , Guanghao Li , Jiyao Liu , Jianxiong Gao , Jian Liang , Ziwei Liu , Chenyang Si

Large Reasoning Models (LRMs) have exhibited extraordinary prowess in tasks like mathematics and coding, leveraging their advanced reasoning capabilities. Nevertheless, as these capabilities progress, significant concerns regarding their…

Computation and Language · Computer Science 2025-05-27 Cheng Wang , Yue Liu , Baolong Bi , Duzhen Zhang , Zhong-Zhi Li , Yingwei Ma , Yufei He , Shengju Yu , Xinfeng Li , Junfeng Fang , Jiaheng Zhang , Bryan Hooi

Large Reasoning Models (LRMs) have achieved remarkable success on reasoning-intensive tasks such as mathematics and programming. However, their enhanced reasoning capabilities do not necessarily translate to improved safety performance-and…

Computation and Language · Computer Science 2026-04-21 Zhexin Zhang , Xian Qi Loye , Victor Shea-Jay Huang , Junxiao Yang , Qi Zhu , Shiyao Cui , Fei Mi , Lifeng Shang , Yingkang Wang , Hongning Wang , Minlie Huang

Multimodal Large Reasoning Models (MLRMs) demonstrate impressive cross-modal reasoning but often amplify safety risks under adversarial or unsafe prompts, a phenomenon we call the \textit{Reasoning Tax}. Existing defenses mainly act at the…

Machine Learning · Computer Science 2025-10-10 Huahui Yi , Kun Wang , Qiankun Li , Miao Yu , Liang Lin , Gongli Xi , Hao Wu , Xuming Hu , Kang Li , Yang Liu

Large reasoning models (LRMs) produce complex, multi-step reasoning traces, yet safety evaluation remains focused on final outputs, overlooking how harm emerges during reasoning. When jailbroken, harm does not appear instantaneously but…

Computation and Language · Computer Science 2026-04-22 Ishita Kakkar , Enze Zhang , Rheeya Uppaal , Junjie Hu

Large Language Models (LLMs) have demonstrated remarkable success across various NLP benchmarks. However, excelling in complex tasks that require nuanced reasoning and precise decision-making demands more than raw language proficiency--LLMs…

Computation and Language · Computer Science 2025-02-24 Ang Li , Yichuan Mo , Mingjie Li , Yifei Wang , Yisen Wang

The rapid development of large reasoning models (LRMs), such as OpenAI-o3 and DeepSeek-R1, has led to significant improvements in complex reasoning over non-reasoning large language models~(LLMs). However, their enhanced capabilities,…

Computers and Society · Computer Science 2025-11-18 Kaiwen Zhou , Chengzhi Liu , Xuandong Zhao , Shreedhar Jangam , Jayanth Srinivasa , Gaowen Liu , Dawn Song , Xin Eric Wang

Large language models (LLMs) have gained widespread recognition for their superior comprehension and have been deployed across numerous domains. Building on Chain-of-Thought (CoT) ideology, Large Reasoning models (LRMs) further exhibit…

Computers and Society · Computer Science 2025-09-03 Shiji Zhao , Ranjie Duan , Jiexi Liu , Xiaojun Jia , Fengxiang Wang , Cheng Wei , Ruoxi Cheng , Yong Xie , Chang Liu , Qing Guo , Jialing Tao , Hui Xue , Xingxing Wei

As multimodal reasoning improves the overall capabilities of Large Vision Language Models (LVLMs), recent studies have begun to explore safety-oriented reasoning, aiming to enhance safety awareness by analyzing potential safety risks during…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Fenghua Weng , Chaochao Lu , Xia Hu , Wenqi Shao , Wenjie Wang

As Multimodal Large Language Models (MLLMs) acquire stronger reasoning capabilities to handle complex, multi-image instructions, this advancement may pose new safety risks. We study this problem by introducing MIR-SafetyBench, the first…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Renmiao Chen , Yida Lu , Shiyao Cui , Xuan Ouyang , Victor Shea-Jay Huang , Shumin Zhang , Chengwei Pan , Han Qiu , Minlie Huang

Large Reasoning Models (LRMs) achieve strong performance on complex multi-step reasoning, yet they still exhibit severe safety failures such as harmful content generation. Existing methods often apply coarse-grained constraints over the…

Artificial Intelligence · Computer Science 2026-04-27 Yingzhi Mao , Chunkang Zhang , Junxiang Wang , Xinyan Guan , Boxi Cao , Yaojie Lu , Hongyu Lin , Xianpei Han , Le Sun

Large Reasoning Models (LRMs) have recently demonstrated impressive performances across diverse domains. However, how the safety of Large Language Models (LLMs) benefits from enhanced reasoning capabilities against jailbreak queries remains…

Computation and Language · Computer Science 2025-09-23 Junda Zhu , Lingyong Yan , Shuaiqiang Wang , Dawei Yin , Lei Sha

While explicit Chain-of-Thought (CoT) empowers large reasoning models (LRMs), it enables the generation of riskier final answers. Current alignment paradigms primarily rely on externally enforced compliance, optimizing models to detect…

Artificial Intelligence · Computer Science 2026-05-12 Yi Zhang , Yuxin Chen , Leheng Sheng , Dongcheng Zhang , Chaochao Lu , Xiang Wang , An Zhang

Vision-Language Models (VLMs) have achieved remarkable progress in multimodal reasoning tasks through enhanced chain-of-thought capabilities. However, this advancement also introduces novel safety risks, as these models become increasingly…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Yinan Xia , Yilei Jiang , Yingshui Tan , Xiaoyong Zhu , Xiangyu Yue , Bo Zheng

The security concerns surrounding Large Language Models (LLMs) have been extensively explored, yet the safety of Multimodal Large Language Models (MLLMs) remains understudied. In this paper, we observe that Multimodal Large Language Models…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Xin Liu , Yichen Zhu , Jindong Gu , Yunshi Lan , Chao Yang , Yu Qiao

Emerging large reasoning models (LRMs), such as DeepSeek-R1 models, leverage long chain-of-thought (CoT) reasoning to generate structured intermediate steps, enhancing their reasoning capabilities. However, long CoT does not inherently…

Artificial Intelligence · Computer Science 2025-02-18 Fengqing Jiang , Zhangchen Xu , Yuetai Li , Luyao Niu , Zhen Xiang , Bo Li , Bill Yuchen Lin , Radha Poovendran

Multimodal Large Language Models (MLLMs) are susceptible to the implicit reasoning risk, wherein innocuous unimodal inputs synergistically assemble into risky multimodal data that produce harmful outputs. We attribute this vulnerability to…

Artificial Intelligence · Computer Science 2025-09-17 Wei Cai , Shujuan Liu , Jian Zhao , Ziyan Shi , Yusheng Zhao , Yuchen Yuan , Tianle Zhang , Chi Zhang , Xuelong Li

Large Language Models (LLMs) have achieved impressive performance across diverse natural language processing tasks, but their growing power also amplifies potential risks such as jailbreak attacks that circumvent built-in safety mechanisms.…

Artificial Intelligence · Computer Science 2025-10-01 Qinjian Zhao , Jiaqi Wang , Zhiqiang Gao , Zhihao Dou , Belal Abuhaija , Kaizhu Huang

Large Language Models (LLMs) are vulnerable to jailbreak attacks that exploit weaknesses in traditional safety alignment, which often relies on rigid refusal heuristics or representation engineering to block harmful outputs. While they are…

Computation and Language · Computer Science 2025-10-01 Yuyou Zhang , Miao Li , William Han , Yihang Yao , Zhepeng Cen , Ding Zhao
‹ Prev 1 2 3 10 Next ›