English
Related papers

Related papers: Self-Guard: Defending Large Reasoning Models via e…

200 papers

Large Reasoning Models (LRMs) have demonstrated impressive performance in reasoning-intensive tasks, but they remain vulnerable to harmful content generation, particularly in the mid-to-late steps of their reasoning processes. Current…

Computation and Language · Computer Science 2026-05-07 Yuquan Wang , Mi Zhang , Yining Wang , Geng Hong , Mi Wen , Xiaoyu You , Min Yang

The jailbreak attack can bypass the safety measures of a Large Language Model (LLM), generating harmful content. This misuse of LLM has led to negative societal consequences. Currently, there are two main approaches to address jailbreak…

Computation and Language · Computer Science 2024-03-25 Zezhong Wang , Fangkai Yang , Lu Wang , Pu Zhao , Hongru Wang , Liang Chen , Qingwei Lin , Kam-Fai Wong

Large language model (LLM) safety classifiers such as Llama Guard are effective at detecting overtly harmful prompts but remain vulnerable to adversarial jailbreak attacks that disguise malicious intent through role-play scenarios,…

Cryptography and Security · Computer Science 2026-05-26 Lixing Lin , Juli You , Yue Li , Luyun Lin , Yiqing Wang , Zhen Zhang , Moxuan Zheng

Large Language Models (LLMs) continue to exhibit vulnerabilities despite deliberate safety alignment efforts, posing significant risks to users and society. To safeguard against the risk of policy-violating content, system-level moderation…

Artificial Intelligence · Computer Science 2025-10-27 Jingnan Zheng , Xiangtian Ji , Yijun Lu , Chenhang Cui , Weixiang Zhao , Gelei Deng , Zhenkai Liang , An Zhang , Tat-Seng Chua

The safety of large language models (LLMs) has increasingly emerged as a fundamental aspect of their development. Existing safety alignment for LLMs is predominantly achieved through post-training methods, which are computationally…

Artificial Intelligence · Computer Science 2026-02-03 Sicheng Shen , Mingyang Lv , Han Shen , Jialin Wu , Binghao Wang , Zhou Yang , Guobin Shen , Dongcheng Zhao , Feifei Zhao , Yi Zeng

While Multimodal Large Language Models (MLLMs) have made remarkable progress in vision-language reasoning, they are also more susceptible to producing harmful content compared to models that focus solely on text. Existing defensive…

Computation and Language · Computer Science 2024-12-30 Yilei Jiang , Yingshui Tan , Xiangyu Yue

Maintaining the safety of large language models (LLMs) is crucial as they are increasingly deployed in real-world applications. Existing safety guardrails typically rely on single-pass classification or, more recently, distilled reasoning.…

Artificial Intelligence · Computer Science 2026-05-29 Siddharth Sai , Xiaofei Wen , Muhao Chen

Large reasoning models (LRMs) "think" by generating structured chain-of-thought (CoT) before producing a final answer, yet they still lack the ability to reason critically about safety alignment and are easily biased when a flawed premise…

Large Reasoning Models possess remarkable capabilities for self-correction in general domain; however, they frequently struggle to recover from unsafe reasoning trajectories under adversarial attacks. Existing alignment methods attempt to…

Artificial Intelligence · Computer Science 2026-05-12 Dongcheng Zhang , Yi Zhang , Yuxin Chen , An Zhang , Xiang Wang , Chaochao Lu

Large Reasoning Models (LRMs) achieve remarkable success through explicit thinking steps, yet the thinking steps introduce a novel risk by potentially amplifying unsafe behaviors. Despite this vulnerability, conventional defense mechanisms…

Artificial Intelligence · Computer Science 2026-01-08 Su-Hyeon Kim , Hyundong Jin , Yejin Lee , Yo-Sub Han

Large reasoning models (LRMs) extend large language models by generating explicit chain-of-thought (CoT) reasoning, significantly improving mathematical and logical problem solving. However, this explicit reasoning process also introduces…

Computation and Language · Computer Science 2025-12-02 Jinghan Jia , Nathalie Baracaldo , Sijia Liu

Large Reasoning Models (LRMs) have recently demonstrated impressive performances across diverse domains. However, how the safety of Large Language Models (LLMs) benefits from enhanced reasoning capabilities against jailbreak queries remains…

Computation and Language · Computer Science 2025-09-23 Junda Zhu , Lingyong Yan , Shuaiqiang Wang , Dawei Yin , Lei Sha

Large reasoning models (LRMs) achieved remarkable performance via chain-of-thought (CoT), but recent studies showed that such enhanced reasoning capabilities are at the expense of significantly degraded safety capabilities. In this paper,…

Artificial Intelligence · Computer Science 2026-05-05 Jianan Chen , Zhifang Zhang , Shuo He , Linan Yue , Lei Feng , Minling Zhang

Large Reasoning Models (LRMs) have significantly improved problem-solving through explicit Chain-of-Thought (CoT) reasoning. However, this capability creates a Safety-Helpfulness Paradox: the reasoning process itself can be misused to…

Artificial Intelligence · Computer Science 2026-01-27 Xin Gao , Shaohan Yu , Zerui Chen , Yueming Lyu , Weichen Yu , Guanghao Li , Jiyao Liu , Jianxiong Gao , Jian Liang , Ziwei Liu , Chenyang Si

The rapid advancement of multi-modal large reasoning models (MLRMs) -- enhanced versions of multimodal language models (MLLMs) equipped with reasoning capabilities -- has revolutionized diverse applications. However, their safety…

Machine Learning · Computer Science 2025-04-15 Junfeng Fang , Yukai Wang , Ruipeng Wang , Zijun Yao , Kun Wang , An Zhang , Xiang Wang , Tat-Seng Chua

Recent advancements in large language models (LLMs) have accelerated progress toward artificial general intelligence, yet their potential to generate harmful content poses critical safety challenges. Existing alignment methods often…

Computation and Language · Computer Science 2025-10-08 Kehua Feng , Keyan Ding , Yuhao Wang , Menghan Li , Fanjunduo Wei , Xinda Wang , Qiang Zhang , Huajun Chen

Large Reasoning Models (LRMs) have become powerful tools for complex problem solving, but their structured reasoning pathways can lead to unsafe outputs when exposed to harmful prompts. Existing safety alignment methods reduce harmful…

Artificial Intelligence · Computer Science 2025-10-24 Wonje Jeung , Sangyeon Yoon , Minsuk Kahng , Albert No

With the widespread application of Large Language Models (LLMs), their associated security issues have become increasingly prominent, severely constraining their trustworthy deployment in critical domains. This paper proposes a novel safety…

Artificial Intelligence · Computer Science 2025-11-18 Qi Li , Jianjun Xu , Pingtao Wei , Jiu Li , Peiqiang Zhao , Jiwei Shi , Xuan Zhang , Yanhui Yang , Xiaodong Hui , Peng Xu , Wenqin Shao

Multimodal large language models (MLLMs) have demonstrated impressive reasoning and instruction-following capabilities, yet their expanded modality space introduces new compositional safety risks that emerge from complex text-image…

Cryptography and Security · Computer Science 2025-11-18 Xuankun Rong , Wenke Huang , Tingfeng Wang , Daiguo Zhou , Bo Du , Mang Ye

Large Reasoning Models (LRMs) achieve strong performance on complex multi-step reasoning, yet they still exhibit severe safety failures such as harmful content generation. Existing methods often apply coarse-grained constraints over the…

Artificial Intelligence · Computer Science 2026-04-27 Yingzhi Mao , Chunkang Zhang , Junxiang Wang , Xinyan Guan , Boxi Cao , Yaojie Lu , Hongyu Lin , Xianpei Han , Le Sun
‹ Prev 1 2 3 10 Next ›