English
Related papers

Related papers: How Does the Thinking Step Influence Model Safety?…

200 papers

Jailbreak attacks pose a serious threat to the safety of Large Language Models (LLMs) by crafting adversarial prompts that bypass alignment mechanisms, causing the models to produce harmful, restricted, or biased content. In this paper, we…

Machine Learning · Computer Science 2025-08-22 Xiangman Li , Xiaodong Wu , Qi Li , Jianbing Ni , Rongxing Lu

Large language models (LLMs) have gained widespread recognition for their superior comprehension and have been deployed across numerous domains. Building on Chain-of-Thought (CoT) ideology, Large Reasoning models (LRMs) further exhibit…

Computers and Society · Computer Science 2025-09-03 Shiji Zhao , Ranjie Duan , Jiexi Liu , Xiaojun Jia , Fengxiang Wang , Cheng Wei , Ruoxi Cheng , Yong Xie , Chang Liu , Qing Guo , Jialing Tao , Hui Xue , Xingxing Wei

Reinforcement learning with verifiable rewards (RLVR) has demonstrated superior performance in enhancing the reasoning capability of large language models (LLMs). However, this accuracy-oriented learning paradigm often suffers from entropy…

Artificial Intelligence · Computer Science 2026-01-19 Hongye Cao , Zhixin Bai , Ziyue Peng , Boyan Wang , Tianpei Yang , Jing Huo , Yuyao Zhang , Yang Gao

Most flagship language models generate explicit reasoning chains, enabling inference-time scaling. However, producing these reasoning chains increases token usage (i.e., reasoning tokens), which in turn increases latency and costs. Our…

Machine Learning · Computer Science 2026-02-05 Abhinav Kumar , Jaechul Roh , Ali Naseh , Marzena Karpinska , Mohit Iyyer , Amir Houmansadr , Eugene Bagdasarian

Large reasoning models (LRMs) increasingly expose chain-of-thought-like reasoning for transparency, verification, and deliberate problem solving. This creates a safety blind spot: harmful or policy-violating content may appear in reasoning…

Artificial Intelligence · Computer Science 2026-05-08 Xiaomin Li , Jianheng Hou , Zheyuan Deng , Zhiwei Zhang , Taoran Li , Binghang Lu , Bing Hu , Yunhan Zhao , Yuexing Hao

Large Reasoning Models (LRMs) leverage transparent reasoning traces, known as Chain-of-Thoughts (CoTs), to break down complex problems into intermediate steps and derive final answers. However, these reasoning traces introduce unique safety…

Computation and Language · Computer Science 2025-10-16 Changyi Li , Jiayi Wang , Xudong Pan , Geng Hong , Min Yang

Large Reasoning Models (LRMs) significantly improve the reasoning ability of Large Language Models (LLMs) by learning to reason, exhibiting promising performance in solving complex tasks. However, their deliberative reasoning process leads…

Computation and Language · Computer Science 2025-08-14 Yue Liu , Jiaying Wu , Yufei He , Ruihan Gong , Jun Xia , Liang Li , Hongcheng Gao , Hongyu Chen , Baolong Bi , Jiaheng Zhang , Zhiqi Huang , Bryan Hooi , Stan Z. Li , Keqin Li

Emerging Large Reasoning Models (LRMs) consistently excel in mathematical and reasoning tasks, showcasing remarkable capabilities. However, the enhancement of reasoning abilities and the exposure of internal reasoning processes introduce…

Cryptography and Security · Computer Science 2025-10-24 Jingyuan Ma , Rui Li , Zheng Li , Junfeng Liu , Heming Xia , Lei Sha , Zhifang Sui

Large Reasoning Models (LRMs) have emerged as a powerful advancement in multi-step reasoning tasks, offering enhanced transparency and logical consistency through explicit chains of thought (CoT). However, these models introduce novel…

Cryptography and Security · Computer Science 2026-04-15 Jiawei Chen , Yang Yang , Chao Yu , Yu Tian , Zhi Cao , Xue Yang , Linghao Li , Hang Su , Zhaoxia Yin

The increasing sophistication of large vision-language models (LVLMs) has been accompanied by advances in safety alignment mechanisms designed to prevent harmful content generation. However, these defenses remain vulnerable to sophisticated…

Cryptography and Security · Computer Science 2026-04-09 Quanchen Zou , Zonghao Ying , Moyang Chen , Wenzhuo Xu , Yisong Xiao , Yakai Li , Deyue Zhang , Dongdong Yang , Zhao Liu , Xiangzheng Zhang

The rapid advancement of large language models (LLMs) has driven their adoption across diverse domains, yet their ability to generate harmful content poses significant safety challenges. While extensive research has focused on mitigating…

Artificial Intelligence · Computer Science 2025-08-29 Yuanzhe Shen , Zisu Huang , Zhengkang Guo , Yide Liu , Guanxu Chen , Ruicheng Yin , Xiaoqing Zheng , Xuanjing Huang

Large Language Models (LLMs) have emerged as powerful tools, but their inherent safety risks - ranging from harmful content generation to broader societal harms - pose significant challenges. These risks can be amplified by the recent…

Large Reasoning Models (LRMs) achieve explicit chain-of-thought expansion by imitating deep thinking behaviors of humans, demonstrating excellent performance in complex task scenarios. However, the deep-thinking mode often leads to…

Machine Learning · Computer Science 2026-01-30 Qian Wan , Ziao Xu , Luona Wei , Xiaoxuan Shen , Jianwen Sun

Large language models (LLMs) have achieved impressive performance across natural language tasks and are increasingly deployed in real-world applications. Despite extensive safety alignment efforts, recent studies show that such alignment is…

Artificial Intelligence · Computer Science 2026-02-02 Yinzhi Zhao , Ming Wang , Shi Feng , Xiaocui Yang , Daling Wang , Yifei Zhang

Large language models (LLMs) have demonstrated impressive performance and have come to dominate the field of natural language processing (NLP) across various tasks. However, due to their strong instruction-following capabilities and…

Cryptography and Security · Computer Science 2026-04-10 Yulin Chen , Haoran Li , Yuan Sui , Yue Liu , Yufei He , Xiaoling Bai , Chi Fei , Yabo Li , Haozhe Ma , Yangqiu Song , Bryan Hooi

While recent success of large reasoning models (LRMs) significantly advanced LLMs' reasoning capability by optimizing the final answer accuracy using reinforcement learning, they may also drastically increase the output length due to…

Artificial Intelligence · Computer Science 2025-05-29 Sohyun An , Ruochen Wang , Tianyi Zhou , Cho-Jui Hsieh

Decoding strategies play a central role in shaping the reasoning ability of large language models (LLMs). Traditional methods such as greedy decoding and beam search often suffer from error propagation, while sampling-based approaches…

Backdoor attacks pose a serious threat to the security of large language models (LLMs), causing them to exhibit anomalous behavior under specific trigger conditions. The design of backdoor triggers has evolved from fixed triggers to dynamic…

Cryptography and Security · Computer Science 2026-04-15 Haotian Jin , Yang Li , Haihui Fan , Lin Shen , Xiangfang Li , Bo Li

Security questions are one of the mechanisms used to recover passwords. Strong answers to security questions (i.e. high entropy) are hard for attackers to guess or obtain using social engineering techniques (e.g. monitoring of social…

Cryptography and Security · Computer Science 2017-09-26 Nicholas Micallef , Nalin Asanka Gamagedara Arachchilage

Large Language Models (LLMs) have demonstrated strong reasoning capabilities, but their safety under adversarial conditions remains a challenge. This study examines the impact of output length on the robustness of DeepSeek-R1, particularly…

Computation and Language · Computer Science 2025-03-05 Xuying Li , Zhuo Li , Yuji Kosuga , Victor Bian