English
Related papers

Related papers: Towards Safe Reasoning in Large Reasoning Models v…

200 papers

Multimodal Large Reasoning Models (MLRMs) demonstrate impressive cross-modal reasoning but often amplify safety risks under adversarial or unsafe prompts, a phenomenon we call the \textit{Reasoning Tax}. Existing defenses mainly act at the…

Machine Learning · Computer Science 2025-10-10 Huahui Yi , Kun Wang , Qiankun Li , Miao Yu , Liang Lin , Gongli Xi , Hao Wu , Xuming Hu , Kang Li , Yang Liu

Large language models (LLMs) have recently demonstrated remarkable progress in reasoning capabilities through reinforcement learning with verifiable rewards (RLVR). By leveraging simple rule-based rewards, RL effectively incentivizes LLMs…

Artificial Intelligence · Computer Science 2025-07-25 Shiye Lei , Zhihao Cheng , Kai Jia , Dacheng Tao

Large Reasoning Models (LRMs) significantly improve the reasoning ability of Large Language Models (LLMs) by learning to reason, exhibiting promising performance in solving complex tasks. However, their deliberative reasoning process leads…

Computation and Language · Computer Science 2025-08-14 Yue Liu , Jiaying Wu , Yufei He , Ruihan Gong , Jun Xia , Liang Li , Hongcheng Gao , Hongyu Chen , Baolong Bi , Jiaheng Zhang , Zhiqi Huang , Bryan Hooi , Stan Z. Li , Keqin Li

Reasoning in Large Language Models (LLMs) often suffers from inefficient long chain-of-thought traces with redundant self-exploration and validation, which inflate computational costs and even degrade performance. Inspired by human…

Artificial Intelligence · Computer Science 2026-02-17 Qianyue Wang , Jinwu Hu , Huanxiang Lin , Bolin Chen , Zhiquan Wen , Yaofo Chen , Yu Rong , Mingkui Tan

Large language models (LLMs) have demonstrated remarkable capabilities in complex reasoning and text generation. However, these models can inadvertently generate unsafe or biased responses when prompted with problematic inputs, raising…

Computation and Language · Computer Science 2024-12-03 Avinash Amballa , Durga Sandeep Saluru , Gayathri Akkinapalli , Abhishek Sureddy , Akshay Kumar Sureddy

Reasoning-enhanced large language models (RLLMs), whether explicitly trained for reasoning or prompted via chain-of-thought (CoT), have achieved state-of-the-art performance on many complex reasoning tasks. However, we uncover a surprising…

Computation and Language · Computer Science 2025-09-03 Xiaomin Li , Zhou Yu , Zhiwei Zhang , Xupeng Chen , Ziji Zhang , Yingying Zhuang , Narayanan Sadagopan , Anurag Beniwal

Large Reasoning Models (LRMs) leverage Chain-of-Thought (CoT) reasoning to solve complex tasks, but this explicit reasoning process introduces a critical vulnerability: adversarial manipulation of the thought chain itself, known as…

Machine Learning · Computer Science 2026-02-13 Zihao Xue , Zhen Bi , Long Ma , Zhenlin Hu , Yan Wang , Xueshu Chen , Zhenfang Liu , Kang Zhao , Jie Xiao , Jungang Lou

Large Reasoning Models (LRMs) have emerged as a powerful advancement in multi-step reasoning tasks, offering enhanced transparency and logical consistency through explicit chains of thought (CoT). However, these models introduce novel…

Cryptography and Security · Computer Science 2026-04-15 Jiawei Chen , Yang Yang , Chao Yu , Yu Tian , Zhi Cao , Xue Yang , Linghao Li , Hang Su , Zhaoxia Yin

Large Language Models (LLMs) have shown remarkable progress across domains, yet their ability to perform inductive reasoning - inferring latent rules from sparse examples - remains limited. It is often assumed that chain-of-thought (CoT)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Haibo Jin , Peiyan Zhang , Man Luo , Haohan Wang

Safety alignment is an important procedure before the official deployment of a Large Language Model (LLM). While safety alignment has been extensively studied for LLM, there is still a large research gap for Large Reasoning Models (LRMs)…

Cryptography and Security · Computer Science 2025-06-06 Tiansheng Huang , Sihao Hu , Fatih Ilhan , Selim Furkan Tekin , Zachary Yahn , Yichang Xu , Ling Liu

Recent advances in large reasoning models (LRMs) have enabled remarkable performance on complex tasks such as mathematics and coding by generating long Chain-of-Thought (CoT) traces. In this paper, we identify and systematically analyze a…

Artificial Intelligence · Computer Science 2025-10-21 Zhehao Zhang , Weijie Xu , Shixian Cui , Chandan K. Reddy

Recent studies on the safety alignment of large language models (LLMs) have revealed that existing approaches often operate superficially, leaving models vulnerable to various adversarial attacks. Despite their significance, these studies…

Cryptography and Security · Computer Science 2025-06-02 Jianwei Li , Jung-Eun Kim

Large Language Models (LLMs) have demonstrated impressive reasoning capabilities in complex problem-solving tasks, sparking growing interest in their application to preference reasoning in recommendation systems. Existing methods typically…

Artificial Intelligence · Computer Science 2025-10-27 Yang Zhang , Wenxin Xu , Xiaoyan Zhao , Wenjie Wang , Fuli Feng , Xiangnan He , Tat-Seng Chua

The ability of large language models (LLMs) to follow user instructions is central to their reliability, safety, and usefulness. While prior studies assess instruction adherence in the model's main responses, we argue that it is also…

Machine Learning · Computer Science 2025-10-20 Yongchan Kwon , Shang Zhu , Federico Bianchi , Kaitlyn Zhou , James Zou

The proliferation of Large Language Models (LLMs) has demonstrated remarkable capabilities, elevating the critical importance of LLM safety. However, existing safety methods rely on ad-hoc taxonomy and lack a rigorous, systematic…

Computation and Language · Computer Science 2025-09-29 Wenbin Hu , Huihao Jing , Haochen Shi , Haoran Li , Yangqiu Song

Large Reasoning Models (LRMs) solve complex tasks by generating long Chain-of-Thought (CoT) sequences; however, the emergent dynamics governing reasoning trajectories are not well understood and can lead to inconsistencies and reasoning…

Artificial Intelligence · Computer Science 2026-05-29 G M Shahariar , Erfan Shayegani , Ali Nazari , Nael Abu-Ghazaleh

The rise of Large Language Models (LLMs) has driven progress in reasoning tasks -- from program synthesis to scientific hypothesis generation -- yet their ability to handle ranked preferences and structured algorithms in combinatorial…

Artificial Intelligence · Computer Science 2025-12-09 Hadi Hosseini , Samarth Khanna , Ronak Singh

Large Reasoning Models (LRMs) achieve strong performance on complex tasks through extended chains of thought but suffer from high inference latency due to autoregressive reasoning. Recent work explores using Small Reasoning Models (SRMs) to…

Artificial Intelligence · Computer Science 2026-04-17 Yi Zhao , Yajuan Peng , Cam-Tu Nguyen , Zuchao Li , Xiaoliang Wang , Xiaoming Fu , Hai Zhao

Large Reasoning Models (LRMs) have demonstrated remarkable capabilities in reasoning and generation tasks and are increasingly deployed in real-world applications. However, their explicit chain-of-thought (CoT) mechanism introduces new…

Artificial Intelligence · Computer Science 2026-05-26 Jianan Li , Simeng Qin , Xiaojun Jia , Lionel Z. Wang , Tianhang Zheng , Xiaoshuang Jia , Yang Liu , Xiaochun Cao

Large Reasoning Models (LRMs) have demonstrated strong capabilities in complex multi-step reasoning, opening new opportunities for automating optimization modeling. However, existing domain adaptation methods, originally designed for…

Computation and Language · Computer Science 2025-10-07 Zhengyang Tang , Zihan Ye , Chenyu Huang , Xuhan Huang , Chengpeng Li , Sihang Li , Guanhua Chen , Ming Yan , Zizhuo Wang , Hongyuan Zha , Dayiheng Liu , Benyou Wang