中文
相关论文

相关论文: Towards Safe Reasoning in Large Reasoning Models v…

200 篇论文

Multimodal Large Reasoning Models (MLRMs) demonstrate impressive cross-modal reasoning but often amplify safety risks under adversarial or unsafe prompts, a phenomenon we call the \textit{Reasoning Tax}. Existing defenses mainly act at the…

机器学习 · 计算机科学 2025-10-10 Huahui Yi , Kun Wang , Qiankun Li , Miao Yu , Liang Lin , Gongli Xi , Hao Wu , Xuming Hu , Kang Li , Yang Liu

Large language models (LLMs) have recently demonstrated remarkable progress in reasoning capabilities through reinforcement learning with verifiable rewards (RLVR). By leveraging simple rule-based rewards, RL effectively incentivizes LLMs…

人工智能 · 计算机科学 2025-07-25 Shiye Lei , Zhihao Cheng , Kai Jia , Dacheng Tao

Large Reasoning Models (LRMs) significantly improve the reasoning ability of Large Language Models (LLMs) by learning to reason, exhibiting promising performance in solving complex tasks. However, their deliberative reasoning process leads…

Reasoning in Large Language Models (LLMs) often suffers from inefficient long chain-of-thought traces with redundant self-exploration and validation, which inflate computational costs and even degrade performance. Inspired by human…

人工智能 · 计算机科学 2026-02-17 Qianyue Wang , Jinwu Hu , Huanxiang Lin , Bolin Chen , Zhiquan Wen , Yaofo Chen , Yu Rong , Mingkui Tan

Large language models (LLMs) have demonstrated remarkable capabilities in complex reasoning and text generation. However, these models can inadvertently generate unsafe or biased responses when prompted with problematic inputs, raising…

Reasoning-enhanced large language models (RLLMs), whether explicitly trained for reasoning or prompted via chain-of-thought (CoT), have achieved state-of-the-art performance on many complex reasoning tasks. However, we uncover a surprising…

计算与语言 · 计算机科学 2025-09-03 Xiaomin Li , Zhou Yu , Zhiwei Zhang , Xupeng Chen , Ziji Zhang , Yingying Zhuang , Narayanan Sadagopan , Anurag Beniwal

Large Reasoning Models (LRMs) leverage Chain-of-Thought (CoT) reasoning to solve complex tasks, but this explicit reasoning process introduces a critical vulnerability: adversarial manipulation of the thought chain itself, known as…

机器学习 · 计算机科学 2026-02-13 Zihao Xue , Zhen Bi , Long Ma , Zhenlin Hu , Yan Wang , Xueshu Chen , Zhenfang Liu , Kang Zhao , Jie Xiao , Jungang Lou

Large Reasoning Models (LRMs) have emerged as a powerful advancement in multi-step reasoning tasks, offering enhanced transparency and logical consistency through explicit chains of thought (CoT). However, these models introduce novel…

密码学与安全 · 计算机科学 2026-04-15 Jiawei Chen , Yang Yang , Chao Yu , Yu Tian , Zhi Cao , Xue Yang , Linghao Li , Hang Su , Zhaoxia Yin

Large Language Models (LLMs) have shown remarkable progress across domains, yet their ability to perform inductive reasoning - inferring latent rules from sparse examples - remains limited. It is often assumed that chain-of-thought (CoT)…

计算机视觉与模式识别 · 计算机科学 2025-06-02 Haibo Jin , Peiyan Zhang , Man Luo , Haohan Wang

Safety alignment is an important procedure before the official deployment of a Large Language Model (LLM). While safety alignment has been extensively studied for LLM, there is still a large research gap for Large Reasoning Models (LRMs)…

密码学与安全 · 计算机科学 2025-06-06 Tiansheng Huang , Sihao Hu , Fatih Ilhan , Selim Furkan Tekin , Zachary Yahn , Yichang Xu , Ling Liu

Recent advances in large reasoning models (LRMs) have enabled remarkable performance on complex tasks such as mathematics and coding by generating long Chain-of-Thought (CoT) traces. In this paper, we identify and systematically analyze a…

人工智能 · 计算机科学 2025-10-21 Zhehao Zhang , Weijie Xu , Shixian Cui , Chandan K. Reddy

Recent studies on the safety alignment of large language models (LLMs) have revealed that existing approaches often operate superficially, leaving models vulnerable to various adversarial attacks. Despite their significance, these studies…

密码学与安全 · 计算机科学 2025-06-02 Jianwei Li , Jung-Eun Kim

Large Language Models (LLMs) have demonstrated impressive reasoning capabilities in complex problem-solving tasks, sparking growing interest in their application to preference reasoning in recommendation systems. Existing methods typically…

人工智能 · 计算机科学 2025-10-27 Yang Zhang , Wenxin Xu , Xiaoyan Zhao , Wenjie Wang , Fuli Feng , Xiangnan He , Tat-Seng Chua

The ability of large language models (LLMs) to follow user instructions is central to their reliability, safety, and usefulness. While prior studies assess instruction adherence in the model's main responses, we argue that it is also…

机器学习 · 计算机科学 2025-10-20 Yongchan Kwon , Shang Zhu , Federico Bianchi , Kaitlyn Zhou , James Zou

The proliferation of Large Language Models (LLMs) has demonstrated remarkable capabilities, elevating the critical importance of LLM safety. However, existing safety methods rely on ad-hoc taxonomy and lack a rigorous, systematic…

计算与语言 · 计算机科学 2025-09-29 Wenbin Hu , Huihao Jing , Haochen Shi , Haoran Li , Yangqiu Song

Large Reasoning Models (LRMs) solve complex tasks by generating long Chain-of-Thought (CoT) sequences; however, the emergent dynamics governing reasoning trajectories are not well understood and can lead to inconsistencies and reasoning…

人工智能 · 计算机科学 2026-05-29 G M Shahariar , Erfan Shayegani , Ali Nazari , Nael Abu-Ghazaleh

The rise of Large Language Models (LLMs) has driven progress in reasoning tasks -- from program synthesis to scientific hypothesis generation -- yet their ability to handle ranked preferences and structured algorithms in combinatorial…

人工智能 · 计算机科学 2025-12-09 Hadi Hosseini , Samarth Khanna , Ronak Singh

Large Reasoning Models (LRMs) achieve strong performance on complex tasks through extended chains of thought but suffer from high inference latency due to autoregressive reasoning. Recent work explores using Small Reasoning Models (SRMs) to…

人工智能 · 计算机科学 2026-04-17 Yi Zhao , Yajuan Peng , Cam-Tu Nguyen , Zuchao Li , Xiaoliang Wang , Xiaoming Fu , Hai Zhao

Large Reasoning Models (LRMs) have demonstrated remarkable capabilities in reasoning and generation tasks and are increasingly deployed in real-world applications. However, their explicit chain-of-thought (CoT) mechanism introduces new…

人工智能 · 计算机科学 2026-05-26 Jianan Li , Simeng Qin , Xiaojun Jia , Lionel Z. Wang , Tianhang Zheng , Xiaoshuang Jia , Yang Liu , Xiaochun Cao

Large Reasoning Models (LRMs) have demonstrated strong capabilities in complex multi-step reasoning, opening new opportunities for automating optimization modeling. However, existing domain adaptation methods, originally designed for…