中文
相关论文

相关论文: In-Token Rationality Optimization: Towards Accurat…

200 篇论文

Outcome-reward reinforcement learning (RL) has proven effective at improving the reasoning capabilities of large language models (LLMs). However, standard RL assigns credit only at the level of the final answer, penalizing entire reasoning…

机器学习 · 计算机科学 2026-01-21 Matthew Y. R. Yang , Hao Bai , Ian Wu , Gene Yang , Amrith Setlur , Aviral Kumar

Large language models (LLMs) have recently demonstrated remarkable progress in reasoning capabilities through reinforcement learning with verifiable rewards (RLVR). By leveraging simple rule-based rewards, RL effectively incentivizes LLMs…

人工智能 · 计算机科学 2025-07-25 Shiye Lei , Zhihao Cheng , Kai Jia , Dacheng Tao

The central challenge of reinforcement learning for reasoning lies not only in the sparsity of outcome-level supervision, but more fundamentally in how to transform feedback provided only at the end of a sequence into fine-grained learning…

机器学习 · 计算机科学 2026-05-26 Fei Ding , Yongkang Zhang , Runhao Liu , Yuhao Liao , Zijian Zeng , Sibo wang , Huiming Yang

Large reasoning models (LRMs) have achieved impressive performance in complex tasks, often outperforming conventional large language models (LLMs). However, the prevalent issue of overthinking severely limits their computational efficiency.…

计算与语言 · 计算机科学 2025-05-29 Zhiyuan Li , Yi Chang , Yuan Wu

Modern large reasoning models (LRMs) exhibit impressive multi-step problem-solving via chain-of-thought (CoT) reasoning. However, this iterative thinking mechanism introduces a new vulnerability surface. We present the Deadlock Attack, a…

机器学习 · 计算机科学 2025-10-21 Mohan Zhang , Yihua Zhang , Jinghan Jia , Zhangyang Wang , Sijia Liu , Tianlong Chen

The complex reasoning ability of Large Language Models (LLMs) poses a critical bottleneck for their practical applications. Test-time expansion methods such as Tree-of-Thought (ToT) and Graph-of-Thought (GoT) enhance reasoning by…

计算与语言 · 计算机科学 2025-12-01 Yujiao Yang , Jing Lian , Linhui Li

Tool-integrated reasoning (TIR) augments large language models (LLMs) with the ability to invoke external tools during long-form reasoning, such as search engines and code interpreters, to solve tasks beyond the capabilities of internal…

人工智能 · 计算机科学 2025-06-03 Hongru Wang , Cheng Qian , Wanjun Zhong , Xiusi Chen , Jiahao Qiu , Shijue Huang , Bowen Jin , Mengdi Wang , Kam-Fai Wong , Heng Ji

Large language models (LLMs) have recently demonstrated remarkable success in mathematical reasoning. Despite progress in methods like chain-of-thought prompting and self-consistency sampling, these advances often focus on final correctness…

Large Language Models (LLMs) have demonstrated remarkable capabilities in complex tasks. Recent advancements in Large Reasoning Models (LRMs), such as OpenAI o1 and DeepSeek-R1, have further improved performance in System-2 reasoning…

Recent breakthroughs in large language models (LLMs) have led to notable successes in complex reasoning tasks, such as mathematical problem solving. A common strategy for improving performance is parallel thinking, in which multiple…

机器学习 · 计算机科学 2026-03-03 Zhan Zhuang , Xiequn Wang , Zebin Chen , Feiyang Ye , Ying Wei , Kede Ma , Yu Zhang

Large Reasoning Models (LRMs) achieve promising performance but compromise token efficiency due to verbose reasoning processes. Unconscious Thought Theory (UTT) posits that complex problems can be solved more efficiently through…

Fine-tuning LLMs for classification typically maps inputs directly to labels. We ask whether attaching brief explanations to each label during fine-tuning yields better models. We evaluate conversational response quality along three axes:…

机器学习 · 计算机科学 2026-03-03 Vivswan Shah , Randy Cogill , Hanwei Yue , Gopinath Chennupati , Rinat Khaziev

Recent advancements in Large Language Models (LLMs) have shifted from explicit Chain-of-Thought (CoT) reasoning to more efficient latent reasoning, where intermediate thoughts are represented as vectors rather than text. However, latent…

计算与语言 · 计算机科学 2026-01-27 Wengao Ye , Yan Liang , Lianlei Shan

Recently, large language models (LLMs) have demonstrated outstanding reasoning capabilities on mathematical and coding tasks. However, their application to financial tasks-especially the most fundamental task of stock movement…

计算与语言 · 计算机科学 2025-10-27 Xueyuan Lin , Cehao Yang , Ye Ma , Ming Li , Rongjunchen Zhang , Yang Ni , Xiaojun Wu , Chengjin Xu , Jian Guo , Hui Xiong

While large language models (LLMs) have shown strong performance in math and logic reasoning, their ability to handle combinatorial optimization (CO) -- searching high-dimensional solution spaces under hard constraints -- remains…

人工智能 · 计算机科学 2026-04-13 Xia Jiang , Jing Chen , Cong Zhang , Jie Gao , Chengpeng Hu , Chenhao Zhang , Yaoxin Wu , Yingqian Zhang

Large language models achieve breakthroughs in complex reasoning via long chain-of-thought sequences. However, this often leads to severe reasoning inflation, causing substantial computational redundancy. To maximize Intelligence per Token,…

计算与语言 · 计算机科学 2026-03-19 Tingcheng Bian , Jinchang Luo , Mingquan Cheng , Jinyu Zhang , Xiaoling Xia , Ni Li , Yan Tao , Haiwei Wang

The recent rise of Large Reasoning Models (LRMs) has significantly improved multi-step reasoning performance, but often at the cost of generating excessively long reasoning chains. This paper revisits the efficiency of such reasoning…

计算与语言 · 计算机科学 2025-05-27 Xixian Yong , Xiao Zhou , Yingying Zhang , Jinlin Li , Yefeng Zheng , Xian Wu

Recommender systems are tasked to infer users' evolving preferences and rank items aligned with their intents, which calls for in-depth reasoning beyond pattern-based scoring. Recent efforts start to leverage large language models (LLMs)…

信息检索 · 计算机科学 2026-02-16 Kehan Zheng , Deyao Hong , Qian Li , Jun Zhang , Huan Yu , Jie Jiang , Hongning Wang

Current large language models (LLMs), even those explicitly trained for reasoning, often struggle with ambiguous content moderation cases due to misleading "decision shortcuts" embedded in context. Inspired by cognitive psychology insights…

人工智能 · 计算机科学 2026-04-14 Bingzhe Wu , Haotian Lu , Yuchen Mou

While Chain-of-Thought (CoT) prompting improves reasoning in large language models (LLMs), the excessive length of reasoning tokens increases latency and KV cache memory usage, and may even truncate final answers under context limits. We…

计算与语言 · 计算机科学 2025-05-26 Gengyang Li , Yifeng Gao , Yuming Li , Yunfang Wu