中文
相关论文

相关论文: Breaking the Exploration Bottleneck: Rubric-Scaffo…

200 篇论文

Vision-language models (VLMs) have shown remarkable abilities by integrating large language models with visual inputs. However, they often fail to utilize visual evidence adequately, either depending on linguistic priors in vision-centric…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Xiaojun Guo , Runyu Zhou , Yifei Wang , Qi Zhang , Chenheng Zhang , Stefanie Jegelka , Xiaohan Wang , Jiajun Chai , Guojun Yin , Wei Lin , Yisen Wang

Learning tabula rasa, that is without any prior knowledge, is the prevalent workflow in reinforcement learning (RL) research. However, RL systems, when applied to large-scale settings, rarely operate tabula rasa. Such large-scale systems…

机器学习 · 计算机科学 2022-10-05 Rishabh Agarwal , Max Schwarzer , Pablo Samuel Castro , Aaron Courville , Marc G. Bellemare

Scaling test-time computation with reinforcement learning (RL) has emerged as a reliable path to improve large language models (LLM) reasoning ability. Yet, outcome-based reward often incentivizes models to be overconfident, leading to…

机器学习 · 计算机科学 2026-04-28 Liaoyaqi Wang , Chunsheng Zuo , William Jurayj , Benjamin Van Durme , Anqi Liu

Deep Reinforcement Learning (DRL) has achieved remarkable success in sequential decision-making tasks across diverse domains, yet its reliance on black-box neural architectures hinders interpretability, trust, and deployment in high-stakes…

机器学习 · 计算机科学 2025-02-12 Zelei Cheng , Jiahao Yu , Xinyu Xing

Recent progress in large language models (LLMs) has led to impressive performance on a range of tasks, yet advanced instruction following (IF)-especially for complex, multi-turn, and system-prompted instructions-remains a significant…

Large reasoning models (LRMs) exhibit unprecedented capabilities in solving complex problems through Chain-of-Thought (CoT) reasoning. However, recent studies reveal that their final answers often contradict their own reasoning traces. We…

人工智能 · 计算机科学 2026-03-03 Yuhui Wang , Changjiang Li , Guangke Chen , Jiacheng Liang , Ting Wang

Recent reinforcement learning (RL) techniques have yielded impressive reasoning improvements in language models, yet it remains unclear whether post-training truly extends a model's reasoning ability beyond what it acquires during…

计算与语言 · 计算机科学 2025-12-09 Charlie Zhang , Graham Neubig , Xiang Yue

Reinforcement Learning (RL) has proven highly effective at enhancing the complex reasoning abilities of Large Language Models (LLMs), yet underlying mechanisms driving this success remain largely opaque. Our analysis reveals that puzzling…

人工智能 · 计算机科学 2025-09-30 Haozhe Wang , Qixin Xu , Che Liu , Junhong Wu , Fangzhen Lin , Wenhu Chen

Reinforcement Learning (RL) has become a key approach for enhancing the reasoning capabilities of large language models. However, prevalent RL approaches like proximal policy optimization and group relative policy optimization suffer from…

机器学习 · 计算机科学 2026-02-02 Jingtong Gao , Ling Pan , Yejing Wang , Rui Zhong , Chi Lu , Maolin Wang , Qingpeng Cai , Peng Jiang , Xiangyu Zhao

The ongoing debate on whether reinforcement learning with verifiable rewards (RLVR) expands or shrinks the reasoning capabilities of large language models (LLMs) remains unresolved. Some studies contend that RLVR mainly improves sampling…

机器学习 · 计算机科学 2025-10-07 Xinhao Yao , Lu Yu , Xiaolin Hu , Fengwei Teng , Qing Cui , Jun Zhou , Yong Liu

Deep reinforcement learning (DRL) is playing an increasingly important role in real-world applications. However, obtaining an optimally performing DRL agent for complex tasks, especially with sparse rewards, remains a significant challenge.…

机器学习 · 计算机科学 2024-06-07 Zelei Cheng , Xian Wu , Jiahao Yu , Sabrina Yang , Gang Wang , Xinyu Xing

Large Language Model (LLM) agents have shown stunning results in complex tasks, yet they often operate in isolation, failing to learn from past experiences. Existing memory-based methods primarily store raw trajectories, which are often…

Inspired by the success of DeepSeek-R1, we explore the potential of rule-based reinforcement learning (RL) in large reasoning models. To analyze reasoning dynamics, we use synthetic logic puzzles as training data due to their controllable…

计算与语言 · 计算机科学 2025-02-21 Tian Xie , Zitian Gao , Qingnan Ren , Haoming Luo , Yuqian Hong , Bryan Dai , Joey Zhou , Kai Qiu , Zhirong Wu , Chong Luo

Reinforcement learning (RL) has emerged as a powerful paradigm for enhancing the reasoning capabilities of large language models (LLMs). While RL has demonstrated substantial performance gains, it still faces key challenges, including low…

机器学习 · 计算机科学 2025-11-18 Yihang Yao , Guangtao Zeng , Raina Wu , Yang Zhang , Ding Zhao , Zhang-Wei Hong , Chuang Gan

Inference-time scaling has attracted much attention which significantly enhance the performance of Large Language Models (LLMs) in complex reasoning tasks by increasing the length of Chain-of-Thought. These longer intermediate reasoning…

计算与语言 · 计算机科学 2025-05-21 Hongru Wang , Deng Cai , Wanjun Zhong , Shijue Huang , Jeff Z. Pan , Zeming Liu , Kam-Fai Wong

Reinforcement learning (RL) has been pivotal in enhancing the reasoning capabilities of large language models (LLMs), but it often suffers from limited exploration and entropy collapse, where models exploit a narrow set of solutions,…

机器学习 · 计算机科学 2025-10-20 Shijia Kang , Muhan Zhang

Reinforcement learning (RL) solves sequential decision-making problems via a trial-and-error process interacting with the environment. While RL achieves outstanding success in playing complex video games that allow huge trial-and-error,…

机器学习 · 计算机科学 2022-06-22 Fan-Ming Luo , Tian Xu , Hang Lai , Xiong-Hui Chen , Weinan Zhang , Yang Yu

Recent advances in large language models (LLMs) have highlighted the potential of reinforcement learning with verifiable rewards (RLVR) to enhance reasoning capabilities through extended output sequences. However, traditional RL frameworks…

计算与语言 · 计算机科学 2025-07-29 Dong Du , Shulin Liu , Tao Yang , Shaohua Chen , Yang Li

This paper introduces KunLunBaizeRAG, a reinforcement learning-driven reasoning framework designed to enhance the reasoning capabilities of large language models (LLMs) in complex multi-hop question-answering tasks. The framework addresses…

人工智能 · 计算机科学 2025-06-30 Cheng Li , Jiexiong Liu , Yixuan Chen , Qihang Zhou , KunLun Meta

The rapid emergence of diverse large language models (LLMs) has spurred the development of LLM routers that assign user queries to the most suitable model. However, existing LLM routers typically perform a single-round, one-to-one mapping…

计算与语言 · 计算机科学 2025-10-27 Haozhen Zhang , Tao Feng , Jiaxuan You