中文
相关论文

相关论文: Harder Is Better: Boosting Mathematical Reasoning …

200 篇论文

RLVR has become a widely adopted paradigm for improving LLMs' reasoning capabilities, and GRPO is one of its most representative algorithms. In this paper, we first show that GRPO admits an equivalent discriminative reformulation as a…

机器学习 · 计算机科学 2026-05-19 Feng Zhang , Xinhong Ma , Ziqiang Dong , Xi Leng , Jianfei Zhao , Xin Sun , Yang Yang , Guanjun Jiang

Reinforcement Learning with Verifiable Rewards (RLVR) has catalyzed a leap in Large Language Model (LLM) reasoning, yet its optimization dynamics remain fragile. Standard algorithms like GRPO enforce stability via "hard clipping", which…

机器学习 · 计算机科学 2026-04-21 Xiaoliang Fu , Jiaye Lin , Yangyi Fang , Chaowen Hu , Cong Qin , Zekai Shao , Binbin Zheng , Lu Pan , Ke Zeng

Reinforcement learning from verifiable rewards has emerged as a powerful technique for enhancing the complex reasoning abilities of Large Language Models (LLMs). However, these methods are fundamentally constrained by the ''learning cliff''…

计算与语言 · 计算机科学 2026-03-03 Xichen Zhang , Sitong Wu , Yinghao Zhu , Haoru Tan , Shaozuo Yu , Ziyi He , Jiaya Jia

Reinforcement learning with verifiable rewards (RLVR) has significantly advanced the reasoning ability of vision-language models (VLMs). However, the inherent text-dominated nature of VLMs often leads to insufficient visual faithfulness,…

计算机视觉与模式识别 · 计算机科学 2026-05-25 Zengbin Wang , Feng Xiong , Liang Lin , Xuecai Hu , Yong Wang , Yanlin Wang , Man Zhang , Xiangxiang Chu

The effective training of Large Language Models (LLMs) for function calling faces a critical challenge: balancing exploration of complex reasoning paths with stable policy optimization. Standard methods like Supervised Fine-Tuning (SFT)…

Reinforcement Learning with Verifiable Rewards has recently advanced the capabilities of Large Language Models in complex reasoning tasks by providing explicit rule-based supervision. Among RLVR methods, GRPO and its variants have achieved…

机器学习 · 计算机科学 2026-03-11 Zepeng Zhai , Meilin Chen , Jiaxuan Zhao , Junlang Qian , Lei Shen , Yuan Lu

Reinforcement learning is emerging as a primary driver for improving language model reasoning capabilities. A fundamental question is whether current reinforcement learning algorithms -- such as Group Relative Policy Optimization (GRPO),…

机器学习 · 计算机科学 2025-06-23 Andre He , Daniel Fried , Sean Welleck

Reinforcement Learning with Verifiable Rewards (RLVR) has proven to be a highly effective strategy for endowing Large Language Models (LLMs) with robust multi-step reasoning abilities. However, its design and optimizations remain tailored…

Recent studies generally enhance MLLMs' reasoning capabilities via supervised fine-tuning on high-quality chain-of-thought reasoning data, which often leads models to merely imitate successful reasoning paths without understanding what the…

人工智能 · 计算机科学 2025-08-05 Jingyi Zhang , Jiaxing Huang , Huanjin Yao , Shunyu Liu , Xikun Zhang , Shijian Lu , Dacheng Tao

Reinforcement learning has been widely applied to enhance the reasoning capabilities of large language models. Extending the inference limits of smaller models has become a prominent research focus. However, algorithms such as Group…

人工智能 · 计算机科学 2025-10-10 Hao Wu , Wei Liu

Large-scale reinforcement learning with verifiable rewards (RLVR) has demonstrated its effectiveness in harnessing the potential of large language models (LLMs) for single-turn reasoning tasks. In realistic reasoning scenarios, LLMs can…

Large Language Models (LLMs) are increasingly aligned with human preferences through Reinforcement Learning from Human Feedback (RLHF). Among RLHF methods, Group Relative Policy Optimization (GRPO) has gained attention for its simplicity…

计算与语言 · 计算机科学 2025-09-25 Yuhang Zhou , Jing Zhu , Shengyi Qian , Zhuokai Zhao , Xiyao Wang , Xiaoyu Liu , Ming Li , Paiheng Xu , Wei Ai , Furong Huang

Reinforcement Learning with Verifiable Rewards (RLVR) has become the standard paradigm for LLM mathematical reasoning, with Group Relative Policy Optimization (GRPO) serving as the dominant algorithm. We identify two overlooked…

机器学习 · 计算机科学 2026-05-13 Mingxiong Lin , Zhangquan Gong , Maowen Tang , Qian Li , Chuangchuang Wang , Jian Ma , Sutian Huang , Kai Tang , Haonan Lu

Reinforcement Learning with Verifiable Rewards (RLVR) has become a central post-training paradigm for improving the reasoning capabilities of large language models. Yet existing methods share a common blind spot: they optimize policies…

机器学习 · 计算机科学 2026-04-29 Huaiyang Wang , Xiaojie Li , Deqing Wang , Haoyi Zhou , Zixuan Huang , Yaodong Yang , Jianxin Li , Yikun Ban

Recent studies have demonstrated that Reinforcement Learning (RL), notably Group Relative Policy Optimization (GRPO), can intrinsically elicit and enhance the reasoning capabilities of Vision-Language Models (VLMs). However, despite the…

计算机视觉与模式识别 · 计算机科学 2026-04-02 Xinyu Tian , Shu Zou , Zhaoyuan Yang , Mengqi He , Peter Tu , Jing Zhang

Recent advancements in Large Reasoning Models (LRMs), exemplified by DeepSeek-R1, have underscored the potential of scaling inference-time compute through Group Relative Policy Optimization (GRPO). However, GRPO frequently suffers from…

人工智能 · 计算机科学 2026-02-09 Yu Zhao , Fan Jiang , Tianle Liu , Bo Zeng , Yu Liu , Longyue Wang , Weihua Luo

The enhancement of reasoning capabilities in large language models (LLMs) has garnered significant attention, with supervised fine-tuning (SFT) and reinforcement learning emerging as dominant paradigms. While recent studies recognize the…

人工智能 · 计算机科学 2026-03-17 Zhijie Wang

Recent advances in large reasoning models have leveraged reinforcement learning with verifiable rewards (RLVR) to improve reasoning capabilities. However, scaling these methods typically requires extensive rollout computation and large…

机器学习 · 计算机科学 2025-09-03 Xinyu Tang , Zhenduo Zhang , Yurou Liu , Wayne Xin Zhao , Zujie Wen , Zhiqiang Zhang , Jun Zhou

State-of-the-art large multi-modal models (LMMs) face challenges when processing high-resolution images, as these inputs are converted into enormous visual tokens, many of which are irrelevant to the downstream task. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Xinyu Huang , Yuhao Dong , Weiwei Tian , Bo Li , Rui Feng , Ziwei Liu

Recent advances in reinforcement learning (RL) have significantly improved the complex reasoning capabilities of large language models (LLMs). Despite these successes, existing methods mainly focus on single-domain RL (e.g., mathematics)…

人工智能 · 计算机科学 2025-11-20 Baolong Bi , Shenghua Liu , Yiwei Wang , Siqian Tong , Lingrui Mei , Yuyao Ge , Yilong Xu , Jiafeng Guo , Xueqi Cheng