English
Related papers

Related papers: How Fast Should a Model Commit to Supervision? Tra…

200 papers

Large vision-language models (VLMs) increasingly adopt post-training techniques such as long chain-of-thought (CoT) supervised fine-tuning (SFT) and reinforcement learning (RL) to elicit sophisticated reasoning. While these methods exhibit…

Computation and Language · Computer Science 2025-07-11 Jierun Chen , Tiezheng Yu , Haoli Bai , Lewei Yao , Jiannan Wu , Kaican Li , Fei Mi , Chaofan Tao , Lei Zhu , Manyi Zhang , Xiaohui Li , Lu Hou , Lifeng Shang , Qun Liu

Process Reward Models (PRMs) provide step-level supervision that improves the reliability of reasoning in large language models. While PRMs have been extensively studied in text-based domains, their extension to Vision Language Models…

Artificial Intelligence · Computer Science 2025-10-08 Brandon Ong , Tej Deep Pala , Vernon Toh , William Chandra Tjhi , Soujanya Poria

The growing complexity of log data in modern software systems has prompted the use of Large Language Models (LLMs) for automated log analysis. Current approaches typically rely on direct supervised fine-tuning (SFT) on log-label pairs.…

Reinforcement Learning with Verifiable Rewards (RLVR) has become a central approach for improving the reasoning ability of large language models. Recent work studies RLVR through token entropy, arguing that high-entropy tokens drive…

Machine Learning · Computer Science 2025-12-02 Xinzhu Chen , Xuesheng Li , Zhongxiang Sun , Weijie Yu

Large Reasoning Models (LRMs) have introduced a new paradigm in AI by enabling models to ``think before responding" via chain-of-thought reasoning. However, the absence of open and reproducible recipes for building reasoning-centric medical…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Xiaoke Huang , Juncheng Wu , Hui Liu , Xianfeng Tang , Yuyin Zhou

Recent advances in reinforcement learning for large language models have converged on increasing complexity: multi-stage training pipelines, dynamic hyperparameter schedules, and curriculum learning strategies. This raises a fundamental…

Computation and Language · Computer Science 2025-12-19 Bingxiang He , Zekai Qu , Zeyuan Liu , Yinghao Chen , Yuxin Zuo , Cheng Qian , Kaiyan Zhang , Weize Chen , Chaojun Xiao , Ganqu Cui , Ning Ding , Zhiyuan Liu

Reinforcement learning from verifiable rewards (RLVR) has recently been extended from text-only LLMs to vision-language models (VLMs) to elicit long-chain multimodal reasoning. However, RLVR-trained VLMs still exhibit two persistent failure…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Hoang Anh Just , Yifei Fan , Handong Zhao , Jiuxiang Gu , Ruiyi Zhang , Simon Jenni , Kushal Kafle , Ruoxi Jia , Jing Shi

Self-improvement at scale has been a longstanding goal for reasoning models, and there are two natural places to do it: at test time, through verification-refinement (V-R) loops; and at training time, through self-training methods. Both are…

Machine Learning · Computer Science 2026-05-29 Chen Henry Wu , Aditi Raghunathan

Recent advances in large language model (LLM) reasoning have shown that sophisticated behaviors such as planning and self-reflection can emerge through reinforcement learning (RL). However, despite these successes, RL in its current form…

Artificial Intelligence · Computer Science 2026-03-12 Lu Ma , Hao Liang , Meiyi Qiang , Lexiang Tang , Xiaochen Ma , Zhen Hao Wong , Junbo Niu , Chengyu Shen , Runming He , Yanhao Li , Bin Cui , Wentao Zhang

Reinforcement Learning (RL) is widely utilized in the field of robotics, and as such, it is gradually being implemented in the Hybrid Electric Vehicle (HEV) supervisory control. Even though RL exhibits excellent performance in terms of fuel…

Robotics · Computer Science 2020-10-29 Bin Xu , Jun Hou , Junzhe Shi , Huayi Li , Dhruvang Rathod , Zhe Wang , Zoran Filipi

Reinforcement learning with verifiable rewards (RLVR) has shown promise in enhancing the reasoning performance of large language models (LLMs) by increasing test-time compute. However, even after extensive RLVR training, such models still…

Artificial Intelligence · Computer Science 2026-03-10 Pinzheng Wang , Shuli Xu , Juntao Li , Yu Luo , Dong Li , Jianye Hao , Min Zhang

Reinforcement learning with verifiable rewards (RLVR) improves language model reasoning by using rule-based rewards in verifiable domains such as mathematics and code. However, RLVR leads to limited generalization for open-ended tasks --…

Computation and Language · Computer Science 2025-09-25 Adithya Bhaskar , Xi Ye , Danqi Chen

The ongoing debate on whether reinforcement learning with verifiable rewards (RLVR) expands or shrinks the reasoning capabilities of large language models (LLMs) remains unresolved. Some studies contend that RLVR mainly improves sampling…

Machine Learning · Computer Science 2025-10-07 Xinhao Yao , Lu Yu , Xiaolin Hu , Fengwei Teng , Qing Cui , Jun Zhou , Yong Liu

Reinforcement learning with verifiable rewards (RLVR) has substantially improved the reasoning capabilities of large language models. While existing analyses identify that RLVR-induced changes are sparse, they primarily focus on the…

Post-training has demonstrated its importance in enhancing the reasoning capabilities of large language models (LLMs). The primary post-training methods can be categorized into supervised fine-tuning (SFT) and reinforcement fine-tuning…

Machine Learning · Computer Science 2025-10-21 Mingyang Liu , Gabriele Farina , Asuman Ozdaglar

Reinforcement Learning with Verifiable Reward (RLVR) effectively solves complex tasks but demands extremely long context lengths during training, leading to substantial computational costs. While multi-stage training can partially mitigate…

Machine Learning · Computer Science 2025-12-25 Xin Xu , Cliveb AI , Kai Yang , Tianhao Chen , Yang Wang , Saiyong Yang , Can Yang

Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) for multimodal large language models (MLLMs) have mainly focused on improving final answer correctness and strengthening visual grounding. However, a critical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Jinda Lu , Junkang Wu , Jinghan Li , Kexin Huang , Shuo Yang , Mingzhu Chen , Jiancan Wu , Kuien Liu , Xiang Wang

Large reasoning models (LRMs) are commonly trained with reinforcement learning (RL) to explore long chain-of-thought reasoning, achieving strong performance at high computational cost. Recent methods add multi-reward objectives to jointly…

Artificial Intelligence · Computer Science 2026-02-17 Anhao Zhao , Ziyang Chen , Junlong Tong , Yingqi Fan , Fanghua Ye , Shuhao Li , Yunpu Ma , Wenjie Li , Xiaoyu Shen

Although LLMs have demonstrated improved performance by scaling parallel test-time compute, doing so relies on generating reasoning paths that are both diverse and accurate. For challenging problems, the forking tokens that trigger diverse…

Computation and Language · Computer Science 2026-03-03 Sheng Jia , Xiao Wang , Shiva Prasad Kasiviswanathan

Post-training has become a crucial step for unlocking the capabilities of large language models, with reinforcement learning (RL) emerging as a critical paradigm. Recent RL-based post-training has increasingly split into two paradigms:…

Machine Learning · Computer Science 2026-05-18 Shangjian Yin , Yu Fu , Yue Dong , Zhouxing Shi