English
Related papers

Related papers: CVeDRL: An Efficient Code Verifier via Difficulty-…

200 papers

Reinforcement learning (RL) is increasingly used to post-train medical Vision-Language Models (VLMs), yet it remains unclear whether RL improves medical visual reasoning or mainly sharpens behaviors already induced by supervised fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Ahmadreza Jeddi , Kimia Shaban , Negin Baghbanzadeh , Natasha Sharan , Abhishek Moturu , Elham Dolatabadi , Babak Taati

With the growing use of Retrieval-Augmented Generation (RAG), training large language models (LLMs) for context-sensitive reasoning and faithfulness is increasingly important. Existing RAG-oriented reinforcement learning (RL) methods rely…

Computation and Language · Computer Science 2026-03-06 Zhehao Tan , Yihan Jiao , Dan Yang , Junjie Wang , Duolin Sun , Jie Feng , Xidong Wang , Lei Liu , Yue Shen , Jian Wang , Jinjie Gu

Designing effective task sequences is crucial for curriculum reinforcement learning (CRL), where agents must gradually acquire skills by training on intermediate tasks. A key challenge in CRL is to identify tasks that promote exploration,…

Machine Learning · Computer Science 2025-07-08 Geonwoo Cho , Jaegyun Im , Doyoon Kim , Sundong Kim

Large language models excel at complex tasks by breaking down problems into structured reasoning steps. However, reasoning traces often extend beyond reaching a correct answer, causing wasted computation, reduced readability, and…

Computation and Language · Computer Science 2025-05-26 Razvan-Gabriel Dumitru , Darius Peteleaza , Vikas Yadav , Liangming Pan

Reinforcement learning (RL) has emerged as a promising approach to improve large language model (LLM) reasoning, yet most open efforts focus narrowly on math and code, limiting our understanding of its broader applicability to general…

Reinforcement learning (RL) has emerged as a critical technique for enhancing LLM-based deep search agents. However, existing approaches primarily rely on binary outcome rewards, which fail to capture the comprehensiveness and factuality of…

Computation and Language · Computer Science 2026-01-12 Jiajie Zhang , Xin Lv , Ling Feng , Lei Hou , Juanzi Li

Long-form generation has become a critical and challenging application for Large Language Models (LLMs). Existing studies are limited by their reliance on scarce, high-quality long-form response data and their focus on coarse-grained,…

Computation and Language · Computer Science 2026-01-01 Jianghao Chen , Wei Sun , Qixiang Yin , Zhixing Tan , Jiajun Zhang

Existing agents for solving tasks such as ML engineering rely on prompting powerful language models. As a result, these agents do not improve with more experience. In this paper, we show that agents backed by weaker models that improve via…

Machine Learning · Computer Science 2025-09-04 Sherry Yang , Joy He-Yueya , Percy Liang

Reinforcement learning (RL) has recently emerged as a compelling approach for enhancing the reasoning capabilities of large language models (LLMs), where an LLM generator serves as a policy guided by a verifier (reward model). However,…

Machine Learning · Computer Science 2025-10-24 Kaiwen Zha , Zhengqi Gao , Maohao Shen , Zhang-Wei Hong , Duane S. Boning , Dina Katabi

Large reasoning models (LRMs) have recently achieved significant progress in complex reasoning tasks, aided by reinforcement learning with verifiable rewards. However, LRMs often suffer from overthinking, expending excessive computation on…

Artificial Intelligence · Computer Science 2025-08-19 Chuhuai Yue , Chengqi Dong , Yinan Gao , Hang He , Jiajun Chai , Guojun Yin , Wei Lin

Reinforcement learning (RL) has been widely used in training large language models (LLMs) for preventing unexpected outputs, eg reducing harmfulness and errors. However, existing RL methods mostly adopt the instance-level reward, which is…

Computation and Language · Computer Science 2024-06-18 Zhipeng Chen , Kun Zhou , Wayne Xin Zhao , Junchen Wan , Fuzheng Zhang , Di Zhang , Ji-Rong Wen

We aim to improve the reasoning capabilities of language models via reinforcement learning (RL). Recent RL post-trained models like DeepSeek-R1 have demonstrated reasoning abilities on mathematical and coding tasks. However, prior studies…

Reinforcement learning with verifiable rewards (RLVR) has recently unlocked strong reasoning capabilities in large language models (LLMs), triggering rapid exploration of new algorithms and data. However, RLVR training is notoriously…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-21 Yiqi Zhang , Fangzheng Jiao , Tian Tang , Boyu Tian , Hangyu Wang , Qiaoling Chen , Guoteng Wang , Zhen Jiang , Peng Sun , Ping Zhang , Xiaohe Hu , Ziming Liu , Menghao Zhang , Yanmin Jia , Yang You , Siyuan Feng

Reinforcement learning (RL) has gained increasing attraction in the academia and tech industry with launches to a variety of impactful applications and products. Although research is being actively conducted on many fronts (e.g., offline…

Machine Learning · Computer Science 2021-12-13 Ruiyang Xu , Zhengxing Chen

Collaborative edge computing uses edge nodes in different locations to execute tasks, necessitating dynamic task offloading decisions to maintain low latency and high reliability, especially under unpredictable node failures. Although deep…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-08 Hao Guo , Kaixiang Xv , Ziwu Ge , Lei Yang

Large Language Models (LLMs) demonstrate transformative potential, yet their reasoning remains inconsistent and unreliable. Reinforcement learning (RL)-based fine-tuning is a key mechanism for improvement, but its effectiveness is…

Machine Learning · Computer Science 2026-02-11 Pei-Chi Pan , Yingbin Liang , Sen Lin

Although deep reinforcement learning (DRL) algorithms have made important achievements in many control tasks, they still suffer from the problems of sample inefficiency and unstable training process, which are usually caused by sparse…

Robotics · Computer Science 2020-02-28 Ke Lin , Liang Gong , Xudong Li , Te Sun , Binhao Chen , Chengliang Liu , Zhengfeng Zhang , Jian Pu , Junping Zhang

Reinforcement learning with verifiable reward (RLVR) has become a promising paradigm for post-training large language models (LLMs) to improve their reasoning capability. However, when the rollout accuracy is low on hard problems, the…

Machine Learning · Computer Science 2026-04-21 Huanyu Liu , Jia Li , Yihong Dong , Chang Yu , Taozhi Chen , Lecheng Wang , Yongding Tao , Bin Gu , Ge Li

Reinforcement Learning (RL) plays a crucial role in advancing autonomous driving technologies by maximizing reward functions to achieve the optimal policy. However, crafting these reward functions has been a complex, manual process in many…

Artificial Intelligence · Computer Science 2024-06-18 Xu Han , Qiannan Yang , Xianda Chen , Xiaowen Chu , Meixin Zhu

Reasoning models (RMs), language models (LMs) trained with reinforcement learning to produce long-form natural language reasoning, have been remarkably successful, but they still require large amounts of computation and data to train, and…

Computation and Language · Computer Science 2025-10-27 Cedegao E. Zhang , Cédric Colas , Gabriel Poesia , Joshua B. Tenenbaum , Jacob Andreas