English
Related papers

Related papers: Benchmark Success, Clinical Failure: When Reinforc…

200 papers

Reinforcement learning with verifiable rewards (RLVR) improves language model reasoning by using rule-based rewards in verifiable domains such as mathematics and code. However, RLVR leads to limited generalization for open-ended tasks --…

Computation and Language · Computer Science 2025-09-25 Adithya Bhaskar , Xi Ye , Danqi Chen

In recent years, general-purpose large language models (LLMs) such as GPT, Gemini, Claude, and DeepSeek have advanced at an unprecedented pace. Despite these achievements, their application to finance remains challenging, due to fragmented…

Despite advances in multilingual capabilities, most large language models (LLMs) remain English-centric in their training and, crucially, in their production of reasoning traces. Even when tasked with non-English problems, these models…

Computation and Language · Computer Science 2026-04-15 Daniil Gurgurov , Tom Röhr , Sebastian von Rohrscheidt , Josef van Genabith , Alexander Löser , Simon Ostermann

Reinforcement learning (RL) for mathematical reasoning can suffer from reward sparsity: for challenging problems, LLM fails to sample any correct trajectories, preventing RL from receiving meaningful positive feedback. At the same time,…

Machine Learning · Computer Science 2026-03-06 Yangzhen Wu , Shanda Li , Zixin Wen , Xin Zhou , Ameet Talwalkar , Yiming Yang , Wenhao Huang , Tianle Cai

Large vision-language models (VLMs) increasingly adopt post-training techniques such as long chain-of-thought (CoT) supervised fine-tuning (SFT) and reinforcement learning (RL) to elicit sophisticated reasoning. While these methods exhibit…

Computation and Language · Computer Science 2025-07-11 Jierun Chen , Tiezheng Yu , Haoli Bai , Lewei Yao , Jiannan Wu , Kaican Li , Fei Mi , Chaofan Tao , Lei Zhu , Manyi Zhang , Xiaohui Li , Lu Hou , Lifeng Shang , Qun Liu

Radiology report generation requires advanced medical image analysis, effective temporal reasoning, and accurate text generation. Although recent innovations, particularly multimodal large language models, have shown improved performance,…

Computation and Language · Computer Science 2025-11-11 Kai Zhang , Christopher Malon , Lichao Sun , Martin Renqiang Min

This paper investigates Reinforcement Learning (RL) approaches to enhance the reasoning capabilities of Large Language Model (LLM) agents in long-horizon, multi-turn scenarios. Although RL algorithms such as Group Relative Policy…

When applying reinforcement learning--typically through GRPO--to large vision-language model reasoning struggles to effectively scale reasoning length or generates verbose outputs across all tasks with only marginal gains in accuracy. To…

Computation and Language · Computer Science 2025-10-24 Wenyi Xiao , Leilei Gan

Recent advancements in large language models (LLMs) have demonstrated impressive chain-of-thought reasoning capabilities, with reinforcement learning (RL) playing a crucial role in this progress. While "aha moment" patterns--where models…

Computation and Language · Computer Science 2025-07-24 Lai Wei , Yuting Li , Kaipeng Zheng , Chen Wang , Yue Wang , Linghe Kong , Lichao Sun , Weiran Huang

Reinforcement learning (RL) has emerged as a powerful approach for tackling complex medical decision-making problems such as treatment planning, personalized medicine, and optimizing the scheduling of surgeries and appointments. It has…

Computation and Language · Computer Science 2023-10-31 Ying Liu , Haozhu Wang , Huixue Zhou , Mingchen Li , Yu Hou , Sicheng Zhou , Fang Wang , Rama Hoetzlein , Rui Zhang

Large Language Models (LLMs) are pretrained on massive datasets and later instruction-tuned via supervised fine-tuning (SFT) or reinforcement learning (RL). Best practices emphasize large, diverse pretraining data, whereas post-training…

Machine Learning · Computer Science 2026-03-03 Adel Javanmard , Baharan Mirzasoleiman , Vahab Mirrokni

Reinforcement learning (RL) has emerged as an effective approach for enhancing the reasoning capabilities of large language models (LLMs), especially in scenarios where supervised fine-tuning (SFT) falls short due to limited…

Machine Learning · Computer Science 2026-04-15 Jian Xiong , Jingbo Zhou , Jingyong Ye , Qiang Huang , Dejing Dou

Reinforcement Learning (RL) can directly enhance the reasoning capabilities of large language models without extensive reliance on Supervised Fine-Tuning (SFT). In this work, we revisit the traditional Policy Gradient (PG) mechanism and…

Machine Learning · Computer Science 2026-02-04 Xiangxiang Chu , Hailang Huang , Xiao Zhang , Fei Wei , Yong Wang

Reinforcement learning (RL) with rule-based reward functions has recently shown great promise in enhancing the reasoning depth and generalization ability of vision-language models (VLMs), while maintaining computational efficiency. In spite…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Yizhou Liu , Dingkang Yang , Zizhi Chen , Minghao Han , Xukun Zhang , Keliang Liu , Jingwei Wei , Lihua Zhang

Current benchmarks are inadequate for evaluating progress in reinforcement learning (RL) for large language models (LLMs).Despite recent benchmark gains reported for RL, we find that training on these benchmarks' training sets achieves…

Machine Learning · Computer Science 2025-10-14 Zihan Chen , Yiming Zhang , Hengguang Zhou , Zenghui Ding , Yining Sun , Cho-Jui Hsieh

Multimodal Large Language Models (MLLMs) have gained significant traction for their ability to process diverse input data types and generate coherent, contextually relevant outputs across various applications. While supervised fine-tuning…

Machine Learning · Computer Science 2025-03-31 Zhiyuan Liu , Yuting Zhang , Feng Liu , Changwang Zhang , Ying Sun , Jun Wang

Recent studies have shown that reinforcement learning (RL) is an effective approach for improving the performance of neural machine translation (NMT) system. However, due to its instability, successfully RL training is challenging,…

Machine Learning · Computer Science 2018-08-28 Lijun Wu , Fei Tian , Tao Qin , Jianhuang Lai , Tie-Yan Liu

Large Language Models (LLMs) have achieved remarkable success in natural language processing tasks, with Reinforcement Learning (RL) playing a key role in adapting them to specific applications. In mathematical problem solving, however, the…

Computation and Language · Computer Science 2026-02-02 Rihui Xin , Han Liu , Zecheng Wang , Yupeng Zhang , Dianbo Sui , Xiaolin Hu , Bingning Wang

Chest X-ray (CXR) imaging is one of the most widely used diagnostic modalities in clinical practice, encompassing a broad spectrum of diagnostic tasks. Recent advancements have seen the extensive application of reasoning-based multimodal…

Reinforcement learning (RL) finetuning has become a key technique for enhancing large language models (LLMs) on reasoning-intensive tasks, motivating its extension to vision-language models (VLMs). While RL-tuned VLMs improve on visual…

Machine Learning · Computer Science 2026-05-22 Rosie Zhao , Anshul Shah , Xiaoyu Zhu , Xinke Deng , Zhongyu Jiang , Yang Yang , Joerg Liebelt , Arnab Mondal