中文
相关论文

相关论文: Text-to-SPARQL Generation with Reinforcement Learn…

200 篇论文

Most of the traditional Applicant Tracking Systems (ATS) depend on strict matching using keywords, where candidates that are highly qualified are many times disqualified because of minor semantic differences. In this article, the two-stage…

Reinforcement Learning with Verifiable Rewards (RLVR) has become a standard recipe for post-training LLMs on reasoning tasks, with Group Relative Policy Optimization (GRPO) emerging as a leading approach. However, GRPO and its variants are…

Aligning large language models with pointwise absolute rewards has so far required online, on-policy algorithms such as PPO and GRPO. In contrast, simpler methods that can leverage offline or off-policy data, such as DPO and REBEL, are…

机器学习 · 计算机科学 2025-12-02 Simon Matrenok , Skander Moalla , Caglar Gulcehre

Group Relative Policy Optimization (GRPO) was introduced and used recently for promoting reasoning in LLMs under verifiable (binary) rewards. We show that the mean + variance calibration of these rewards induces a weighted contrastive loss…

机器学习 · 计算机科学 2025-10-22 Youssef Mroueh

Large Language Models (LLMs) often exhibit implicit biases and discriminatory tendencies that reflect underlying social stereotypes. While recent alignment techniques such as RLHF and DPO have mitigated some of these issues, they remain…

计算与语言 · 计算机科学 2025-11-11 Deng Yixuan , Ji Xiaoqiang

Mathematical reasoning is a key benchmark for large language models. Reinforcement learning is a standard post-training mechanism for improving the reasoning capabilities of large language models, yet performance remains sensitive to the…

计算与语言 · 计算机科学 2026-05-11 Arash Ahmadi , Sarah Sharif , Yaser , Banad

Large language models are increasingly post-trained with reinforcement learning in verifiable domains such as code and math. Yet, current methods for reinforcement learning with verifiable rewards (RLVR) learn only from a scalar outcome…

Proximal Policy Optimization (PPO) is commonly used in Reinforcement Learning from Human Feedback to align large language models (LLMs) with downstream tasks. This paper investigates the feasibility of using PPO for direct reinforcement…

计算与语言 · 计算机科学 2024-10-23 Alexander G. Padula , Dennis J. N. J. Soemers

Vision-Language-Action (VLA) models excel in robotic manipulation but are constrained by their heavy reliance on expert demonstrations, leading to demonstration bias and limiting performance. Reinforcement learning (RL) is a vital…

机器人学 · 计算机科学 2025-12-02 Senyu Fei , Siyin Wang , Li Ji , Ao Li , Shiduo Zhang , Liming Liu , Jinlong Hou , Jingjing Gong , Xianzhong Zhao , Xipeng Qiu

Controlled text generation tasks such as unsupervised text style transfer have increasingly adopted the use of Reinforcement Learning (RL). A major challenge in applying RL to such tasks is the sparse reward, which is available only after…

计算与语言 · 计算机科学 2022-04-19 Bhargav Upadhyay , Akhilesh Sudhakar , Arjun Maheswaran

Reinforcement learning (RL) is an effective approach to learn an optimal dialog policy for task-oriented visual dialog systems. A common practice is to apply RL on a neural sequence-to-sequence (seq2seq) framework with the action space…

计算与语言 · 计算机科学 2019-10-30 Mingyang Zhou , Josh Arnold , Zhou Yu

Large reasoning models (LRMs) aim to solve diverse and complex problems through structured reasoning. Recent advances in group-based policy optimization methods have shown promise in enabling stable advantage estimation without reliance on…

机器学习 · 计算机科学 2026-01-29 Zhizheng Jiang , Kang Zhao , Weikai Xu , Xinkui Lin , Wei Liu , Jian Luan , Shuo Shang , Peng Han

Group relative policy optimization (GRPO) has demonstrated significant potential in improving the reasoning capabilities of large language models (LLMs) via reinforcement learning. However, its practical deployment is impeded by an…

机器学习 · 计算机科学 2025-09-29 Yizhou Zhang , Ning Lv , Teng Wang , Jisheng Dang

Text generation is a crucial task in NLP. Recently, several adversarial generative models have been proposed to improve the exposure bias problem in text generation. Though these models gain great success, they still suffer from the…

计算与语言 · 计算机科学 2018-06-08 Zhan Shi , Xinchi Chen , Xipeng Qiu , Xuanjing Huang

This paper investigates Reinforcement Learning (RL) approaches to enhance the reasoning capabilities of Large Language Model (LLM) agents in long-horizon, multi-turn scenarios. Although RL algorithms such as Group Relative Policy…

Recently, reinforcement learning (RL) has been shown to greatly enhance the reasoning capabilities of large language models (LLMs), and RL-based approaches have been progressively applied to visual multimodal tasks. However, the audio…

声音 · 计算机科学 2025-05-15 Gang Li , Jizhong Liu , Heinrich Dinkel , Yadong Niu , Junbo Zhang , Jian Luan

Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a powerful paradigm for facilitating the self-improvement of large language models (LLMs), particularly in the domain of complex reasoning tasks. However,…

机器学习 · 计算机科学 2025-07-17 Ziru Liu , Cheng Gong , Xinyu Fu , Yaofang Liu , Ran Chen , Shoubo Hu , Suiyun Zhang , Rui Liu , Qingfu Zhang , Dandan Tu

Group Relative Policy Optimization (GRPO) has significantly advanced the reasoning ability of large language models (LLMs), particularly in their mathemat ical reasoning performance. However, GRPO and related entropy regularization methods…

计算与语言 · 计算机科学 2026-04-15 Xingyu Lin , Yilin Wen , Du Su , Jinchang Hou , En Wang , Wenbin Liu , Chenfu Bao , Zhonghou Lv

Recent works have demonstrated the effectiveness of reinforcement learning (RL)-based post-training for enhancing the reasoning capabilities of large language models (LLMs). In particular, Group Relative Policy Optimization (GRPO) has shown…

计算机视觉与模式识别 · 计算机科学 2026-02-05 Jinyoung Park , Jeehye Na , Jinyoung Kim , Hyunwoo J. Kim

Transforming natural-language requests into reliable, production-ready data transformations remains challenging: correctness depends on precise schema linking and warehouse-specific SQL dialects, while the strongest supervision available…

人工智能 · 计算机科学 2025-10-06 Anni Li , Aria Attar , Paul Dong