中文
相关论文

相关论文: PRISMA: Reinforcement Learning Guided Two-Stage Po…

200 篇论文

Reinforcement Learning with Verifiable Rewards (RLVR) has proven effective for Large Language Model (LLM) reasoning, yet current methods face key challenges in resource allocation and policy optimization dynamics: (i) uniform rollout…

机器学习 · 计算机科学 2026-04-24 Yangyi Fang , Jiaye Lin , Xiaoliang Fu , Cong Qin , Haolin Shi , Chaowen Hu , Lu Pan , Ke Zeng , Xunliang Cai

Reinforcement Learning with Verifiable Rewards (RLVR) enhances Large Language Model (LLM) reasoning but suffers from advantage collapse on ``hard samples'' where all rollouts fail. This lack of variance eliminates crucial learning signals.…

机器学习 · 计算机科学 2026-05-08 Xinyu Lu , Kaiqi Zhang , Jinglin Yang , Boxi Cao , Yaojie Lu , Hongyu Lin , Min He , Xianpei Han , Le Sun

Large Language Models (LLMs) have shown promise in solving complex mathematical problems, yet they still fall short of producing accurate and consistent solutions. Reinforcement Learning (RL) is a framework for aligning these models with…

人工智能 · 计算机科学 2026-02-10 Ali Hatamizadeh , Shrimai Prabhumoye , Igor Gitman , Ximing Lu , Seungju Han , Wei Ping , Yejin Choi , Jan Kautz

Reinforcement learning (RL) has significantly improved the reasoning ability of large language models. However, current reward models underperform in challenging reasoning scenarios and predominant RL training paradigms rely on rule-based…

计算与语言 · 计算机科学 2025-07-30 Meng Zhou , Bei Li , Jiahao Liu , Xiaowen Shi , Yang Bai , Rongxiang Weng , Jingang Wang , Xunliang Cai

Reinforcement Learning with Verifiable Reward (RLVR) has significantly advanced the complex reasoning abilities of Large Language Models (LLMs). However, it struggles to break through the inherent capability boundaries of the base LLM, due…

Recent advances in reinforcement learning (RL) have significantly enhanced the reasoning capabilities of large language models (LLMs). Group Relative Policy Optimization (GRPO), a lightweight variant of Proximal Policy Optimization (PPO),…

机器学习 · 计算机科学 2025-10-13 Chen Wang , Lai Wei , Yanzhi Zhang , Chenyang Shao , Zedong Dan , Weiran Huang , Yuzhi Zhang , Yue Wang

Retrieval-augmented generation (RAG) enables large language models (LLMs) to produce evidence-based responses, and its performance hinges on the matching between the retriever and LLMs. Retriever optimization has emerged as an efficient…

机器学习 · 计算机科学 2026-02-04 Yicheng Zhang , Zhen Qin , Zhaomin Wu , Wenqi Zhang , Shuiguang Deng

Ensuring safety is important for the practical deployment of reinforcement learning (RL). Various challenges must be addressed, such as handling stochasticity in the environments, providing rigorous guarantees of persistent state-wise…

机器学习 · 计算机科学 2023-09-26 Milan Ganai , Zheng Gong , Chenning Yu , Sylvia Herbert , Sicun Gao

Despite the promise of Retrieval-Augmented Generation in grounding Multimodal Large Language Models with external knowledge, the transition to extensive contexts often leads to significant attention dilution and reasoning hallucinations.…

计算与语言 · 计算机科学 2026-03-10 Junming Liu , Yuqi Li , Shiping Wen , Zhigang Zeng , Tingwen Huang

Recent large reasoning models (LRMs) driven by reinforcement learning algorithms (e.g., GRPO) have achieved remarkable performance on challenging reasoning tasks. However, these models suffer from overthinking, generating unnecessarily long…

人工智能 · 计算机科学 2026-03-03 Gang Li , Yan Chen , Ming Lin , Tianbao Yang

A major drawback of reasoning models is their excessive token usage, inflating computational cost, resource demand, and latency. We show this verbosity stems not from deeper reasoning but from reinforcement learning loss minimization when…

计算与语言 · 计算机科学 2025-11-24 Mehdi Fatemi , Banafsheh Rafiee , Mingjie Tang , Kartik Talamadupula

There hardly exists a general solver that is efficient for scheduling problems due to their diversity and complexity. In this study, we develop a two-stage framework, in which reinforcement learning (RL) and traditional operations research…

人工智能 · 计算机科学 2021-03-11 Yongming He , Guohua Wu , Yingwu Chen , Witold Pedrycz

Reinforcement Learning (RL) has proven to be an effective post-training strategy for enhancing reasoning in vision-language models (VLMs). Group Relative Policy Optimization (GRPO) is a recent prominent method that encourages models to…

人工智能 · 计算机科学 2025-10-30 Jiaqi Wang , Kevin Qinghong Lin , James Cheng , Mike Zheng Shou

The development of autonomous agents for complex, long-horizon tasks is a central goal in AI. However, dominant training paradigms face a critical limitation: reinforcement learning (RL) methods that optimize solely for final task success…

机器学习 · 计算机科学 2025-07-31 Zijing Zhang , Ziyang Chen , Mingxiao Li , Zhaopeng Tu , Xiaolong Li

Operating LLMs as coordinated multi-agent research systems over multi-hour runs surfaces failure modes that single-shot evaluation cannot: upstream providers throttle without warning, sub-agents drift the task to fit accessible tools,…

人工智能 · 计算机科学 2026-05-26 Sasank Annapureddy

Recent progress in Large Language Model (LLM) reasoning is increasingly driven by the refinement of post-training loss functions and alignment strategies. However, standard Reinforcement Learning (RL) paradigms like Group Relative Policy…

机器学习 · 计算机科学 2026-01-28 Kishan Panaganti , Zhenwen Liang , Wenhao Yu , Haitao Mi , Dong Yu

Reinforcement learning (RL) has proven highly effective in eliciting the reasoning capabilities of large language models (LLMs). Inspired by this success, recent studies have explored applying similar techniques to vision-language models…

计算机视觉与模式识别 · 计算机科学 2025-10-20 Yan Chen , Long Li , Teng Xi , Long Zeng , Jingdong Wang

Reinforcement learning (RL) agents are powerful tools for managing power grids. They use large amounts of data to inform their actions and receive rewards or penalties as feedback to learn favorable responses for the system. Once trained,…

系统与控制 · 电气工程与系统科学 2024-11-19 Benjamin M. Peter , Mert Korkali

Inspired by the dual-process theory of human cognition from \textit{Thinking, Fast and Slow}, we introduce \textbf{PRIME} (Planning and Retrieval-Integrated Memory for Enhanced Reasoning), a multi-agent reasoning framework that dynamically…

人工智能 · 计算机科学 2025-11-12 Hieu Tran , Zonghai Yao , Nguyen Luong Tran , Zhichao Yang , Feiyun Ouyang , Shuo Han , Razieh Rahimi , Hong Yu

Recent studies increasingly explore Large Language Models (LLMs) as a new paradigm for recommendation systems due to their scalability and world knowledge. However, existing work has three key limitations: (1) most efforts focus on…