中文
相关论文

相关论文: InfoPO: Information-Driven Policy Optimization for…

200 篇论文

Large language models (LLMs) have recently advanced in reasoning when optimized with reinforcement learning (RL) under verifiable rewards. Existing methods primarily rely on outcome-based supervision to strengthen internal LLM reasoning,…

人工智能 · 计算机科学 2026-05-29 Siyao Song , Cong Ma , Zhihao Cheng , Shiye Lei , Minghao Li , Ying Zeng , Huaixiao Tou , Kai Jia

Reinforcement learning with verifiers (RLVR) has become a central paradigm for improving LLM reasoning, yet popular group-based optimization algorithms like GRPO often suffer from exploration collapse, where the models prematurely converge…

人工智能 · 计算机科学 2026-05-19 Haoxuan Chen , Tianming Liang , Wei-Shi Zheng , Jian-Fang Hu

Solving tasks in Reinforcement Learning is no easy feat. As the goal of the agent is to maximize the accumulated reward, it often learns to exploit loopholes and misspecifications in the reward signal resulting in unwanted behavior. While…

机器学习 · 计算机科学 2018-12-27 Chen Tessler , Daniel J. Mankowitz , Shie Mannor

Group-based reinforcement learning (RL), such as GRPO, has advanced the capabilities of large language models on long-horizon agentic tasks. To enable more fine-grained policy updates, recent research has increasingly shifted toward…

机器学习 · 计算机科学 2026-02-27 Shuo He , Lang Feng , Qi Wei , Xin Cheng , Lei Feng , Bo An

Existing Reinforcement Learning from Verifiable Rewards (RLVR) methods, such as Group Relative Policy Optimization (GRPO), have achieved remarkable progress in improving the reasoning capabilities of Large Reasoning Models (LRMs). However,…

机器学习 · 计算机科学 2026-04-16 Hsiu-Yuan Huang , Chenming Tang , Weijie Liu , Clive Bai , Saiyong Yang , Yunfang Wu

Recent advances in Large Language Model (LLM) agents have demonstrated their promising general capabilities. However, their performance in specialized real-world domains often degrades due to challenges in effectively integrating external…

计算与语言 · 计算机科学 2025-10-10 Yuzheng Cai , Siqi Cai , Yuchen Shi , Zihan Xu , Lichao Chen , Yulei Qin , Xiaoyu Tan , Gang Li , Zongyi Li , Haojia Lin , Yong Mao , Ke Li , Xing Sun

The rapid evolution of Large Language Models (LLMs) has accelerated the transition from conversational chatbots to general agents. However, effectively balancing empathetic communication with budget-aware decision-making remains an open…

计算与语言 · 计算机科学 2026-02-27 Ning Gao , Wei Zhang , Yuqin Dai , Ling Shi , Ziyin Wang , Yujie Wang , Wei He , Jinpeng Wang , Chaozheng Wang

With the rapid advancement of large language models and vision-language models, employing large models as Web Agents has become essential for automated web interaction. However, training Web Agents with reinforcement learning faces critical…

Retrieval is increasingly moving from one-shot matching toward interactive reasoning, where language agents iteratively inspect evidence, reformulate queries, and search again. Training such agents raises a credit-assignment challenge:…

计算与语言 · 计算机科学 2026-05-27 Mingchen Li , Hansi Zeng , Zhuo Qian , Jiatan Huang , Hamed Zamani , Hong Yu

Large Language Models (LLMs) often suffer from mode collapse, repeatedly generating the same few completions even when many valid answers exist, limiting their diversity across a wide range of tasks. We introduce Group-Aware Policy…

Large Language Models (LLMs) have shown promise in solving complex mathematical problems, yet they still fall short of producing accurate and consistent solutions. Reinforcement Learning (RL) is a framework for aligning these models with…

人工智能 · 计算机科学 2026-02-10 Ali Hatamizadeh , Shrimai Prabhumoye , Igor Gitman , Ximing Lu , Seungju Han , Wei Ping , Yejin Choi , Jan Kautz

Large Language Models (LLMs) are increasingly deployed in business-critical domains such as finance, education, healthcare, and customer support, where users expect consistent and reliable recommendations. Yet LLMs often exhibit variability…

机器学习 · 计算机科学 2026-04-20 Sonal Prabhune , Balaji Padmanabhan , Kaushik Dutta

Enhancing LLMs with the ability to actively search external knowledge is crucial for complex and real-world tasks. Current approaches either rely on prompting to elicit the model's innate agent capabilities, or suffer from performance…

计算与语言 · 计算机科学 2026-03-20 Chenyang Gu , Yewen Pu , Bruce Yang , Xiaofan Li , Huan Gao

Large Language Models (LLMs) increasingly rely on Chain-of-Thought (CoT) reasoning to improve accuracy on complex tasks. However, always generating lengthy reasoning traces is inefficient, leading to excessive token usage and higher…

While large language models (LLMs) have recently made tremendous progress towards solving challenging AI problems, they have done so at increasingly steep computational and API costs. We propose a novel strategy where we combine multiple…

机器学习 · 计算机科学 2026-03-24 Wenwen Si , Sooyong Jang , Insup Lee , Osbert Bastani

By integrating external knowledge, Retrieval-Augmented Generation (RAG) has become an effective strategy for mitigating the hallucination problems that large language models (LLMs) encounter when dealing with knowledge-intensive tasks.…

计算与语言 · 计算机科学 2024-08-20 Ruizhe Zhang , Yongxin Xu , Yuzhen Xiao , Runchuan Zhu , Xinke Jiang , Xu Chu , Junfeng Zhao , Yasha Wang

Large language models (LLMs) have shown great potential in natural language processing tasks, but their application to machine translation (MT) remains challenging due to pretraining on English-centric data and the complexity of…

计算与语言 · 计算机科学 2025-01-24 Guofeng Cui , Pichao Wang , Yang Liu , Zemian Ke , Zhu Liu , Vimal Bhat

As a typical open-ended generation task, creative writing lacks verifiable reference answers, which has long constrained reward modeling and automatic evaluation due to high human annotation costs, evaluative bias, and coarse feedback…

计算与语言 · 计算机科学 2026-03-17 Jihao Zhao , Shuaishuai Zu , Zhiyuan Ji , Chunlai Zhou , Biao Qin

Training tool-calling agents with reinforcement learning on multi-turn tasks remains challenging due to sparse outcome rewards and difficult credit assignment across conversation turns. We present the first application of MT-GRPO…

人工智能 · 计算机科学 2026-04-06 Wachiravit Modecrua , Krittanon Kaewtawee , Krittin Pachtrachai , Touchapon Kraisingkorn

While current emotional support dialogue systems typically rely on expert-defined scalar rewards for alignment, these signals suffer from severe information sparsity. They cannot explain why a response failed or how to adapt to dynamic user…

人工智能 · 计算机科学 2026-03-20 Jing Ye , Xinpei Zhao , Lu Xiang , Yaping Zhang , Chengqing Zong