中文
相关论文

相关论文: Resolving Action Bottleneck: Agentic Reinforcement…

200 篇论文

A major drawback of reasoning models is their excessive token usage, inflating computational cost, resource demand, and latency. We show this verbosity stems not from deeper reasoning but from reinforcement learning loss minimization when…

计算与语言 · 计算机科学 2025-11-24 Mehdi Fatemi , Banafsheh Rafiee , Mingjie Tang , Kartik Talamadupula

Large foundation models enable powerful reasoning for autonomous systems, but mapping semantic intent to reliable real-time control remains challenging. Existing approaches either (i) let Large Language Models (LLMs) generate trajectories…

机器人学 · 计算机科学 2026-04-03 Jiayi Chen , Shuai Wang , Guangxu Zhu , Chengzhong Xu

Group-based reinforcement learning methods, like Group Relative Policy Optimization (GRPO), are widely used nowadays to post-train large language models. Despite their empirical success, they exhibit structural mismatches between reward…

机器学习 · 计算机科学 2026-01-09 Aleksandar Fontana , Marco Simoni , Giulio Rossolini , Andrea Saracino , Paolo Mori

Reinforcement learning (RL) is a dominant paradigm for training autonomous agents, yet these agents often exhibit poor generalization, failing to adapt to scenarios not seen during training. In this work, we identify a fundamental cause of…

人工智能 · 计算机科学 2026-01-16 Jingyu Liu , Xiaopeng Wu , Jingquan Peng , Kehan Chen , Chuan Yu , Lizhong Ding , Yong Liu

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by incorporating external knowledge, yet traditional single-round retrieval struggles with complex multi-step reasoning. Agentic RAG addresses this by enabling LLMs…

计算与语言 · 计算机科学 2026-02-27 Tianle Xia , Ming Xu , Lingxiang Hu , Yiding Sun , Wenwei Li , Linfang Shang , Liqun Liu , Peng Shu , Huan Yu , Jie Jiang

Problem definition: Supply chains are constantly evolving networks. Reinforcement learning is increasingly proposed as a solution to provide optimal control of these networks. Academic/practical: However, learning in continuously varying…

系统与控制 · 电气工程与系统科学 2023-12-27 Wan Wang , Haiyan Wang , Adam J. Sobey

Reinforcement learning (RL) is a powerful approach to enhance task-oriented dialogue (TOD) systems. However, existing RL methods tend to mainly focus on generation tasks, such as dialogue policy learning (DPL) or response generation (RG),…

人工智能 · 计算机科学 2024-06-21 Huifang Du , Shuqin Li , Minghao Wu , Xuejing Feng , Yuan-Fang Li , Haofen Wang

Multi-step reasoning ability of large language models is crucial in tasks such as math and tool utilization. Current researches predominantly focus on enhancing model performance in these multi-step reasoning tasks through fine-tuning with…

计算与语言 · 计算机科学 2024-10-23 Yuli Qiu , Jiashu Yao , Heyan Huang , Yuhang Guo

Process Reward Models (PRMs) provide step-level supervision to large language models (LLMs), but scaling up training data annotation remains challenging for both humans and LLMs. To address this limitation, we propose an active learning…

机器学习 · 计算机科学 2025-04-16 Keyu Duan , Zichen Liu , Xin Mao , Tianyu Pang , Changyu Chen , Qiguang Chen , Michael Qizhe Shieh , Longxu Dou

While Reinforcement Learning (RL) shows promise in training tool-use Large Language Models (LLMs) using verifiable outcome rewards, existing methods largely overlook the potential of reasoning rewards based on chain-of-thought quality for…

计算与语言 · 计算机科学 2026-01-16 Zihan Lin , Xiaohan Wang , Hexiong Yang , Jiajun Chai , Jie Cao , Guojun Yin , Wei Lin , Ran He

With the rapid advancement of large language models and vision-language models, employing large models as Web Agents has become essential for automated web interaction. However, training Web Agents with reinforcement learning faces critical…

We present REARANK, a large language model (LLM)-based listwise reasoning reranking agent. REARANK explicitly reasons before reranking, significantly improving both performance and interpretability. Leveraging reinforcement learning and…

信息检索 · 计算机科学 2025-05-27 Le Zhang , Bo Wang , Xipeng Qiu , Siva Reddy , Aishwarya Agrawal

Reinforcement learning is an appropriate and successful method to robustly perform low-level robot control under noisy conditions. Symbolic action planning is useful to resolve causal dependencies and to break a causally complex problem…

机器学习 · 计算机科学 2019-12-10 Manfred Eppe , Phuong D. H. Nguyen , Stefan Wermter

Recent thinking models trained with reinforcement learning and backward-checking CoT often suffer from overthinking: they produce excessively long outputs even on simple problems, wasting computation. Existing evaluations, based on token…

计算与语言 · 计算机科学 2025-10-15 Siqi Fan , Bowen Qin , Peng Han , Shuo Shang , Yequan Wang , Aixin Sun

Retrieval is increasingly moving from one-shot matching toward interactive reasoning, where language agents iteratively inspect evidence, reformulate queries, and search again. Training such agents raises a credit-assignment challenge:…

计算与语言 · 计算机科学 2026-05-27 Mingchen Li , Hansi Zeng , Zhuo Qian , Jiatan Huang , Hamed Zamani , Hong Yu

We study a common challenge in reinforcement learning for large language models (LLMs): the Zero-Reward Assumption, where non-terminal actions (i.e., intermediate token generations) receive zero task-specific immediate reward, while only…

机器学习 · 计算机科学 2025-06-04 Shenghua He , Tian Xia , Xuan Zhou , Hui Wei

Learning a control policy capable of adapting to time-varying and potentially evolving system dynamics has been a great challenge to the mainstream reinforcement learning (RL). Mainly, the ever-changing system properties would continuously…

机器学习 · 计算机科学 2022-08-31 Po-Hsiang Chiu , Manfred Huber

The increase of renewable energy generation towards the zero-emission target is making the problem of controlling power grids more and more challenging. The recent series of competitions Learning To Run a Power Network (L2RPN) have…

系统与控制 · 电气工程与系统科学 2024-09-10 Gianvito Losapio , Davide Beretta , Marco Mussi , Alberto Maria Metelli , Marcello Restelli

We introduce reinforcement learning for heterogeneous teams in which rewards for an agent are additively factored into local costs, stimuli unique to each agent, and global rewards, those shared by all agents in the domain. Motivating…

机器学习 · 计算机科学 2020-11-19 Roi Ceren , Prashant Doshi , Keyang He

Agentic reinforcement learning has advanced large language models (LLMs) to reason through long chain-of-thought trajectories while interleaving external tool use. Existing approaches assume a fixed inventory of tools, limiting LLM agents'…

计算与语言 · 计算机科学 2025-12-16 Jiaru Zou , Ling Yang , Yunzhe Qi , Sirui Chen , Mengting Ai , Ke Shen , Jingrui He , Mengdi Wang