中文
相关论文

相关论文: Rethinking the Design of Reinforcement Learning-Ba…

200 篇论文

Large language models (LLMs) augmented with multi-step reasoning and action generation abilities have shown promise in leveraging external tools to tackle complex tasks that require long-horizon planning. However, existing approaches either…

人工智能 · 计算机科学 2025-10-16 Wei Fan , Wenlin Yao , Zheng Li , Feng Yao , Xin Liu , Liang Qiu , Qingyu Yin , Yangqiu Song , Bing Yin

The emergence of agentic reinforcement learning (Agentic RL) marks a paradigm shift from conventional reinforcement learning applied to large language models (LLM RL), reframing LLMs from passive sequence generators into autonomous,…

Deep Reinforcement Learning (RL) is remarkably effective in addressing sequential resource allocation problems in domains such as healthcare, public policy, and resource management. However, deep RL policies often lack transparency and…

机器学习 · 计算机科学 2025-02-18 Mauricio Tec , Guojun Xiong , Haichuan Wang , Francesca Dominici , Milind Tambe

The development of autonomous agents for complex, long-horizon tasks is a central goal in AI. However, dominant training paradigms face a critical limitation: reinforcement learning (RL) methods that optimize solely for final task success…

机器学习 · 计算机科学 2025-07-31 Zijing Zhang , Ziyang Chen , Mingxiao Li , Zhaopeng Tu , Xiaolong Li

We study what actually works and what doesn't for training large language models as agents via multi-turn reinforcement learning. Despite rapid progress, existing frameworks and definitions are fragmented, and there is no systematic…

机器学习 · 计算机科学 2025-12-09 Ruiyi Wang , Prithviraj Ammanabrolu

Recent advancements in Large Language Models(LLMs) have demonstrated their capabilities not only in reasoning but also in invoking external tools, particularly search engines. However, teaching models to discern when to invoke search and…

计算与语言 · 计算机科学 2025-05-14 Zeyang Sha , Shiwen Cui , Weiqiang Wang

The rapid progress of Large Language Models (LLMs) has given rise to a new category of autonomous AI systems, referred to as Deep Research (DR) agents. These agents are designed to tackle complex, multi-turn informational research tasks by…

The rapid advancement of large language models (LLMs) has driven the development of agentic systems capable of autonomously performing complex tasks. Despite their impressive capabilities, LLMs remain constrained by their internal knowledge…

信息检索 · 计算机科学 2025-08-19 Wenlin Zhang , Xiaopeng Li , Yingyi Zhang , Pengyue Jia , Yichao Wang , Huifeng Guo , Yong Liu , Xiangyu Zhao

Recent months have seen the emergence of a powerful new trend in which large language models (LLMs) are augmented to become autonomous language agents capable of performing objective oriented multi-step tasks on their own, rather than…

A key method for creating Artificial Intelligence (AI) agents is Reinforcement Learning (RL). However, constructing a standalone RL policy that maps perception to action directly encounters severe problems, chief among them being its lack…

Large pretrained models are showing increasingly better performance in reasoning and planning tasks across different modalities, opening the possibility to leverage them for complex sequential decision making problems. In this paper, we…

人工智能 · 计算机科学 2024-10-10 Martin Klissarov , Devon Hjelm , Alexander Toshev , Bogdan Mazoure

Recent studies have explored integrating Large Language Models (LLMs) with search engines to leverage both the LLMs' internal pre-trained knowledge and external information. Specially, reinforcement learning (RL) has emerged as a promising…

人工智能 · 计算机科学 2025-12-30 Lang Mei , Zhihan Yang , Xiaohan Yu , Huanyao Zhang , Chong Chen

Reinforcement Learning (RL) is essential for evolving Large Language Models (LLMs) into autonomous agents capable of long-horizon planning, yet a practical recipe for scaling RL in complex, multi-turn environments remains elusive. This…

机器学习 · 计算机科学 2026-03-24 Xixi Wu , Qianguo Sun , Ruiyang Zhang , Chao Song , Junlong Wu , Yiyan Qi , Hong Cheng

Large Language Models (LLMs) have become a popular interface for human-AI interaction, supporting information seeking and task assistance through natural, multi-turn dialogue. To respond to users within multi-turn dialogues, the…

计算与语言 · 计算机科学 2026-04-16 Fengran Mo , Yifan Gao , Sha Li , Hansi Zeng , Xin Liu , Zhaoxuan Tan , Xian Li , Jianshu Chen , Dakuo Wang , Meng Jiang

Large vision-language models (VLMs) fine-tuned on specialized visual instruction-following data have exhibited impressive language reasoning capabilities across various scenarios. However, this fine-tuning paradigm may not be able to…

人工智能 · 计算机科学 2024-10-10 Yuexiang Zhai , Hao Bai , Zipeng Lin , Jiayi Pan , Shengbang Tong , Yifei Zhou , Alane Suhr , Saining Xie , Yann LeCun , Yi Ma , Sergey Levine

Although Deep Reinforcement Learning (DRL) has achieved notable success in numerous robotic applications, designing a high-performing reward function remains a challenging task that often requires substantial manual input. Recently, Large…

机器人学 · 计算机科学 2023-10-03 Jiayang Song , Zhehua Zhou , Jiawei Liu , Chunrong Fang , Zhan Shu , Lei Ma

Reinforcement learning (RL) enhanced large language models (LLMs), particularly exemplified by DeepSeek-R1, have exhibited outstanding performance. Despite the effectiveness in improving LLM capabilities, its implementation remains highly…

计算与语言 · 计算机科学 2025-02-25 Shuhe Wang , Shengyu Zhang , Jie Zhang , Runyi Hu , Xiaoya Li , Tianwei Zhang , Jiwei Li , Fei Wu , Guoyin Wang , Eduard Hovy

Graphical User Interface (GUI) agents, driven by Multi-modal Large Language Models (MLLMs), have emerged as a promising paradigm for enabling intelligent interaction with digital systems. This paper provides a structured survey of recent…

人工智能 · 计算机科学 2025-05-14 Jiahao Li , Kaer Huang

The advent of large language models (LLMs) has transformed information access and reasoning through open-ended natural language interaction. However, LLMs remain limited by static knowledge, factual hallucinations, and the inability to…

人工智能 · 计算机科学 2025-10-29 Minhua Lin , Zongyu Wu , Zhichao Xu , Hui Liu , Xianfeng Tang , Qi He , Charu Aggarwal , Hui Liu , Xiang Zhang , Suhang Wang

Designing rewards for autonomous cyber attack and defense learning agents in a complex, dynamic environment is a challenging task for subject matter experts. We propose a large language model (LLM)-based reward design approach to generate…

机器学习 · 计算机科学 2025-11-21 Sayak Mukherjee , Samrat Chatterjee , Emilie Purvine , Ted Fujimoto , Tegan Emerson