中文
相关论文

相关论文: WebAnchor: Anchoring Agent Planning to Stabilize L…

200 篇论文

Recent Large Reasoning Models (LRMs) have achieved remarkable performance in solving complex problems via supervised fine-tuning (SFT) and reinforcement learning (RL). Although existing RL algorithms significantly enhance model accuracy,…

人工智能 · 计算机科学 2025-10-20 Zezhong Tan , Hang Gao , Xinhong Ma , Feng Zhang , Ziqiang Dong

Training large language models (LLMs) as interactive agents for controlling graphical user interfaces (GUIs) presents a unique challenge to optimize long-horizon action sequences with multimodal feedback from complex environments. While…

计算机视觉与模式识别 · 计算机科学 2025-05-23 Fanbin Lu , Zhisheng Zhong , Shu Liu , Chi-Wing Fu , Jiaya Jia

Large language models (LLMs) have exhibited extraordinary performance in a variety of tasks while it remains challenging for them to solve complex multi-step tasks as agents. In practice, agents sensitive to the outcome of certain key steps…

Large language model (LLM)-based agents are increasingly trained with reinforcement learning (RL) to enhance their ability to interact with external environments through tool use, particularly in search-based settings that require…

计算与语言 · 计算机科学 2026-03-25 Guoqing Wang , Sunhao Dai , Guangze Ye , Zeyu Gan , Wei Yao , Yong Deng , Xiaofeng Wu , Zhenzhe Ying

Web agents powered by Large Language Models (LLMs) show promise for next-generation AI, but their limited reasoning in uncertain, dynamic web environments hinders robust deployment. In this paper, we identify key reasoning skills essential…

计算与语言 · 计算机科学 2025-09-19 Minda Hu , Tianqing Fang , Jianshu Zhang , Junyu Ma , Zhisong Zhang , Jingyan Zhou , Hongming Zhang , Haitao Mi , Dong Yu , Irwin King

Recent advances of reasoning models, exemplified by OpenAI's o1 and DeepSeek's R1, highlight the significant potential of Reinforcement Learning (RL) to enhance the reasoning capabilities of Large Language Models (LLMs). However,…

Reinforcement learning (RL) has emerged as a powerful tool for fine-tuning large language models (LLMs) to improve complex reasoning abilities. However, state-of-the-art policy optimization methods often suffer from high computational…

机器学习 · 计算机科学 2025-05-28 Kianté Brantley , Mingyu Chen , Zhaolin Gao , Jason D. Lee , Wen Sun , Wenhao Zhan , Xuezhou Zhang

Large language models (LLMs) are reshaping the recommender system paradigm by enabling users to express preferences and receive recommendations through conversations. Yet, aligning LLMs to the recommendation task remains challenging:…

信息检索 · 计算机科学 2026-02-17 Yaochen Zhu , Harald Steck , Dawen Liang , Yinhan He , Vito Ostuni , Jundong Li , Nathan Kallus

Large language models (LLMs) have recently advanced in reasoning when optimized with reinforcement learning (RL) under verifiable rewards. Existing methods primarily rely on outcome-based supervision to strengthen internal LLM reasoning,…

人工智能 · 计算机科学 2026-05-29 Siyao Song , Cong Ma , Zhihao Cheng , Shiye Lei , Minghao Li , Ying Zeng , Huaixiao Tou , Kai Jia

Large language models (LLMs) augmented with multi-step reasoning and action generation abilities have shown promise in leveraging external tools to tackle complex tasks that require long-horizon planning. However, existing approaches either…

人工智能 · 计算机科学 2025-10-16 Wei Fan , Wenlin Yao , Zheng Li , Feng Yao , Xin Liu , Liang Qiu , Qingyu Yin , Yangqiu Song , Bing Yin

Large language models (LLMs) demonstrate strong reasoning abilities via Chain-of-Thought (CoT), but their token-level generation encourages local decisions and lacks global planning, often leading to redundant or inaccurate reasoning.…

Large language model (LLM) agents are fundamentally constrained by context length on long-horizon tasks. We introduce Context-Folding, a framework that empowers agents to actively manage their working context. An agent can procedurally…

计算与语言 · 计算机科学 2025-10-15 Weiwei Sun , Miao Lu , Zhan Ling , Kang Liu , Xuesong Yao , Yiming Yang , Jiecao Chen

Reinforcement Learning (RL) has enabled Large Language Models (LLMs) to acquire increasingly complex reasoning and agentic behaviors. In this work, we propose two simple techniques to improve policy gradient algorithms for LLMs. First, we…

机器学习 · 计算机科学 2026-02-05 Lunjun Zhang , Jimmy Ba

Recent advances in multimodal agents have improved computer-use interaction and tool-usage, yet most existing systems remain reactive, optimizing actions in isolation without reasoning about future states or long-term goals. This limits…

人工智能 · 计算机科学 2026-03-18 Yongyuan Liang , Shijie Zhou , Yu Gu , Hao Tan , Gang Wu , Franck Dernoncourt , Jihyung Kil , Ryan A. Rossi , Ruiyi Zhang

The effective training of Large Language Models (LLMs) for function calling faces a critical challenge: balancing exploration of complex reasoning paths with stable policy optimization. Standard methods like Supervised Fine-Tuning (SFT)…

Language model (LM)-based agents have demonstrated promising capabilities in automating complex tasks from natural language instructions, yet they continue to struggle with long-horizon planning and reasoning. To address this, we propose an…

人工智能 · 计算机科学 2026-05-05 Wenyi Wu , Sibo Zhu , Kun Zhou , Biwei Huang

Reinforcement learning (RL) has emerged as an effective approach for enhancing the reasoning capabilities of large language models (LLMs), especially in scenarios where supervised fine-tuning (SFT) falls short due to limited…

机器学习 · 计算机科学 2026-04-15 Jian Xiong , Jingbo Zhou , Jingyong Ye , Qiang Huang , Dejing Dou

Agentic search -- the task of training agents that iteratively reason, issue queries, and synthesize retrieved information to answer complex questions -- has achieved remarkable progress through reinforcement learning (RL). However,…

人工智能 · 计算机科学 2026-04-23 Hansi Zeng , Liam Collins , Bhuvesh Kumar , Neil Shah , Hamed Zamani

Large Language Models (LLMs) have demonstrated strong capabilities in web search and reasoning. However, their dependence on static training corpora makes them prone to factual errors and knowledge gaps. Retrieval-Augmented Generation (RAG)…

人工智能 · 计算机科学 2026-01-26 Jiasheng Xu , Mingda Li , Yongqiang Tang , Peijie Wang , Wensheng Zhang

Open-ended dialogue agents aim to deliver engaging, personalized interactions by adapting to users' traits, but existing methods face critical limitations: over-reliance on pre-collected user data, and short-horizon biases in reinforcement…

人工智能 · 计算机科学 2026-02-11 Kun Peng , Conghui Tan , Yu Liu , Guohua Tang , Zhongqian Sun , Wei Yang , Zining Zhu , Lei Jiang , Yanbing Liu , Hao Peng