中文
相关论文

相关论文: Dual-Scale World Models for LLM Agents Towards Har…

200 篇论文

Offline multi-agent reinforcement learning (MARL) aims to solve cooperative decision-making problems in multi-agent systems using pre-collected datasets. Existing offline MARL methods primarily constrain training within the dataset…

人工智能 · 计算机科学 2026-03-01 Sijia Li , Xinran Li , Shibo Chen , Jun Zhang

Multi-agent reinforcement learning (MARL) faces two critical bottlenecks distinct from single-agent RL: credit assignment in cooperative tasks and partial observability of environmental states. We propose LERO, a framework integrating Large…

机器学习 · 计算机科学 2025-03-31 Yuan Wei , Xiaohan Shan , Jianmin Li

Large language models (LLMs) have demonstrated remarkable capabilities across a range of text-generation tasks. However, LLMs still struggle with problems requiring multi-step decision-making and environmental feedback, such as online…

人工智能 · 计算机科学 2025-02-18 Zhenfang Chen , Delin Chen , Rui Sun , Wenjun Liu , Chuang Gan

Large Language Models (LLMs) have become integral components in various autonomous agent systems. In this study, we present an exploration-based trajectory optimization approach, referred to as ETO. This learning method is designed to…

计算与语言 · 计算机科学 2024-07-11 Yifan Song , Da Yin , Xiang Yue , Jie Huang , Sujian Li , Bill Yuchen Lin

Humans leverage rich internal models of the world to reason about the future, imagine counterfactuals, and adapt flexibly to new situations. In Reinforcement Learning (RL), world models aim to capture how the environment evolves in response…

人工智能 · 计算机科学 2025-10-29 Léopold Maytié , Roland Bertin Johannet , Rufin VanRullen

Agent self-improvement, where the backbone Large Language Model (LLM) of the agent are trained on trajectories sampled autonomously based on their own policies, has emerged as a promising approach for enhancing performance. Recent…

计算与语言 · 计算机科学 2025-08-22 Tianqing Fang , Hongming Zhang , Zhisong Zhang , Kaixin Ma , Wenhao Yu , Haitao Mi , Dong Yu

Text-based games provide an interactive way to study natural language processing. While deep reinforcement learning has shown effectiveness in developing the game playing agent, the low sample efficiency and the large action space remain to…

计算与语言 · 计算机科学 2022-04-22 Yunqiu Xu , Meng Fang , Ling Chen , Yali Du , Joey Tianyi Zhou , Chengqi Zhang

Large Language Model (LLM) agents can leverage multiple turns and tools to solve complex tasks, with prompt-based approaches achieving strong performance. This work demonstrates that Reinforcement Learning (RL) can push capabilities…

计算与语言 · 计算机科学 2025-10-29 Vivek Kalyan , Martin Andrews

LLM-based (Large Language Model) GUI (Graphical User Interface) agents can potentially reshape our daily lives significantly. However, current LLM-based GUI agents suffer from the scarcity of high-quality training data owing to the…

人工智能 · 计算机科学 2025-05-26 Danyang Zhang , Situo Zhang , Ziyue Yang , Zichen Zhu , Zihan Zhao , Ruisheng Cao , Lu Chen , Kai Yu

Large language models (LLMs) have recently gained much attention in building autonomous agents. However, the performance of current LLM-based web agents in long-horizon tasks is far from optimal, often yielding errors such as repeatedly…

计算与语言 · 计算机科学 2025-04-01 Hyungjoo Chae , Namyoung Kim , Kai Tzu-iunn Ong , Minju Gwak , Gwanwoo Song , Jihoon Kim , Sunghwan Kim , Dongha Lee , Jinyoung Yeo

Large Language Models (LLMs) offer a promising basis for creating agents that can tackle complex tasks through iterative environmental interaction. Existing methods either require these agents to mimic expert-provided trajectories or rely…

计算与语言 · 计算机科学 2024-12-02 Dihong Gong , Pu Lu , Zelong Wang , Meng Zhou , Xiuqiang He

In environments with sparse or delayed rewards, reinforcement learning (RL) incurs high sample complexity due to the large number of interactions needed for learning. This limitation has motivated the use of large language models (LLMs) for…

机器学习 · 计算机科学 2026-02-23 Narjes Nourzad , Carlee Joe-Wong

Large Language Model (LLM) based agents are powerful yet fundamentally static after deployment, lacking the ability to autonomously expand capabilities, generate new tools, or evolve their reasoning. This work introduces a hierarchical…

计算与语言 · 计算机科学 2026-01-21 Indrajit Kar , Sammy Zonunpuia , Zonunfeli Ralte

While Large Language Models (LLMs) excel in language-based agentic tasks, their applicability to unseen, nonlinguistic environments (e.g., symbolic or spatial tasks) remains limited. Previous work attributes this performance gap to the…

人工智能 · 计算机科学 2026-02-03 Haoyu Wang , Guozheng Ma , Shugang Cui , Yilun Kong , Haotian Luo , Li Shen , Mengya Gao , Yichao Wu , Xiaogang Wang , Dacheng Tao

Large Language Model (LLM)-based multi-agent systems show promise for automating real-world tasks but struggle to transfer across domains due to their domain-specific nature. Current approaches face two critical shortcomings: they require…

Reinforcement learning (RL) agents improve through trial-and-error, but when reward is sparse and the agent cannot discover successful action sequences, learning stagnates. This has been a notable problem in training deep RL agents to…

人工智能 · 计算机科学 2018-02-27 Evan Zheran Liu , Kelvin Guu , Panupong Pasupat , Tianlin Shi , Percy Liang

Reinforcement learning has become essential for strengthening the reasoning abilities of large language models, yet current exploration mechanisms remain fundamentally misaligned with how these models actually learn. Entropy bonuses and…

机器学习 · 计算机科学 2025-12-18 Zhenwen Liang , Sidi Lu , Wenhao Yu , Kishan Panaganti , Yujun Zhou , Haitao Mi , Dong Yu

Efficient exploration remains a central challenge in reinforcement learning (RL), particularly in sparse-reward environments. We introduce Optimistic World Models (OWMs), a principled and scalable framework for optimistic exploration that…

机器学习 · 计算机科学 2026-02-11 Akshay Mete , Shahid Aamir Sheikh , Tzu-Hsiang Lin , Dileep Kalathil , P. R. Kumar

Long horizon interactive environments are a testbed for evaluating agents skill usage abilities. These environments demand multi step reasoning, the chaining of multiple skills over many timesteps, and robust decision making under delayed…

Large language model (LLM) agents that follow the sequential "reason-then-act" paradigm have achieved superior performance in many complex tasks.However, these methods suffer from limited exploration and incomplete environmental…

计算与语言 · 计算机科学 2026-04-28 Junshuo Zhang , Chengrui Huang , Feng Guo , Zihan Li , Ke Shi , Menghua Jiang , Jiguo Yu , Shuo Shang , Shen Gao