中文
相关论文

相关论文: Evaluating Language-Model Agents on Realistic Auto…

200 篇论文

Recent efforts have augmented large language models (LLMs) with external resources (e.g., the Internet) or internal control flows (e.g., prompt chaining) for tasks requiring grounding or reasoning, leading to a new class of language agents.…

人工智能 · 计算机科学 2024-03-18 Theodore R. Sumers , Shunyu Yao , Karthik Narasimhan , Thomas L. Griffiths

Before taking actions in an environment with more than one intelligent agent, an autonomous agent may benefit from reasoning about the other agents and utilizing a notion of a guarantee or confidence about the behavior of the system. In…

机器学习 · 计算机科学 2024-02-12 Nikunj Gupta , Somjit Nath , Samira Ebrahimi Kahou

The rapid evolution of Large Language Model (LLM) agents has necessitated robust memory systems to support cohesive long-term interaction and complex reasoning. Benefiting from the strong capabilities of LLMs, recent research focus has…

人工智能 · 计算机科学 2026-04-16 Weiquan Huang , Zixuan Wang , Hehai Lin , Sudong Wang , Bo Xu , Qian Li , Beier Zhu , Linyi Yang , Chengwei Qin

As language model (LM) agents become increasingly capable and adopted in real-world applications, there is a growing need for scalable evaluation frameworks beyond costly, manually designed benchmarks. We propose information-theoretic…

人工智能 · 计算机科学 2026-05-29 Jinyeop Song , Jeff Gore , Max Kleiman-Weiner

Entity relationship classification remains a challenging task in information extraction, especially in scenarios with limited labeled data and complex relational structures. In this study, we conduct a comparative analysis of three distinct…

计算与语言 · 计算机科学 2026-03-24 Maryam Berijanian , Kuldeep Singh , Amin Sehati

Autonomous agent systems powered by Large Language Models (LLMs) have demonstrated promising capabilities in automating complex tasks. However, current evaluations largely rely on success rates without systematically analyzing the…

人工智能 · 计算机科学 2025-08-19 Ruofan Lu , Yichen Li , Yintong Huo

Large Language Models (LLMs) offer a promising basis for creating agents that can tackle complex tasks through iterative environmental interaction. Existing methods either require these agents to mimic expert-provided trajectories or rely…

计算与语言 · 计算机科学 2024-12-02 Dihong Gong , Pu Lu , Zelong Wang , Meng Zhou , Xiuqiang He

We present Dynamic Skill Adaptation (DSA), an adaptive and dynamic framework to adapt novel and complex skills to Large Language Models (LLMs). Compared with previous work which learns from human-curated and static data in random orders, we…

计算与语言 · 计算机科学 2024-12-30 Jiaao Chen , Diyi Yang

Large language models can perform well on many isolated tasks, yet they continue to struggle on multi-turn, long-horizon agentic problems that require skills such as planning, state tracking, and long context processing. In this work, we…

We show that large language models (LLMs) can be adapted to be generalizable policies for embodied visual tasks. Our approach, called Large LAnguage model Reinforcement Learning Policy (LLaRP), adapts a pre-trained frozen LLM to take as…

Agents built on vision-language models increasingly face tasks that demand anticipating future states rather than relying on short-horizon reasoning. Generative world models offer a promising remedy: agents could use them as external…

An agent trained within a closed system can master any desired capability, as long as the following three conditions hold: (a) it receives sufficiently informative and aligned feedback, (b) its coverage of experience/data is broad enough,…

人工智能 · 计算机科学 2024-11-27 Tom Schaul

We attempt to solve the Abstraction and Reasoning Corpus (ARC) Challenge using Large Language Models (LLMs) as a system of multiple expert agents. Using the flexibility of LLMs to be prompted to do various novel tasks using zero-shot,…

人工智能 · 计算机科学 2023-10-10 John Chong Min Tan , Mehul Motani

Agentic systems operating over large tool ecosystems must plan and execute long-horizon workflows under weak or non-verifiable supervision. While frontier models mitigate these challenges through scale and large context budgets, small…

机器学习 · 计算机科学 2026-03-10 Karan Gupta , Pranav Vajreshwari , Yash Pandya , Raghav Magazine , Akshay Nambi , Ahmed Awadallah

Imitation learning enables autonomous agents to learn from human examples, without the need for a reward signal. Still, if the provided dataset does not encapsulate the task correctly, or when the task is too complex to be modeled, such…

人工智能 · 计算机科学 2024-06-10 Federico Malato , Ville Hautamaki

Practical mechanisms often limit agent reports to constrained formats like trades or orderings, potentially limiting the information agents can express. We propose a novel class of mechanisms that elicit agent reports in natural language…

计算机科学与博弈论 · 计算机科学 2024-07-11 Nicolas Della Penna

The application of artificial intelligence (AI) in industry is accelerating the shift from traditional automation to intelligent systems with perception and cognition. Vision language-action (VLA) models have been a key paradigm in AI to…

人工智能 · 计算机科学 2025-09-30 Shuai Li , Chen Yizhe , Li Dong , Liu Sichao , Lan Dapeng , Liu Yu , Zhibo Pang

Recently, we have proposed a framework for verification of agents' abilities in asynchronous multi-agent systems, together with an algorithm for automated reduction of models. The semantics was built on the modeling tradition of distributed…

计算机科学中的逻辑 · 计算机科学 2025-01-22 Wojciech Jamroga , Wojciech Penczek , Teofil Sidoruk

Current language models are considered to have sub-human capabilities at natural language tasks like question-answering or writing code. However, language models are not trained to perform well at these tasks, they are trained to accurately…

计算与语言 · 计算机科学 2024-07-16 Buck Shlegeris , Fabien Roger , Lawrence Chan , Euan McLean

Autonomous agents in safety-critical applications must continuously adapt to dynamic conditions without compromising performance and reliability. This work introduces TAPA (Training-free Adaptation of Programmatic Agents), a novel framework…

多智能体系统 · 计算机科学 2025-11-25 Jinwei Hu , Yi Dong , Youcheng Sun , Xiaowei Huang