中文
相关论文

相关论文: Evaluating Language-Model Agents on Realistic Auto…

200 篇论文

Large Language Model (LLM) based agents have proved their ability to perform complex tasks like humans. However, there is still a large gap between open-sourced LLMs and commercial models like the GPT series. In this paper, we focus on…

人工智能 · 计算机科学 2025-02-25 Dayuan Fu , Keqing He , Yejie Wang , Wentao Hong , Zhuoma Gongque , Weihao Zeng , Wei Wang , Jingang Wang , Xunliang Cai , Weiran Xu

Agent-based modeling and simulation has evolved as a powerful tool for modeling complex systems, offering insights into emergent behaviors and interactions among diverse agents. Integrating large language models into agent-based modeling…

人工智能 · 计算机科学 2023-12-20 Chen Gao , Xiaochong Lan , Nian Li , Yuan Yuan , Jingtao Ding , Zhilun Zhou , Fengli Xu , Yong Li

Remarkable performance of large language models (LLMs) in a variety of tasks brings forth many opportunities as well as challenges of utilizing them in production settings. Towards practical adoption of LLMs, multi-agent systems hold great…

计算与语言 · 计算机科学 2024-02-05 Pouya Pezeshkpour , Eser Kandogan , Nikita Bhutani , Sajjadur Rahman , Tom Mitchell , Estevam Hruschka

We posit that to achieve superhuman agents, future models require superhuman feedback in order to provide an adequate training signal. Current approaches commonly train reward models from human preferences, which may then be bottlenecked by…

计算与语言 · 计算机科学 2025-03-31 Weizhe Yuan , Richard Yuanzhe Pang , Kyunghyun Cho , Xian Li , Sainbayar Sukhbaatar , Jing Xu , Jason Weston

Humans are highly effective at utilizing prior knowledge to adapt to novel tasks, a capability that standard machine learning models struggle to replicate due to their reliance on task-specific training. Meta-learning overcomes this…

人工智能 · 计算机科学 2026-05-07 Björn Hoppmann , Christoph Scholz

LLM agents are increasingly deployed to plan, retrieve, and write with tools, yet evaluation still leans on static benchmarks and small human studies. We present the Agent-Testing Agent (ATA), a meta-agent that combines static code…

计算与语言 · 计算机科学 2025-08-26 Sameer Komoravolu , Khalil Mrini

The field of artificial intelligence (AI) agents is evolving rapidly, driven by the capabilities of Large Language Models (LLMs) to autonomously perform and refine tasks with human-like efficiency and adaptability. In this context,…

统计金融 · 定量金融 2025-08-18 Tianjiao Zhao , Jingrao Lyu , Stokes Jones , Harrison Garber , Stefano Pasquali , Dhagash Mehta

Reinforcement Learning (RL) has emerged as a crucial method for training or fine-tuning large language models (LLMs), enabling adaptive, task-specific optimizations through interactive feedback. Multi-Agent Reinforcement Learning (MARL), in…

机器学习 · 计算机科学 2026-02-10 Junwei Su , Chuan Wu

We present Adaptive Minds, an agentic system that treats LoRA adapters as domain-specific tools. Instead of relying on a single fine-tuned model or rigid rule-based routing, our approach empowers the base LLM itself to act as a semantic…

人工智能 · 计算机科学 2025-10-20 Pavan C Shekar , Ashwanth Krishnan

The era of intelligent agents is upon us, driven by revolutionary advancements in large language models. Large Language Model (LLM) agents, with goal-driven behaviors and dynamic adaptation capabilities, potentially represent a critical…

Human intelligence's adaptability is remarkable, allowing us to adjust to new tasks and multi-modal environments swiftly. This skill is evident from a young age as we acquire new abilities and solve problems by imitating others or following…

Language models (LMs) are sentence-completion engines trained on massive corpora. LMs have emerged as a significant breakthrough in natural-language processing, providing capabilities that go far beyond sentence completion including…

人工智能 · 计算机科学 2021-10-26 Robert E. Wray , III , James R. Kirk , John E. Laird

The recent explosion of question answering (QA) datasets and models has increased the interest in the generalization of models across multiple domains and formats by either training on multiple datasets or by combining multiple models.…

计算与语言 · 计算机科学 2023-02-08 Haritz Puerto , Gözde Gül Şahin , Iryna Gurevych

Answering Questions over Knowledge Graphs (KGQA) is key to well-functioning autonomous language agents in various real-life applications. To improve the neural-symbolic reasoning capabilities of language agents powered by Large Language…

计算与语言 · 计算机科学 2024-06-12 Haishuo Fang , Xiaodan Zhu , Iryna Gurevych

Large pretrained models are showing increasingly better performance in reasoning and planning tasks across different modalities, opening the possibility to leverage them for complex sequential decision making problems. In this paper, we…

人工智能 · 计算机科学 2024-10-10 Martin Klissarov , Devon Hjelm , Alexander Toshev , Bogdan Mazoure

Agentic systems have transformed how Large Language Models (LLMs) can be leveraged to create autonomous systems with goal-directed behaviors, consisting of multi-step planning and the ability to interact with different environments. These…

Language models (LMs) are often expected to generate strings in some formal language; for example, structured data, API calls, or code snippets. Although LMs can be tuned to improve their adherence to formal syntax, this does not guarantee…

计算与语言 · 计算机科学 2024-08-06 Terry Koo , Frederick Liu , Luheng He

Despite the impressive performance recently achieved by automatic speech recognition (ASR), we observe two primary challenges that hinder its broader applications: (1) The difficulty of introducing scalability into the model to support more…

音频与语音处理 · 电气工程与系统科学 2023-06-29 Zhongzhi Yu , Yang Zhang , Kaizhi Qian , Yonggan Fu , Yingyan Lin

As language models (LMs) are used to build autonomous agents in real environments, ensuring their adversarial robustness becomes a critical challenge. Unlike chatbots, agents are compound systems with multiple components taking actions,…

机器学习 · 计算机科学 2025-02-06 Chen Henry Wu , Rishi Shah , Jing Yu Koh , Ruslan Salakhutdinov , Daniel Fried , Aditi Raghunathan

We introduce an autonomous multiagent framework for mechanistic interpretability that automates both explaining and finding internal features in large language models. The system runs two coupled loops: (1) explanation refinement, where an…

计算与语言 · 计算机科学 2026-05-05 Arnau Marin-Llobet , Javier Ferrando