中文
相关论文

相关论文: Stop Comparing LLM Agents Without Disclosing the H…

200 篇论文

Large language models (LLMs) are being widely applied across various fields, but as tasks become more complex, evaluating their responses is increasingly challenging. Compared to human evaluators, the use of LLMs to support performance…

人工智能 · 计算机科学 2025-04-25 Yuran Li , Jama Hussein Mohamud , Chongren Sun , Di Wu , Benoit Boulet

As AI agents built on large language models (LLMs) become increasingly embedded in society, issues of coordination, control, delegation, and accountability are entangled with concerns over their reliability. To design and implement LLM…

计算机与社会 · 计算机科学 2025-12-09 R. Patrick Xian , Garry A. Gabison , Ahmed Alaa , Christoph Riedl , Grigorios G. Chrysos

Multi-agent large language models (MA-LLMs) are a rapidly growing research area that leverages multiple interacting language agents to tackle complex tasks, outperforming single-agent large language models. This literature review…

多智能体系统 · 计算机科学 2025-06-03 Arne Tillmann

Large language model (LLM) agents are fundamentally constrained by context length on long-horizon tasks. We introduce Context-Folding, a framework that empowers agents to actively manage their working context. An agent can procedurally…

计算与语言 · 计算机科学 2025-10-15 Weiwei Sun , Miao Lu , Zhan Ling , Kang Liu , Xuesong Yao , Yiming Yang , Jiecao Chen

AI agents are increasingly deployed on complex, domain-specific workflows -- navigating enterprise web applications that require dozens of clicks and form fills, orchestrating multi-step research pipelines that span search, extraction, and…

人工智能 · 计算机科学 2026-05-05 Haebin Seong , Li Yin , Haoran Zhang , Zhan Shi

We introduce a novel non-cooperative game to analyse opinion formation and resistance, incorporating principles from social psychology such as confirmation bias, resource constraints, and influence penalties. Our simulation features Large…

人工智能 · 计算机科学 2025-09-03 Amin Qasmi , Usman Naseem , Mehwish Nasim

Agents based on Large Language Models (LLMs) are increasingly being deployed as interfaces to information on online platforms. These agents filter, prioritize, and synthesize information retrieved from the platforms' back-end databases or…

Adapting Large Language Models in complex technical service domains is constrained by the absence of explicit cognitive chains in human demonstrations and the inherent ambiguity arising from the diversity of valid responses. These…

Existing benchmarks measure capability -- whether a model succeeds on a single attempt -- but production deployments require reliability -- consistent success across repeated attempts on tasks of varying duration. We show these properties…

人工智能 · 计算机科学 2026-04-01 Aaditya Khanal , Yangyang Tao , Junxiu Zhou

Recent advances in agentic harness with orchestration frameworks that coordinate multiple agents with memory, skills, and tool use have achieved remarkable success in complex reasoning tasks. However, the underlying mechanism that truly…

人工智能 · 计算机科学 2026-05-05 Jianing Wang , Linsen Guo , Zhengyu Chen , Qi Guo , Hongyu Zang , Wenjie Shi , Haoxiang Ma , Xiangyu Xi , Xiaoyu Li , Wei Wang , Xunliang Cai

Large language models (LLMs) are increasingly capable of carrying out long-running, real-world tasks. However, as the amount of context grows, their reliability often deteriorates, a phenomenon known as "context rot". Existing long-context…

人工智能 · 计算机科学 2026-02-10 Weihao Zeng , Yuzhen Huang , Junxian He

Recent advances in mathematical reasoning and the long-term planning capabilities of large language models (LLMs) have precipitated the development of agents, which are being increasingly leveraged in business operations processes. Decision…

人工智能 · 计算机科学 2025-08-18 Xuhua Zhao , Yuxuan Xie , Caihua Chen , Yuxiang Sun

RLHF-aligned LMs have shown unprecedented ability on both benchmarks and long-form text generation, yet they struggle with one foundational task: next-token prediction. As RLHF models become agent models aimed at interacting with humans,…

计算与语言 · 计算机科学 2024-07-03 Margaret Li , Weijia Shi , Artidoro Pagnoni , Peter West , Ari Holtzman

Large language models (LLMs) are increasingly being deployed as autonomous agents on behalf of institutions and individuals in economic, political, and social settings that involve negotiation. Yet this trend carries significant risks if…

计算机科学与博弈论 · 计算机科学 2025-12-19 Manuel S. Ríos , Ruben F. Manrique , Nicanor Quijano , Luis F. Giraldo

Multi-agent systems based on large language models (LLMs) for financial trading have grown rapidly since 2023, yet the field lacks a shared framework for understanding what drives performance or for evaluating claims credibly. This survey…

多智能体系统 · 计算机科学 2026-03-31 Phat Nguyen , Thang Pham

The rapid adoption of LLM-based agentic systems has produced a rich ecosystem of frameworks (smolagents, LangGraph, AutoGen, CAMEL, LlamaIndex, i.a.). Yet existing benchmarks are model-centric: they fix the agentic setup and do not compare…

人工智能 · 计算机科学 2026-03-11 Cornelius Emde , Alexander Rubinstein , Anmol Goel , Ahmed Heakl , Sangdoo Yun , Seong Joon Oh , Martin Gubri

Most vision-language models (VLMs) apply a large language model (LLM) as the decoder, where the response tokens are generated sequentially through autoregression. Therefore, the number of output tokens can be the bottleneck of the…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Sixun Dong , Juhua Hu , Steven Li , Wei Wen , Qi Qian

As foundation models are increasingly deployed as interacting agents in multi-agent systems, their collective behavior raises new challenges for trustworthiness, transparency, and accountability. Traditional coordination mechanisms, such as…

Large language models (LLMs) often expose useful signals of self-monitoring: before solving a problem, they can estimate whether they are likely to succeed, and after solving it, they can judge whether their answer is likely to be correct.…

机器学习 · 计算机科学 2026-05-15 Qi Cao , Yufan Wang , Peijia Qin , Shuhao Zhang , Pengtao Xie

Given the growing influence of language model-based agents on high-stakes societal decisions, from public policy to healthcare, ensuring their beneficial impact requires understanding the far-reaching implications of their suggestions. We…

人工智能 · 计算机科学 2025-06-27 Chenkai Sun , Denghui Zhang , ChengXiang Zhai , Heng Ji