English
Related papers

Related papers: Stop Comparing LLM Agents Without Disclosing the H…

200 papers

Large language models (LLMs) are being widely applied across various fields, but as tasks become more complex, evaluating their responses is increasingly challenging. Compared to human evaluators, the use of LLMs to support performance…

Artificial Intelligence · Computer Science 2025-04-25 Yuran Li , Jama Hussein Mohamud , Chongren Sun , Di Wu , Benoit Boulet

As AI agents built on large language models (LLMs) become increasingly embedded in society, issues of coordination, control, delegation, and accountability are entangled with concerns over their reliability. To design and implement LLM…

Computers and Society · Computer Science 2025-12-09 R. Patrick Xian , Garry A. Gabison , Ahmed Alaa , Christoph Riedl , Grigorios G. Chrysos

Multi-agent large language models (MA-LLMs) are a rapidly growing research area that leverages multiple interacting language agents to tackle complex tasks, outperforming single-agent large language models. This literature review…

Multiagent Systems · Computer Science 2025-06-03 Arne Tillmann

Large language model (LLM) agents are fundamentally constrained by context length on long-horizon tasks. We introduce Context-Folding, a framework that empowers agents to actively manage their working context. An agent can procedurally…

Computation and Language · Computer Science 2025-10-15 Weiwei Sun , Miao Lu , Zhan Ling , Kang Liu , Xuesong Yao , Yiming Yang , Jiecao Chen

AI agents are increasingly deployed on complex, domain-specific workflows -- navigating enterprise web applications that require dozens of clicks and form fills, orchestrating multi-step research pipelines that span search, extraction, and…

Artificial Intelligence · Computer Science 2026-05-05 Haebin Seong , Li Yin , Haoran Zhang , Zhan Shi

We introduce a novel non-cooperative game to analyse opinion formation and resistance, incorporating principles from social psychology such as confirmation bias, resource constraints, and influence penalties. Our simulation features Large…

Artificial Intelligence · Computer Science 2025-09-03 Amin Qasmi , Usman Naseem , Mehwish Nasim

Agents based on Large Language Models (LLMs) are increasingly being deployed as interfaces to information on online platforms. These agents filter, prioritize, and synthesize information retrieved from the platforms' back-end databases or…

Computation and Language · Computer Science 2026-02-18 Mohammad Aflah Khan , Mahsa Amani , Soumi Das , Bishwamittra Ghosh , Qinyuan Wu , Krishna P. Gummadi , Manish Gupta , Abhilasha Ravichander

Adapting Large Language Models in complex technical service domains is constrained by the absence of explicit cognitive chains in human demonstrations and the inherent ambiguity arising from the diversity of valid responses. These…

Existing benchmarks measure capability -- whether a model succeeds on a single attempt -- but production deployments require reliability -- consistent success across repeated attempts on tasks of varying duration. We show these properties…

Artificial Intelligence · Computer Science 2026-04-01 Aaditya Khanal , Yangyang Tao , Junxiu Zhou

Recent advances in agentic harness with orchestration frameworks that coordinate multiple agents with memory, skills, and tool use have achieved remarkable success in complex reasoning tasks. However, the underlying mechanism that truly…

Artificial Intelligence · Computer Science 2026-05-05 Jianing Wang , Linsen Guo , Zhengyu Chen , Qi Guo , Hongyu Zang , Wenjie Shi , Haoxiang Ma , Xiangyu Xi , Xiaoyu Li , Wei Wang , Xunliang Cai

Large language models (LLMs) are increasingly capable of carrying out long-running, real-world tasks. However, as the amount of context grows, their reliability often deteriorates, a phenomenon known as "context rot". Existing long-context…

Artificial Intelligence · Computer Science 2026-02-10 Weihao Zeng , Yuzhen Huang , Junxian He

Recent advances in mathematical reasoning and the long-term planning capabilities of large language models (LLMs) have precipitated the development of agents, which are being increasingly leveraged in business operations processes. Decision…

Artificial Intelligence · Computer Science 2025-08-18 Xuhua Zhao , Yuxuan Xie , Caihua Chen , Yuxiang Sun

RLHF-aligned LMs have shown unprecedented ability on both benchmarks and long-form text generation, yet they struggle with one foundational task: next-token prediction. As RLHF models become agent models aimed at interacting with humans,…

Computation and Language · Computer Science 2024-07-03 Margaret Li , Weijia Shi , Artidoro Pagnoni , Peter West , Ari Holtzman

Large language models (LLMs) are increasingly being deployed as autonomous agents on behalf of institutions and individuals in economic, political, and social settings that involve negotiation. Yet this trend carries significant risks if…

Computer Science and Game Theory · Computer Science 2025-12-19 Manuel S. Ríos , Ruben F. Manrique , Nicanor Quijano , Luis F. Giraldo

Multi-agent systems based on large language models (LLMs) for financial trading have grown rapidly since 2023, yet the field lacks a shared framework for understanding what drives performance or for evaluating claims credibly. This survey…

Multiagent Systems · Computer Science 2026-03-31 Phat Nguyen , Thang Pham

The rapid adoption of LLM-based agentic systems has produced a rich ecosystem of frameworks (smolagents, LangGraph, AutoGen, CAMEL, LlamaIndex, i.a.). Yet existing benchmarks are model-centric: they fix the agentic setup and do not compare…

Artificial Intelligence · Computer Science 2026-03-11 Cornelius Emde , Alexander Rubinstein , Anmol Goel , Ahmed Heakl , Sangdoo Yun , Seong Joon Oh , Martin Gubri

Most vision-language models (VLMs) apply a large language model (LLM) as the decoder, where the response tokens are generated sequentially through autoregression. Therefore, the number of output tokens can be the bottleneck of the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Sixun Dong , Juhua Hu , Steven Li , Wei Wen , Qi Qian

As foundation models are increasingly deployed as interacting agents in multi-agent systems, their collective behavior raises new challenges for trustworthiness, transparency, and accountability. Traditional coordination mechanisms, such as…

Multiagent Systems · Computer Science 2026-02-24 Brendan Gho , Suman Muppavarapu , Afnan Shaik , Tyson Tsay , Atharva Mohan , James Begin , Kevin Zhu , Archana Vaidheeswaran , Vasu Sharma

Large language models (LLMs) often expose useful signals of self-monitoring: before solving a problem, they can estimate whether they are likely to succeed, and after solving it, they can judge whether their answer is likely to be correct.…

Machine Learning · Computer Science 2026-05-15 Qi Cao , Yufan Wang , Peijia Qin , Shuhao Zhang , Pengtao Xie

Given the growing influence of language model-based agents on high-stakes societal decisions, from public policy to healthcare, ensuring their beneficial impact requires understanding the far-reaching implications of their suggestions. We…

Artificial Intelligence · Computer Science 2025-06-27 Chenkai Sun , Denghui Zhang , ChengXiang Zhai , Heng Ji
‹ Prev 1 4 5 6 7 8 10 Next ›