English
Related papers

Related papers: Which LLM Multi-Agent Protocol to Choose?

200 papers

With the rapid development of LLM-based agents, there is a growing trend to incorporate agent-specific data into the pre-training stage of LLMs, aiming to better align LLMs with real-world autonomous task execution. However, current…

Artificial Intelligence · Computer Science 2025-10-29 Jiarui Qin , Yunjia Xi , Junjie Huang , Renting Rui , Di Yin , Weiwen Liu , Yong Yu , Weinan Zhang , Xing Sun

Routing large language models (LLMs) is a new paradigm that uses a router to recommend the best LLM from a pool of candidates for a given input. In this paper, our comprehensive analysis with more than 8,500 LLMs reveals a novel model-level…

Computation and Language · Computer Science 2025-05-21 Zhongzhan Huang , Guoming Ling , Yupei Lin , Yandong Chen , Shanshan Zhong , Hefeng Wu , Liang Lin

Nowadays distributed computing approach has become very popular due to several advantages over the centralized computing approach as it also offers high performance computing at a very low cost. Each router implements some queuing mechanism…

Networking and Internet Architecture · Computer Science 2019-10-10 Taskeen Zaidi , Nitya Nand Dwivedi

Large language model (LLM) agents have exhibited strong problem-solving competence across domains like research and coding. Yet, it remains underexplored whether LLM agents can tackle compounding real-world problems that require a diverse…

Artificial Intelligence · Computer Science 2025-11-04 Hanwen Xu , Xuyao Huang , Yuzhe Liu , Kai Yu , Zhijie Deng

Personalized mobile agents that infer user preferences and calibrate proactive assistance hold great promise as everyday digital assistants, yet existing benchmarks fail to capture what this requires. Prior work evaluates preference…

Agent orchestration frameworks have proliferated, collectively exceeding 290,000 GitHub stars across LangGraph, CrewAI, Google ADK, OpenAI Agents SDK, Semantic Kernel, Strands, and LlamaIndex. All follow the same pattern: an external…

Artificial Intelligence · Computer Science 2026-05-22 Simon Dennis , Rivaan Patil , Kevin Shabahang , Hao Guo

Cooperative multi-agent methods for embodied AI are almost universally evaluated under idealized communication: zero latency, no packet loss, and unlimited bandwidth. Real-world deployment on robots with wireless links, autonomous vehicles…

Artificial Intelligence · Computer Science 2026-03-24 Aayam Bansal , Ishaan Gangwani

Large language model (LLM)-based agents are increasingly applied to complex strategic environments that demand long-horizon reasoning, multi-agent interaction, and decision-making under uncertainty. However, common existing benchmarks…

Artificial Intelligence · Computer Science 2026-05-12 Wenjie Tang , Yuan Zhou , Erqiang Xu , Keyan Cheng , Minne Li , Liquan Xiao

Current AI agents excel in familiar settings, but fail sharply when faced with novel tasks with unseen vocabularies -- a core limitation of procedural memory systems. We present the first benchmark that isolates procedural memory retrieval…

Computation and Language · Computer Science 2025-12-01 Ishant Kohar , Aswanth Krishnan

Disasters cause severe societal impacts, demanding rapid coordination of heterogeneous AI tools, from satellite analysis to flood prediction and damage assessment, into coherent multi-step workflows. As LLMs increasingly serve as…

Computation and Language · Computer Science 2026-05-28 Zhitong Chen , Kai Yin , Weifeng Zhang , Zhiyuan Wang , Xiangjue Dong , Chengkai Liu , Zhewei Liu , Yiming Xiao , Ali Mostafavi , James Caverlee

As large language models (LLMs) are increasingly deployed as agents, their integration into interactive environments and tool use introduce new safety challenges beyond those associated with the models themselves. However, the absence of…

Computation and Language · Computer Science 2025-05-21 Zhexin Zhang , Shiyao Cui , Yida Lu , Jingzhuo Zhou , Junxiao Yang , Hongning Wang , Minlie Huang

Efficient agentic systems should incur expensive frontier-model costs only on decisions where a cheaper local model is likely to fail. Existing LLM cascades usually route whole queries before execution, but task difficulty shifts…

Large Language Models (LLMs), such as OpenAI-o1 and DeepSeek-R1, have demonstrated strong reasoning capabilities. To further enhance LLM capabilities, recent agentic systems, such as Deep Research, incorporate web interactions into LLM…

Artificial Intelligence · Computer Science 2025-10-21 Song Bian , Minghao Yan , Anand Jayarajan , Gennady Pekhimenko , Shivaram Venkataraman

Multi-model routing has evolved from an engineering technique into essential infrastructure, yet existing work lacks a systematic, reproducible benchmark for evaluating vision-language models (VLMs). We present VL-RouterBench to assess the…

Machine Learning · Computer Science 2026-03-19 Zhehao Huang , Baijiong Lin , Jingyuan Zhang , Jingying Wang , Yuhang Liu , Ning Lu , Tao Li , Xiaolin Huang

Agentic systems are evaluated on benchmarks where agents interact with environments to solve tasks. Most papers report a pass@1 score computed from a single run per task, assuming this gives a reliable performance estimate. We test this…

Machine Learning · Computer Science 2026-03-26 Bjarni Haukur Bjarnason , André Silva , Martin Monperrus

Rapidly evolving cyberattacks demand incident response systems that can autonomously learn and adapt to changing threats. Prior work has extensively explored the reinforcement learning approach, which involves learning response strategies…

Cryptography and Security · Computer Science 2026-04-16 Yiran Gao , Kim Hammar , Tao Li

These days MANET is an amazing remarkably altering or rising technology, for the reason that of its elite nature of scattered mobile devices and self motivated network topology. The mobile adhoc routing protocol follows several principles…

Networking and Internet Architecture · Computer Science 2014-04-14 Sohail Abid , Shahab Khan

Industrial automation increasingly requires flexible control strategies that can adapt to changing tasks and environments. Agents based on Large Language Models (LLMs) offer potential for such adaptive planning and execution but lack…

Artificial Intelligence · Computer Science 2025-12-04 Niklas Jobs , Luis Miguel Vieira da Silva , Jayanth Somashekaraiah , Maximilian Weigand , David Kube , Felix Gehlhoff

Travel planning is a realistic task for evaluating the planning and tool-use abilities of LLM agents. However, existing benchmarks typically assume only a single user, thereby avoiding one of the most challenging aspects of real-world…

Computation and Language · Computer Science 2026-05-26 Xiang Cheng , Yulan Hu , Lulu Zheng , Zheng Pan , Xin Li , Yong Liu

One fundamental challenge in 5G URLLC is how to optimize massive MIMO systems for achieving low latency and high reliability. A natural design choice to maximize reliability and minimize retransmission is to select the lowest allowed target…

Information Theory · Computer Science 2024-10-30 Xu Du , Yin Sun , Ness B. Shroff , Ashutosh Sabharwal