English
Related papers

Related papers: Information Fidelity in Tool-Using LLM Agents: A M…

200 papers

We present M^3-Bench, the first benchmark for evaluating multimodal tool use under the Model Context Protocol. The benchmark targets realistic, multi-hop and multi-threaded workflows that require visual grounding and textual reasoning,…

Artificial Intelligence · Computer Science 2026-02-05 Yang Zhou , Mingyu Zhao , Zhenting Wang , Difei Gu , Bangwei Guo , Ruosong Ye , Ligong Han , Can Jin , Dimitris N. Metaxas

Large Language Models (LLMs) with tool-calling capabilities have demonstrated remarkable potential in executing complex tasks through external tool integration. The Model Context Protocol (MCP) has emerged as a standardized framework for…

Software Engineering · Computer Science 2026-03-24 Sarat Mudunuri , Jian Wan , Ally Qin , Srinivasan Manoharan

Large Language Models (LLMs) are prone to generating fluent but incorrect content, known as confabulation, which poses increasing risks in multi-turn or agentic applications where outputs may be reused as context. In this work, we…

Computation and Language · Computer Science 2026-03-18 Tianyi Zhou , Johanne Medina , Sanjay Chawla

Tool use enables large language models (LLMs) to access external information, invoke software systems, and act in digital environments beyond what can be solved from model parameters alone. Early research mainly studied whether a model…

Recent advances in LLM Multi-Agent Systems enable scalable orchestration of sub-agents, each coordinating hundreds or thousands of tools or Model Context Protocol (MCP) servers. However, existing retrieval methods typically match queries…

Computation and Language · Computer Science 2025-11-05 Elias Lumer , Faheem Nizar , Anmol Gulati , Pradeep Honaganahalli Basavaraju , Vamse Kumar Subbiah

Model Context Protocol (MCP) has become a key infrastructure for connecting LLMs with external tools, scaling to 10,000+ MCP servers with diverse tools. Unfortunately, there is still a large gap between real-world MCP usage and current…

Artificial Intelligence · Computer Science 2026-02-27 Guozhao Mo , Wenliang Zhong , Jiawei Chen , Qianhao Yuan , Xuanang Chen , Yaojie Lu , Hongyu Lin , Ben He , Xianpei Han , Le Sun

LLMs' capabilities are enhanced by using function calls to integrate various data sources or API results into the context window. Typical tools include search, web crawlers, maps, financial data, file systems, and browser usage, etc.…

Artificial Intelligence · Computer Science 2025-08-12 Shiqing Fan , Xichen Ding , Liang Zhang , Linjian Mo

Multi-agent systems represent a significant advancement in artificial intelligence, enabling complex problem-solving through coordinated specialized agents. However, these systems face fundamental challenges in context management,…

Multiagent Systems · Computer Science 2025-05-01 Naveen Krishnan

Machine Translation (MT) plays a pivotal role in cross-lingual information access, public policy communication, and equitable knowledge dissemination. However, critical meaning errors, such as factual distortions, intent reversals, or…

Computation and Language · Computer Science 2026-02-13 Muskaan Chopra , Lorenz Sparrenberg , Rafet Sifa

Diffusion models have emerged as a powerful paradigm for modern generative modeling, demonstrating strong potential for large language models (LLMs). Unlike conventional autoregressive (AR) models that generate tokens sequentially,…

Machine Learning · Computer Science 2026-01-09 Gen Li , Changxiao Cai

The rise of tool-using Large Language Model (LLM) agents, standardized by protocols like the Model Context Protocol (MCP), has unlocked unprecedented autonomous execution capabilities for LLM Agents by integrating external open-domain…

Cryptography and Security · Computer Science 2026-05-26 Shi Liu , Xuehai Tang , Xikang Yang , Liang Lin , Biyu Zhou , Wenjie Xiao , Wantao Liu

While Large Language Models (LLMs) have achieved remarkable performance, they remain vulnerable to jailbreak. The integration of Large Language Models (LLMs) with external tools via protocols such as the Model Context Protocol (MCP)…

Cryptography and Security · Computer Science 2026-01-09 Wenpeng Xing , Zhonghao Qi , Yupeng Qin , Yilin Li , Caini Chang , Jiahui Yu , Changting Lin , Zhenzhen Xie , Meng Han

The Model Context Protocol (MCP) enables Large Language Models (LLMs) to interact with external tools via tool descriptors, thereby extending their capabilities for task execution, autonomous decision-making, and multi-agent coordination.…

Cryptography and Security · Computer Science 2026-05-22 Saeid Jamshidi , Arghavan Moradi Dakhel , Kawser Wazed Nafi , Foutse Khomh

Large-scale telecom and datacenter infrastructures rely on multi-layered service and resource models, where failures propagate across physical and logical components and affect multiple customers. Traditional approaches to root cause…

Artificial Intelligence · Computer Science 2026-01-13 Nicolas Tacheny

Automated evaluation of tool-using large language model (LLM) agents is widely assumed to be reliable, but this assumption has rarely been validated against human annotation. We introduce AgentProp-Bench, a 2,000-task benchmark with 2,300…

Artificial Intelligence · Computer Science 2026-04-21 Bhaskar Gurram

Recent improvements in large language models (LLMs) have had a dramatic effect on capabilities and productivity across many disciplines involving critical thinking and writing. The development of the model context protocol (MCP) provides a…

Agentic AI systems built around large language models (LLMs) are moving away from closed, single-model frameworks and toward open ecosystems that connect a variety of agents, external tools, and resources. The Model Context Protocol (MCP)…

Cryptography and Security · Computer Science 2026-02-03 Xinyi Hou , Shenao Wang , Yifan Zhang , Ziluo Xue , Yanjie Zhao , Cai Fu , Haoyu Wang

Large Language Models (LLMs) have revolutionized Natural Language Processing but exhibit limitations, particularly in autonomously addressing novel challenges such as reasoning and problem-solving. Traditional techniques like…

Multiagent Systems · Computer Science 2024-01-03 Sumedh Rasal

Self-evolving large language model (LLM) agents continually improve by accumulating and reusing past experience, yet it remains unclear whether they faithfully rely on that experience to guide their behavior. We present the first systematic…

Computation and Language · Computer Science 2026-02-10 Weixiang Zhao , Yingshuo Wang , Yichen Zhang , Yang Deng , Yanyan Zhao , Wanxiang Che , Bing Qin , Ting Liu

Large Language Model (LLM) agents, which integrate planning, memory, reflection, and tool-use modules, have shown promise in solving complex, multi-step tasks. Yet their sophisticated architectures amplify vulnerability to cascading…