English
Related papers

Related papers: PHMForge: Evaluating LLM Agents on Industrial Prog…

200 papers

Current LLM agents are proficient at calling isolated APIs but struggle with the "last mile" of commercial software automation. In real-world scenarios, tools are not independent; they are atomic, interdependent, and prone to environmental…

Artificial Intelligence · Computer Science 2026-05-21 Yuanyang Li , Xue Yang , Longyue Wang , Weihua Luo , Hongyang Chen

Model Context Protocol (MCP) has become a key infrastructure for connecting LLMs with external tools, scaling to 10,000+ MCP servers with diverse tools. Unfortunately, there is still a large gap between real-world MCP usage and current…

Artificial Intelligence · Computer Science 2026-02-27 Guozhao Mo , Wenliang Zhong , Jiawei Chen , Qianhao Yuan , Xuanang Chen , Yaojie Lu , Hongyu Lin , Ben He , Xianpei Han , Le Sun

Recent advancements in Large Language Models (LLMs) and the introduction of the Model Context Protocol (MCP) have significantly expanded LLM agents' capability to interact dynamically with external tools and APIs. However, existing tool…

Computation and Language · Computer Science 2025-05-13 Elias Lumer , Anmol Gulati , Vamse Kumar Subbiah , Pradeep Honaganahalli Basavaraju , James A. Burke

The Model Context Protocol (MCP) standardizes how large language model (LLM) agents discover, describe, and call external tools. While MCP unlocks broad interoperability, it also enlarges the attack surface by making tools first-class,…

Cryptography and Security · Computer Science 2026-03-25 Dongsen Zhang , Zekun Li , Xu Luo , Xuannan Liu , Peipei Li , Wenjun Xu

LLMs' capabilities are enhanced by using function calls to integrate various data sources or API results into the context window. Typical tools include search, web crawlers, maps, financial data, file systems, and browser usage, etc.…

Artificial Intelligence · Computer Science 2025-08-12 Shiqing Fan , Xichen Ding , Liang Zhang , Linjian Mo

The Model Context Protocol (MCP) standardizes how AI agents discover and invoke external tools, with over 10,000 active servers and 97 million monthly SDK downloads as of early 2026. Yet MCP does not yet standardize how agents safely…

Software Engineering · Computer Science 2026-04-16 Vasundra Srinivasan

Since the introduction of the Model Context Protocol (MCP), the number of available tools for Large Language Models (LLMs) has increased significantly. These task-specific tool sets offer an alternative to general-purpose tools such as web…

Computation and Language · Computer Science 2025-12-12 Reza Esfandiarpoor , Vishwas Suryanarayanan , Stephen H. Bach , Vishal Chowdhary , Anthony Aue

As AI agents powered by large language models (LLMs) increasingly use external tools for high-stakes decisions, a critical reliability question arises: how do errors propagate across sequential tool calls? We introduce the first theoretical…

Artificial Intelligence · Computer Science 2026-02-17 Flint Xiaofeng Fan , Cheston Tan , Roger Wattenhofer , Yew-Soon Ong

As Large Language Models (LLMs) evolve from passive text generators to active reasoning agents capable of interacting with external tools, the Model Context Protocol (MCP) has emerged as a key standardized framework for dynamic tool…

Artificial Intelligence · Computer Science 2025-10-14 Xuanqi Gao , Siyi Xie , Juan Zhai , Shiqing Ma , Chao Shen

Tool calling has emerged as a critical capability for AI agents. In contrast to conventional tool calling frameworks that rely on static, provider-specific tool definitions, the Model Context Protocol (MCP) offers a unified interface to…

Model Context Protocol (MCP) is increasingly adopted for tool-integrated LLM agents, but its multi-layer design and third-party server ecosystem expand risks across tool metadata, untrusted outputs, cross-tool flows, multimodal inputs, and…

Cryptography and Security · Computer Science 2026-04-24 Run Hao , Zhuoran Tan

Large Language Models (LLMs) demonstrate strong capabilities in solving complex tasks when integrated with external tools. The Model Context Protocol (MCP) has become a standard interface for enabling such tool-based interactions. However,…

Cryptography and Security · Computer Science 2026-01-23 Jiayi Fu , Yuansen Zhang , Yinggui Wang

Large language model (LLM)-based AI agents extend LLM capabilities by enabling access to tools such as data sources, APIs, search engines, code sandboxes, and even other agents. While this empowers agents to perform complex tasks, LLMs may…

Software Engineering · Computer Science 2026-01-14 Aarya Doshi , Yining Hong , Congying Xu , Eunsuk Kang , Alexandros Kapravelos , Christian Kästner

Explicit modeling of capabilities and skills -- whether based on ontologies, Asset Administration Shells, or other technologies -- requires considerable manual effort and often results in representations that are not easily accessible to…

Software Engineering · Computer Science 2025-12-10 Luis Miguel Vieira da Silva , Aljosha Köcher , Felix Gehlhoff

The Model Context Protocol (MCP) is emerging as a standard interface through which large language model (LLM) agents discover and invoke external tools. However, existing MCP evaluations fall short along three key axes: realistic multi-step…

Large Language Models (LLMs) increasingly rely on external tools to perform complex, realistic tasks, yet their ability to utilize the rapidly expanding Model Contextual Protocol (MCP) ecosystem remains limited. Existing MCP research covers…

Artificial Intelligence · Computer Science 2026-04-17 Wenhao Wang , Peizhi Niu , Zhao Xu , Zhaoyu Chen , Jian Du , Yaxin Du , Xianghe Pang , Keduan Huang , Yanfeng Wang , Qiang Yan , Siheng Chen

The Model Context Protocol (MCP) introduces a standard specification that defines how Foundation Model (FM)-based agents should interact with external systems by invoking tools. However, to understand a tool's purpose and features, FMs rely…

Software Engineering · Computer Science 2026-02-24 Mohammed Mehedi Hasan , Hao Li , Gopi Krishnan Rajbahadur , Bram Adams , Ahmed E. Hassan

The development of large language models (LLMs) has entered in a experience-driven era, flagged by the emergence of environment feedback-driven learning via reinforcement learning and tool-using agents. This encourages the emergenece of…

Machine Learning · Computer Science 2025-06-17 Junfeng Fang , Zijun Yao , Ruipeng Wang , Haokai Ma , Xiang Wang , Tat-Seng Chua

The Model Context Protocol (MCP) enables large language models (LLMs) to access external resources on demand. While commonly assumed to enhance performance, how LLMs actually leverage this capability remains poorly understood. We introduce…

Artificial Intelligence · Computer Science 2025-08-19 Wei Song , Haonan Zhong , Ziqi Ding , Jingling Xue , Yuekang Li

By providing a standardized interface for LLM agents to interact with external tools, the Model Context Protocol (MCP) is quickly becoming a cornerstone of the modern autonomous agent ecosystem. However, it creates novel attack surfaces due…

Cryptography and Security · Computer Science 2025-08-22 Zhiqiang Wang , Yichao Gao , Yanting Wang , Suyuan Liu , Haifeng Sun , Haoran Cheng , Guanquan Shi , Haohua Du , Xiangyang Li
‹ Prev 1 2 3 10 Next ›