English
Related papers

Related papers: HumanMCP: A Human-Like Query Dataset for Evaluatin…

200 papers

The Model Context Protocol (MCP) enables large language models (LLMs) to access external resources on demand. While commonly assumed to enhance performance, how LLMs actually leverage this capability remains poorly understood. We introduce…

Artificial Intelligence · Computer Science 2025-08-19 Wei Song , Haonan Zhong , Ziqi Ding , Jingling Xue , Yuekang Li

Current LLM agents are proficient at calling isolated APIs but struggle with the "last mile" of commercial software automation. In real-world scenarios, tools are not independent; they are atomic, interdependent, and prone to environmental…

Artificial Intelligence · Computer Science 2026-05-21 Yuanyang Li , Xue Yang , Longyue Wang , Weihua Luo , Hongyang Chen

Large Language Models (LLMs) are increasingly serving as autonomous agents, and their utilization of external tools via the Model Context Protocol (MCP) is considered a future trend. Current MCP evaluation sets suffer from issues such as…

Artificial Intelligence · Computer Science 2026-01-22 Wenrui Liu , Zixiang Liu , Elsie Dai , Wenhan Yu , Lei Yu , Tong Yang , Jinjun Han , Hong Gao

The Model Context Protocol (MCP) has rapidly become a de facto standard for connecting LLM-based agents with external tools via reusable MCP servers. In practice, however, server selection and onboarding rely heavily on free-text tool…

Software Engineering · Computer Science 2026-02-24 Peiran Wang , Ying Li , Yuqiang Sun , Chengwei Liu , Yang Liu , Yuan Tian

Recent advancements in Large Language Models (LLMs) and the introduction of the Model Context Protocol (MCP) have significantly expanded LLM agents' capability to interact dynamically with external tools and APIs. However, existing tool…

Computation and Language · Computer Science 2025-05-13 Elias Lumer , Anmol Gulati , Vamse Kumar Subbiah , Pradeep Honaganahalli Basavaraju , James A. Burke

This paper introduces \textbf{FinMCP-Bench}, a novel benchmark for evaluating large language models (LLMs) in solving real-world financial problems through tool invocation of financial model context protocols. FinMCP-Bench contains 613…

Artificial Intelligence · Computer Science 2026-03-27 Jie Zhu , Yimin Tian , Boyang Li , Kehao Wu , Zhongzhi Liang , Junhui Li , Xianyin Zhang , Lifan Guo , Feng Chen , Yong Liu , Chi Zhang

Large language model (LLM)-powered agents are increasingly used to plan and execute scientific workflows, yet most research cyberinfrastructure (CI) exposes heterogeneous APIs and implements security models that present barriers for use by…

The Model Context Protocol (MCP) has emerged as a standard for connecting large language models (LLMs) with external tools. However, this MCP ecosystem introduces new security risks across hosts, servers, and registries. In this paper, we…

Cryptography and Security · Computer Science 2026-04-29 Xiaofan Li , Xing Gao

To reduce development overhead and enable seamless integration between potential components comprising any given generative AI application, the Model Context Protocol (MCP) (Anthropic, 2024) has recently been released and subsequently…

Cryptography and Security · Computer Science 2025-04-14 Brandon Radosevich , John Halloran

Large language models (LLMs) are evolving into agentic systems that reason, plan, and operate external tools. The Model Context Protocol (MCP) is a key enabler of this transition, offering a standardized interface for connecting LLMs with…

Computation and Language · Computer Science 2026-03-06 Xuanjun Zong , Zhiqi Shen , Lei Wang , Yunshi Lan , Chao Yang

The rapid adoption of foundation models has significantly expanded the capabilities of software systems, enabling them to perform complex language, reasoning, and interaction tasks that were previously difficult to automate. However, this…

Software Engineering · Computer Science 2026-03-09 Mina Taraghi , Mohammad Mehdi Morovati , Foutse Khomh

The Model Context Protocol (MCP) (MCP Community, 2025) has emerged as a widely used framework for enabling LLM-based agents to communicate with external tools and services. The original MCP implementation (Anthropic, 2024) relies on a Large…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-26 Meenakshi Amulya Jayanti , X. Y. Han

Bioinformatics web servers are critical resources in modern biomedical research, facilitating interactive exploration of datasets through custom-built interfaces with rich visualization capabilities. However, this human-centric design…

Other Quantitative Biology · Quantitative Biology 2026-02-25 Matthias Flotho , Ian Ferenc Diks , Philipp Flotho , Leidy-Alejandra G. Molano , Pascal Hirsch , Andreas Keller

The Model Context Protocol (MCP) standardizes how AI agents discover and invoke external tools, with over 10,000 active servers and 97 million monthly SDK downloads as of early 2026. Yet MCP does not yet standardize how agents safely…

Software Engineering · Computer Science 2026-04-16 Vasundra Srinivasan

The rapid expansion of the model context protocol (MCP) ecosystem enables large language model (LLM)-based agents to access a wide range of external tools via a standardized interface. However, identifying appropriate MCP servers for a…

Software Engineering · Computer Science 2026-04-21 Shiyu He , Zhiman Chen , Yuqi Zhao , Neng Zhang , Ran Mo , Yutao Ma

Large Language Model (LLM) agents increasingly interact with external systems through tool-calling protocols such as the Model Context Protocol (MCP). In prevailing architectures, the agent must reason about every tool invocation in every…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-05 Abhinav Singh Parmar

The Model Context Protocol (MCP) is emerging as a common interface connecting large language models (LLMs) with external services. Remote deployments are becoming increasingly important as agents connect to user-linked online services, such…

Cryptography and Security · Computer Science 2026-05-22 Huijun Zhou , Xiaohan Zhang , Haozhe Zhang , Haoyang Zhang , Mi Zhang , Min Yang

The Model Context Protocol (MCP) is an emerging standard designed to enable seamless interaction between Large Language Model (LLM) applications and external tools or resources. Within a short period, thousands of MCP services have been…

Cryptography and Security · Computer Science 2025-09-16 Hao Song , Yiming Shen , Wenxuan Luo , Leixin Guo , Ting Chen , Jiashui Wang , Beibei Li , Xiaosong Zhang , Jiachi Chen

MCP standardizes how LLMs interact with external systems, forming the foundation for general agents. However, existing MCP benchmarks remain narrow in scope: they focus on read-heavy tasks or tasks with limited interaction depth, and fail…

With the rise of LLMs, a large number of Model Context Protocol (MCP) services have emerged since the end of 2024. However, the effectiveness and efficiency of MCP servers have not been well studied. To study these questions, we propose an…

Information Retrieval · Computer Science 2025-04-21 Zhiling Luo , Xiaorong Shi , Xuanrui Lin , Jinyang Gao