中文
相关论文

相关论文: PHMForge: Evaluating LLM Agents on Industrial Prog…

200 篇论文

The Model Context Protocol (MCP), introduced by Anthropic in November 2024 and now governed by the Linux Foundation's Agentic AI Foundation, has rapidly become the de facto standard for connecting large language model (LLM)-based agents to…

密码学与安全 · 计算机科学 2026-04-08 Nirajan Acharya , Gaurav Kumar Gupta

The Model Context Protocol (MCP) is rapidly emerging as the middleware for LLM-based applications, offering a standardized interface for tool integration. However, its built-in security mechanisms are minimal: while schemas and declarations…

密码学与安全 · 计算机科学 2025-12-04 Biwei Yan , Yue Zhang , Minghui Xu , Hao Wu , Yechao Zhang , Kun Li , Guoming Zhang , Xiuzhen Cheng

Large language model (LLM) coding agents increasingly operate over repositories, terminals, tests, and execution traces across long software-engineering episodes. Persistent memory is useful, but static vector stores or generic…

软件工程 · 计算机科学 2026-05-05 Mehmet Iscan

The Model Context Protocol (MCP) is an emerging standard designed to enable seamless interaction between Large Language Model (LLM) applications and external tools or resources. Within a short period, thousands of MCP services have been…

密码学与安全 · 计算机科学 2025-09-16 Hao Song , Yiming Shen , Wenxuan Luo , Leixin Guo , Ting Chen , Jiashui Wang , Beibei Li , Xiaosong Zhang , Jiachi Chen

The Model Context Protocol (MCP) enables large language models (LLMs) to dynamically discover and invoke third-party tools, significantly expanding agent capabilities while introducing a distinct security landscape. Unlike prompt-only…

密码学与安全 · 计算机科学 2026-04-10 Mehrdad Rostamzadeh , Sidhant Narula , Nahom Birhan , Mohammad Ghasemigol , Daniel Takabi

LLM-based agents for industrial asset operations show limited accuracy when reasoning over flat document stores. AssetOpsBench (KDD 2026) establishes that GPT-4 agents achieve 65% on 139 industrial maintenance scenarios backed by CouchDB,…

数据库 · 计算机科学 2026-05-27 Madhulatha Mandarapu , Sandeep Kunkunuru

Model Context Protocol (MCP) servers contain a collection of thousands of open-source standardized tools, linking LLMs to external systems; however, existing datasets and benchmarks lack realistic, human-like user queries, remaining a…

To address the steep learning curve and reliance on complex manual file editing and command-line operations in the traditional workflow of the mainstream open-source seismic wave simulation software SPECFEM, this paper proposes an…

人工智能 · 计算机科学 2025-12-17 Yukun Ren , Siwei Yu , Kai Chen , Jianwei Ma

Multi-agent LLM frameworks are widely used to accelerate the development of agent systems powered by large language models (LLMs). These frameworks impose distinct architectural structures that govern how agents interact, store information,…

人工智能 · 计算机科学 2026-02-04 Abdelghny Orogat , Ana Rostam , Essam Mansour

We introduce ETOM, a five-level benchmark for evaluating multi-hop, end-to-end tool orchestration by LLM agents within a hierarchical Model-Context Protocol (MCP) ecosystem. Existing benchmarks often assess tools in isolation, overlooking…

人工智能 · 计算机科学 2026-01-21 Jia-Kai Dong , I-Wei Huang , Chun-Tin Wu , Yi-Tien Tsai

Large Language Model (LLM) agents increasingly interact with external systems through tool-calling protocols such as the Model Context Protocol (MCP). In prevailing architectures, the agent must reason about every tool invocation in every…

分布式、并行与集群计算 · 计算机科学 2026-05-05 Abhinav Singh Parmar

Agentic workflows driven by large language models (LLMs) are increasingly applied to Building Information Modelling (BIM), enabling natural-language retrieval, modification and generation of IFC models. Recent work has begun adopting the…

其他计算机科学 · 计算机科学 2026-03-31 Tobias Heimig-Elschner , Changyu Du , Anna Scheuvens , André Borrmann , Jakob Beetz

With advances in decision-making and reasoning capabilities, multimodal agents show strong potential in computer application scenarios. Past evaluations have mainly assessed GUI interaction skills, while tool invocation abilities, such as…

计算机视觉与模式识别 · 计算机科学 2025-11-12 Hongrui Jia , Jitong Liao , Xi Zhang , Haiyang Xu , Tianbao Xie , Chaoya Jiang , Ming Yan , Si Liu , Wei Ye , Fei Huang

Large Language Models can break through knowledge and timeliness limitations by invoking external tools within the Model Context Protocol framework to achieve automated execution of complex tasks. However, with the rapid growth of…

软件工程 · 计算机科学 2025-11-26 Qingsong He , Jing Nan , Jiayu Jiao , Liangjie Tang , Xiaodong Xu , Mengmeng Sun , Qingyao Wang , Minghui Yan

Model Context Protocol (MCP) have quickly become the interface layer between LLM agents and external tools, yet they also introduce unsafe data flows that existing analyzers handle poorly. Vulnerabilities manifest in two directions:…

软件工程 · 计算机科学 2026-05-11 Xinyi Hou , Yanjie Zhao , Haoyu Wang

The Model Context Protocol (MCP) introduces a structurally distinct attack surface that existing threat frameworks, designed for traditional software systems or generic LLM deployments, do not adequately cover. This paper presents MCP-38, a…

密码学与安全 · 计算机科学 2026-03-20 Yi Ting Shen , Kentaroh Toyoda , Alex Leung

The Model Context Protocol (MCP) enables Large Language Models (LLMs) to interact with external tools via tool descriptors, thereby extending their capabilities for task execution, autonomous decision-making, and multi-agent coordination.…

密码学与安全 · 计算机科学 2026-05-22 Saeid Jamshidi , Arghavan Moradi Dakhel , Kawser Wazed Nafi , Foutse Khomh

The Model Context Protocol (MCP) has emerged as a widely adopted mechanism for connecting large language models to external tools and resources. While MCP promises seamless extensibility and rich integrations, it also introduces a…

密码学与安全 · 计算机科学 2025-07-10 Zhihao Li , Kun Li , Boyang Ma , Minghui Xu , Yue Zhang , Xiuzhen Cheng

Teams of LLM agents increasingly collaborate on tasks spanning days or weeks: multi-day data-generation sprints where generator, reviewer, and auditor agents coordinate in real time on overlapping batches; specialists carrying findings…

多智能体系统 · 计算机科学 2026-04-22 Hongwei Xu

Deploying compound LLM agents in adversarial, partially observable sequential environments requires navigating several design dimensions: (1) what the agent sees, (2) how it reasons, and (3) how tasks are decomposed across components. Yet…

人工智能 · 计算机科学 2026-05-18 Igor Bogdanov , Chung-Horng Lung , Thomas Kunz , Jie Gao , Adrian Taylor , Marzia Zaman