English
Related papers

Related papers: MCPToolBench++: A Large Scale AI Agent Model Conte…

200 papers

Large Language Models (LLMs) based agent systems have made great strides in real-world applications beyond traditional NLP tasks. This paper proposes a new LLM-based Multi-Agent System (LLM-MAS) benchmark, Collab-Overcooked, built on the…

Computation and Language · Computer Science 2025-12-02 Haochen Sun , Shuwen Zhang , Lujie Niu , Lei Ren , Hao Xu , Hao Fu , Fangkun Zhao , Caixia Yuan , Xiaojie Wang

The Model Context Protocol (MCP) enhances large language models (LLMs) by integrating external tools, enabling dynamic aggregation of real-time data to improve task execution. However, its non-isolated execution context introduces critical…

Computation and Language · Computer Science 2025-08-11 Haoran Shi , Hongwei Yao , Shuo Shao , Shaopeng Jiao , Ziqi Peng , Zhan Qin , Cong Wang

The rise of Multi-Agent Systems (MAS) in Artificial Intelligence (AI), especially integrated with Large Language Models (LLMs), has greatly facilitated the resolution of complex tasks. However, current systems are still facing challenges of…

Information Retrieval · Computer Science 2025-09-23 Callie C. Liao , Duoduo Liao , Sai Surya Gadiraju

Large Language Models (LLMs) are increasingly being used as autonomous agents capable of performing complicated tasks. However, they lack the ability to perform reliable long-horizon planning on their own. This paper bridges this gap by…

Artificial Intelligence · Computer Science 2025-09-17 Yarin Benyamin , Argaman Mordoch , Shahaf S. Shperberg , Roni Stern

The Model Context Protocol (MCP) is an open and standardized interface that enables large language models (LLMs) to interact with external tools and services, and is increasingly adopted by AI agents. However, the security of MCP-based…

Cryptography and Security · Computer Science 2026-03-10 Yuhang Huang , Boyang Ma , Biwei Yan , Xuelong Dai , Yechao Zhang , Minghui Xu , Kaidi Xu , Yue Zhang

With the rapid advancement of post-training techniques for reasoning and information seeking, large language models (LLMs) can incorporate a large quantity of retrieved knowledge to solve complex tasks. However, the limited context window…

Computation and Language · Computer Science 2026-04-21 Zijun Liu , Zhennan Wan , Peng Li , Ming Yan , Fei Huang , Yang Liu

Large Language Models (LLMs) have become increasingly capable of interacting with external tools, granting access to specialized knowledge beyond their training data - critical in dynamic, knowledge-intensive domains such as Chemistry and…

Artificial intelligence is rapidly evolving towards multi-agent systems where numerous AI agents collaborate and interact with external tools. Two key open standards, Google's Agent to Agent (A2A) protocol for inter-agent communication and…

Multiagent Systems · Computer Science 2025-05-08 Qiaomu Li , Ying Xie

The evolution of Large Language Models (LLMs) into Agentic AI has established the Model Context Protocol (MCP) as the standard for connecting reasoning engines with external tools. Although this decoupled architecture fosters modularity, it…

Cryptography and Security · Computer Science 2026-02-17 Yunhao Yao , Zhiqiang Wang , Haoran Cheng , Yihang Cheng , Haohua Du , Xiang-Yang Li

General-purpose agents perform tasks in unfamiliar environments without domain-specific manual customization. Yet no study has systematically measured how agent architecture shapes performance across heterogeneous protocols and diverse…

The Model Context Protocol (MCP) is emerging as a common interface connecting large language models (LLMs) with external services. Remote deployments are becoming increasingly important as agents connect to user-linked online services, such…

Cryptography and Security · Computer Science 2026-05-22 Huijun Zhou , Xiaohan Zhang , Haozhe Zhang , Haoyang Zhang , Mi Zhang , Min Yang

Bioinformatics web servers are critical resources in modern biomedical research, facilitating interactive exploration of datasets through custom-built interfaces with rich visualization capabilities. However, this human-centric design…

Other Quantitative Biology · Quantitative Biology 2026-02-25 Matthias Flotho , Ian Ferenc Diks , Philipp Flotho , Leidy-Alejandra G. Molano , Pascal Hirsch , Andreas Keller

Large language models(LLMs) are increasingly integrated with external systems through the Model Context Protocol(MCP),which standardizes tool invocation and has rapidly become a backbone for LLM-powered applications. While this paradigm…

Cryptography and Security · Computer Science 2026-05-04 Shuli Zhao , Qinsheng Hou , Zihan Zhan , Yanhao Wang , Yuchong Xie , Yu Guo , Libo Chen , Shenghong Li , Zhi Xue

Tool calling allows large language models (LLMs) to interact with external systems like APIs, enabling applications in customer support, data analysis, and dynamic content generation. While recent benchmarks have advanced tool-use research,…

Human-Computer Interaction · Computer Science 2026-03-09 Zuoyu Zhang , Yancheng Zhu

While Large Language Models (LLMs) have evolved into tool-using agents, they remain brittle in long-horizon interactions. Unlike mathematical reasoning where errors are often rectifiable via backtracking, tool-use failures frequently induce…

Artificial Intelligence · Computer Science 2026-03-17 Shengda Fan , Xuyan Ye , Yupeng Huo , Zhi-Yuan Chen , Yiju Guo , Shenzhi Yang , Wenkai Yang , Shuqi Ye , Jingwen Chen , Haotian Chen , Xin Cong , Yankai Lin

As large language model (LLM)-based agents become increasingly integrated into daily digital interactions, their ability to reason across long interaction histories becomes crucial for providing personalized and contextually aware…

Machine Learning · Computer Science 2025-12-05 Andy Chung , Yichi Zhang , Kaixiang Lin , Aditya Rawal , Qiaozi Gao , Joyce Chai

Large Language Models (LLMs) are now integral to numerous industries, increasingly serving as the core reasoning engine for autonomous agents that perform complex tasks through tool-use. While the development of Arabic-native LLMs is…

Artificial Intelligence · Computer Science 2026-01-09 Konstantin Kubrak , Ahmed El-Moselhy , Ammar Alsulami , Remaz Altuwaim , Hassan Ismail Fawaz , Faisal Alsaby

In 2025, Large Language Model (LLM) services have launched a new feature -- AI video chat -- allowing users to interact with AI agents via real-time video communication (RTC), just like chatting with real people. Despite its significance,…

Networking and Internet Architecture · Computer Science 2025-10-02 Jiayang Xu , Xiangjie Huang , Zijie Li , Zili Meng

The Model Context Protocol (MCP) aims to create a standard for how Large Language Models use tools. However, most current research focuses on selecting tools from an existing pool. A more fundamental, yet largely overlooked, problem is how…

Software Engineering · Computer Science 2026-02-12 Chaoqian Ouyang , Ling Yue , Shimin Di , Libin Zheng , Linan Yue , Shaowu Pan , Jian Yin , Min-Ling Zhang

Recent advances in large language models (LLMs) have enabled the emergence of general-purpose agents for automating end-to-end machine learning (ML) workflows, including data analysis, feature engineering, model training, and competition…

Artificial Intelligence · Computer Science 2025-09-12 Hangyi Jia , Yuxi Qian , Hanwen Tong , Xinhui Wu , Lin Chen , Feng Wei