English
Related papers

Related papers: MCPTox: A Benchmark for Tool Poisoning Attack on R…

200 papers

LLM agents have begun to appear as personal assistants, customer service bots, and clinical aides. While these applications deliver substantial operational benefits, they also require continuous access to sensitive data, which increases the…

Cryptography and Security · Computer Science 2025-09-30 Saswat Das , Jameson Sandler , Ferdinando Fioretto

We define Oracle Poisoning, an attack class in which an adversary corrupts a structured knowledge graph that AI agents query at runtime via tool-use protocols, causing incorrect conclusions through correct reasoning. Unlike prompt…

Cryptography and Security · Computer Science 2026-05-12 Ben Kereopa-Yorke , Guillermo Diaz , Holly Wright , Reagan Johnston , Ron F. Del Rosario , Timothy Lynar

Autonomous web agents such as \textbf{OpenClaw} are rapidly moving into high-impact real-world workflows, but their security robustness under live network threats remains insufficiently evaluated. Existing benchmarks mainly focus on static…

Cryptography and Security · Computer Science 2026-03-20 Haochen Zhao , Shaoyang Cui

Tool-using agents are increasingly expected to operate across realistic professional workflows, where they must interpret multimodal inputs, coordinate external tools, inspect intermediate artifacts, and revise their actions before…

Artificial Intelligence · Computer Science 2026-05-19 Zhiqiang Liu , Wenhui Dong , Yilang Tan , Yuwen Qu , Haochen Yin , Chenyang Si

Agentic AI systems and Physical or Embodied AI systems have been two key research verticals at the forefront of Artificial Intelligence and Robotics, with Model Context Protocol (MCP) increasingly becoming a key component and enabler of…

The integration of artificial intelligence into automated penetration testing (AutoPT) has highlighted the necessity of simulation modeling for the training of intelligent agents, due to its cost-efficiency and swift feedback capabilities.…

Artificial Intelligence · Computer Science 2025-02-18 Yunfei Wang , Shixuan Liu , Wenhao Wang , Changling Zhou , Chao Zhang , Jiandong Jin , Cheng Zhu

LLM agents have demonstrated remarkable performance across various applications, primarily due to their advanced capabilities in reasoning, utilizing external knowledge and tools, calling APIs, and executing actions to interact with…

Machine Learning · Computer Science 2024-07-18 Zhaorun Chen , Zhen Xiang , Chaowei Xiao , Dawn Song , Bo Li

In a malicious tool attack, an attacker uploads a malicious tool to a distribution platform; once a user inadvertently installs the tool and the LLM agent selects it during task execution, the tool can compromise the user's security and…

Cryptography and Security · Computer Science 2026-05-12 Yuepeng Hu , Yuqi Jia , Mengyuan Li , Dawn Song , Neil Gong

The rapid development of the AI agent communication protocols, including the Model Context Protocol (MCP), Agent2Agent (A2A), Agora, and Agent Network Protocol (ANP), is reshaping how AI agents communicate with tools, services, and each…

Cryptography and Security · Computer Science 2026-04-20 Zeynab Anbiaee , Mahdi Rabbani , Mansur Mirani , Gunjan Piya , Igor Opushnyev , Ali Ghorbani , Sajjad Dadkhah

Defenses against indirect prompt injection (IPI) in tool-using LLM agents share two structural weaknesses. First, they all attempt to prevent attacks rather than detect the compromises that slip through. Second, they have only been…

Cryptography and Security · Computer Science 2026-05-13 Yassin H. Rassul , Tarik A. Rashid

Recent studies have shown that Large Language Models (LLMs) are vulnerable to data poisoning attacks, where malicious training examples embed hidden behaviours triggered by specific input patterns. However, most existing works assume a…

Computation and Language · Computer Science 2025-10-10 Sanhanat Sivapiromrat , Caiqi Zhang , Marco Basaldella , Nigel Collier

Both fair machine learning and adversarial learning have been extensively studied. However, attacking fair machine learning models has received less attention. In this paper, we present a framework that seeks to effectively generate…

Machine Learning · Computer Science 2021-10-19 Minh-Hao Van , Wei Du , Xintao Wu , Aidong Lu

The robustness of LLMs to jailbreak attacks, where users design prompts to circumvent safety measures and misuse model capabilities, has been studied primarily for LLMs acting as simple chatbots. Meanwhile, LLM agents -- which use external…

AI coding assistants powered by large language models (LLMs) have transformed software development, significantly boosting productivity. While existing benchmarks evaluate the correctness and security of LLM-generated code, they are…

Software Engineering · Computer Science 2025-10-17 Ruchit Rawal , Jeffrey Yang Fan Chiang , Chihao Shen , Jeffery Siyuan Tian , Aastha Mahajan , Tom Goldstein , Yizheng Chen

Large Language Models (LLMs) have demonstrated strong capabilities as autonomous agents through tool use, planning, and decision-making abilities, leading to their widespread adoption across diverse tasks. As task complexity grows,…

Multiagent Systems · Computer Science 2025-11-10 Ishan Kavathekar , Hemang Jain , Ameya Rathod , Ponnurangam Kumaraguru , Tanuja Ganu

Equipping LLM agents with real-world tools can substantially improve productivity. However, granting agents autonomy over tool use also transfers the associated privileges to both the agent and the underlying LLM. Improper privilege usage…

Cryptography and Security · Computer Science 2026-04-21 Quan Zhang , Lianhang Fu , Lvsi Lian , Gwihwan Go , Yujue Wang , Chijin Zhou , Yu Jiang , Geguang Pu

Significant focus has been placed on integrating large language models (LLMs) with various tools in developing general-purpose agents. This poses a challenge to LLMs' tool-use capabilities. However, there are evident gaps between existing…

Computation and Language · Computer Science 2024-11-25 Jize Wang , Zerun Ma , Yining Li , Songyang Zhang , Cailian Chen , Kai Chen , Xinyi Le

The rapid deployment of Large language model (LLM) agents in critical domains like healthcare and finance necessitates robust security frameworks. To address the absence of standardized evaluation benchmarks for these agents in dynamic…

Cryptography and Security · Computer Science 2025-06-19 Yuchuan Fu , Xiaohan Yuan , Dongxia Wang

Tool-use language agents are evaluated on benchmarks that assume clean inputs, unambiguous tool registries, and reliable APIs. Real deployments violate all these assumptions: user typos propagate into hallucinated tool names, a…

Tool learning is widely acknowledged as a foundational approach or deploying large language models (LLMs) in real-world scenarios. While current research primarily emphasizes leveraging tools to augment LLMs, it frequently neglects emerging…

Computation and Language · Computer Science 2024-08-19 Junjie Ye , Sixian Li , Guanyu Li , Caishuang Huang , Songyang Gao , Yilong Wu , Qi Zhang , Tao Gui , Xuanjing Huang
‹ Prev 1 8 9 10 Next ›