English
Related papers

Related papers: ToolTweak: An Attack on Tool Selection in LLM-base…

200 papers

Large Language Model (LLM) agents increasingly use external tools for complex tasks and rely on embedding-based retrieval to select a small top-k subset for reasoning. As these systems scale, the robustness of this retrieval stage is…

Computation and Language · Computer Science 2026-03-17 Hussein Jawad , Nicolas J-B Brunel

Agents backed by large language models (LLMs) increasingly rely on external tools drawn from marketplaces where multiple providers offer functionally equivalent options. This raises a critical fairness concern: systematic bias in tool…

Artificial Intelligence · Computer Science 2026-03-12 Thierry Blankenstein , Jialin Yu , Zixuan Li , Vassilis Plachouras , Sunando Sengupta , Philip Torr , Yarin Gal , Alasdair Paren , Adel Bibi

Tool learning serves as a powerful auxiliary mechanism that extends the capabilities of large language models (LLMs), enabling them to tackle complex tasks requiring real-time relevance or high precision operations. Behind its powerful…

Cryptography and Security · Computer Science 2025-04-08 Liuji Chen , Hao Gao , Jinghao Zhang , Qiang Liu , Shu Wu , Liang Wang

Tool selection is a key component of LLM agents. A popular approach follows a two-step process - \emph{retrieval} and \emph{selection} - to pick the most appropriate tool from a tool library for a given task. In this work, we introduce…

Cryptography and Security · Computer Science 2025-08-26 Jiawen Shi , Zenghui Yuan , Guiyao Tie , Pan Zhou , Neil Zhenqiang Gong , Lichao Sun

Large language models (LLMs) can now access a wide range of external tools, thanks to the Model Context Protocol (MCP). This greatly expands their abilities as various agents. However, LLMs rely entirely on the text descriptions of tools to…

Artificial Intelligence · Computer Science 2025-09-23 Kazem Faghih , Wenxiao Wang , Yize Cheng , Siddhant Bharti , Gaurang Sriramanan , Sriram Balasubramanian , Parsa Hosseini , Soheil Feizi

Tool-use large language model (LLM) agents are increasingly deployed to support sensitive workflows, relying on tool calls for retrieval, external API access, and session memory management. While prior research has examined various threats,…

Cryptography and Security · Computer Science 2026-04-08 Wuyang Zhang , Shichao Pei

Large language model (LLM) agents rely on external tools to solve complex tasks, but real-world toolsets often contain redundant tools with overlapping names and descriptions, introducing ambiguity and reducing selection accuracy. LLMs also…

Computation and Language · Computer Science 2026-05-12 Marianne Menglin Liu , Daniel Garcia , Fjona Parllaku , Vikas Upadhyay , Syed Fahad Allam Shah , Dan Roth

LLM-driven agents are capable of selecting external tools to complete users' tasks. However, attackers could compromise such process, steering agents toward inappropriate/wrong tools and enabling malicious actions. Most existing attacks…

Cryptography and Security · Computer Science 2026-05-27 Xuanye Zhang , Yongsen Zheng , Zhuqin Xu , Kaiyu Zhou , Bowen Shen , Haoran Ou , Tianwei Zhang , Kwok-Yan Lam

Recent studies on software tool manipulation with large language models (LLMs) mostly rely on closed model APIs. The industrial adoption of these models is substantially constrained due to the security and robustness risks in exposing…

Computation and Language · Computer Science 2023-05-29 Qiantong Xu , Fenglu Hong , Bo Li , Changran Hu , Zhengyu Chen , Jian Zhang

Large Language Model (LLM) Agents leverage the advanced reasoning capabilities of LLMs in real-world applications. To interface with an environment, these agents often rely on tools, such as web search or database APIs. As the agent…

Artificial Intelligence · Computer Science 2025-03-12 Ivan Milev , Mislav Balunović , Maximilian Baader , Martin Vechev

LLM-based agent systems increasingly rely on agent skills sourced from open registries to extend their capabilities, yet the openness of such ecosystems makes skills difficult to thoroughly vet. Existing attacks rely on injecting malicious…

Cryptography and Security · Computer Science 2026-04-08 Zenghao Duan , Yuxin Tian , Zhiyi Yin , Liang Pang , Jingcheng Deng , Zihao Wei , Shicheng Xu , Yuyao Ge , Xueqi Cheng

Large Language Models (LLMs) are increasingly used in applications where the model selects from competing third-party content, such as in LLM-powered search engines or chatbot plugins. In this paper, we introduce Preference Manipulation…

Cryptography and Security · Computer Science 2024-07-03 Fredrik Nestaas , Edoardo Debenedetti , Florian Tramèr

Large language models (LLMs) are increasingly deployed in agentic systems, where a fundamental task is mapping user intents to relevant external tools. Errors in tool selection can have severe outcomes, such as unauthorized data access,…

Cryptography and Security · Computer Science 2026-05-14 Jehyeok Yeon , Isha Chaudhary , Gagandeep Singh

Large language model (LLM) agents have demonstrated remarkable capabilities in complex reasoning and decision-making by leveraging external tools. However, this tool-centric paradigm introduces a previously underexplored attack surface,…

Artificial Intelligence · Computer Science 2026-01-08 Kanghua Mo , Li Hu , Yucheng Long , Zhihao Li

Large language models (LLMs) are increasingly deployed as autonomous agents in offensive cybersecurity. In this paper, we reveal an interesting phenomenon: different agents exhibit distinct attack patterns. Specifically, each agent exhibits…

Cryptography and Security · Computer Science 2026-05-11 Taein Lim , Seongyong Ju , Munhyeok Kim , Hyunjun Kim , Hoki Kim

Tool learning aims to extend the capabilities of large language models (LLMs) with external tools. A major challenge in tool learning is how to support a large number of tools, including unseen tools. To address this challenge, previous…

Information Retrieval · Computer Science 2024-06-12 Yuanhang Zheng , Peng Li , Wei Liu , Yang Liu , Jian Luan , Bin Wang

Current Large Language Models (LLMs) are gradually exploited in practically valuable agentic workflows such as Deep Research, E-commerce recommendation, and job recruitment. In these applications, LLMs need to select some optimal solutions…

Computers and Society · Computer Science 2026-03-23 Zichen Tang , Zirui Zhang , Qian Wang , Zhenheng Tang , Bo Li , Xiaowen Chu

Current evaluations of tool-integrated LLM agents typically focus on end-to-end tool-usage evaluation while neglecting their stability. This limits their real-world applicability, as various internal or external factors can cause agents to…

Computation and Language · Computer Science 2025-06-30 Weimin Xiong , Ke Wang , Yifan Song , Hanchao Liu , Sai Zhou , Wei Peng , Sujian Li

Tool-Based Agent Systems (TBAS) allow Language Models (LMs) to use external tools for tasks beyond their standalone capabilities, such as searching websites, booking flights, or making financial transactions. However, these tools greatly…

Cryptography and Security · Computer Science 2025-02-17 Peter Yong Zhong , Siyuan Chen , Ruiqi Wang , McKenna McCall , Ben L. Titzer , Heather Miller , Phillip B. Gibbons

The integration of large language models (LLMs) into information retrieval systems introduces new attack surfaces, particularly for adversarial ranking manipulations. We present $\textbf{StealthRank}$, a novel adversarial attack method that…

Information Retrieval · Computer Science 2025-05-26 Yiming Tang , Yi Fan , Chenxiao Yu , Tiankai Yang , Yue Zhao , Xiyang Hu
‹ Prev 1 2 3 10 Next ›