English
Related papers

Related papers: Memory-Induced Tool-Drift in LLM Agents

200 papers

Large language model (LLM) agents execute tasks through multi-step workflows that combine planning, memory, and tool use. While this design enables autonomy, it also expands the attack surface for backdoor threats. Backdoor triggers…

Artificial Intelligence · Computer Science 2026-01-13 Yunhao Feng , Yige Li , Yutao Wu , Yingshui Tan , Yanming Guo , Yifan Ding , Kun Zhai , Xingjun Ma , Yu-Gang Jiang

The Model Context Protocol (MCP) is increasingly adopted to standardize the interaction between LLM agents and external tools. However, this trend introduces a new threat: Tool Poisoning Attacks (TPA), where tool metadata is poisoned to…

Cryptography and Security · Computer Science 2026-01-16 Zhiqiang Wang , Haohua Du , Guanquan Shi , Junyang Zhang , HaoRan Cheng , Yunhao Yao , Kaiwen Guo , Xiang-Yang Li

As LLM-based agents increasingly rely on external tools, it is important to evaluate their ability to sustain tool-grounded reasoning beyond familiar workflows and short-range interactions. We introduce AgentEscapeBench, an…

Artificial Intelligence · Computer Science 2026-05-21 Zhengkang Guo , Yiyang Li , Lin Qiu , Xiaohua Wang , Jingwen Xv , Dongyu Ru , Xiaoyu Li , Xiaoqing Zheng , Xuezhi Cao , Xunliang Cai

While large language models have shown impressive capabilities across a wide range of domains, they still encounter significant challenges in reasoning tasks that require gathering evidence over multiple turns and drawing logical…

Artificial Intelligence · Computer Science 2024-10-16 Eryk Banatt , Jonathan Cheng , Skanda Vaidyanath , Tiffany Hwu

Large language model (LLM)-based agents combine LLMs with external tools to automate tasks such as scheduling meetings, managing documents, or booking travel. While these integrations unlock powerful capabilities, they also create new and…

Cryptography and Security · Computer Science 2026-04-22 Jonathan Evertz , Merlin Chlosta , Lea Schönherr , Thorsten Eisenhofer

Conversational assistants are increasingly integrating long-term memory with large language models (LLMs). This persistence of memories, e.g., the user is vegetarian, can enhance personalization in future conversations. However, the same…

Artificial Intelligence · Computer Science 2026-02-03 Sidharth Pulipaka , Oliver Chen , Manas Sharma , Taaha S Bajwa , Vyas Raina , Ivaxi Sheth

Vision-Language Models(VLMs) have demonstrated significant potential for end-to-end autonomous driving, yet a substantial gap remains between their current capabilities and the reliability necessary for real-world deployment. A critical…

LLM agents operating in open environments face escalating risks from indirect prompt injection, particularly within the tool stream where manipulated metadata and runtime feedback hijack execution flow. Existing defenses encounter a…

Cryptography and Security · Computer Science 2026-01-15 Junda Lin , Zhaomeng Zhou , Zhi Zheng , Shuochen Liu , Tong Xu , Yong Chen , Enhong Chen

Large Language Models (LLMs) have shown significant promise in real-world decision-making tasks for embodied artificial intelligence, especially when fine-tuned to leverage their inherent common sense and reasoning abilities while being…

Cryptography and Security · Computer Science 2025-05-01 Ruochen Jiao , Shaoyuan Xie , Justin Yue , Takami Sato , Lixu Wang , Yixuan Wang , Qi Alfred Chen , Qi Zhu

Multi-agent reinforcement learning (MARL) extends (single-agent) reinforcement learning (RL) by introducing additional agents and (potentially) partial observability of the environment. Consequently, algorithms for solving MARL problems…

Multiagent Systems · Computer Science 2019-09-12 Yilun Zhou , Derrik E. Asher , Nicholas R. Waytowich , Julie A. Shah

Autonomous agents have recently achieved remarkable progress across diverse domains, yet most evaluations focus on short-horizon, fully observable tasks. In contrast, many critical real-world tasks, such as large-scale software development,…

Fulfilling user needs through Large Language Model multi-turn, multi-step tool-use is rarely a straightforward process. Real user interactions are inherently wild, being intricate, messy, and flexible. We identify three key challenges from…

Human-Computer Interaction · Computer Science 2026-04-09 Peijie Yu , Wei Liu , Yifan Yang , Jinjian Li , Zelong Zhang , Xiao Feng , Feng Zhang

Large language model (LLM) agents are increasingly used to migrate legacy code to modern stacks. We ask a deceptively simple question: when an LLM modernizes legacy code, can the same model be relied upon to recognize when its own output…

Software Engineering · Computer Science 2026-05-22 Gokul Chandra Purnachandra Reddy , Aditya Lolla , Harsha Sanku

Current AI agents excel in familiar settings, but fail sharply when faced with novel tasks with unseen vocabularies -- a core limitation of procedural memory systems. We present the first benchmark that isolates procedural memory retrieval…

Computation and Language · Computer Science 2025-12-01 Ishant Kohar , Aswanth Krishnan

Tool-calling LLM agents can read private data, invoke external services, and trigger real-world actions, creating a security problem at the point of tool execution. We identify a denial-feedback leakage pattern, which we term causality…

Cryptography and Security · Computer Science 2026-04-07 Mohammad Hossein Chinaei

Large language models are increasingly used in decision-making tasks that require them to process information from a variety of sources, including both human experts and other algorithmic agents. How do LLMs weigh the information provided…

Artificial Intelligence · Computer Science 2026-02-26 Jessica Y. Bo , Lillio Mok , Ashton Anderson

Memory emerges as the core module in the large language model (LLM)-based agents for long-horizon complex tasks (e.g., multi-turn dialogue, game playing, scientific discovery), where memory can enable knowledge accumulation, iterative…

Computation and Language · Computer Science 2026-05-04 Yanchen Wu , Tenghui Lin , Yingli Zhou , Fangyuan Zhang , Qintian Guo , Xun Zhou , Sibo Wang , Xilin Liu , Yuchi Ma , Yixiang Fang

Decision Transformer-based decision-making agents have shown the ability to generalize across multiple tasks. However, their performance relies on massive data and computation. We argue that this inefficiency stems from the forgetting…

Machine Learning · Computer Science 2024-05-30 Jikun Kang , Romain Laroche , Xingdi Yuan , Adam Trischler , Xue Liu , Jie Fu

Large Language Models (LLMs) have shown remarkable capabilities in tool calling and tool usage, but suffer from hallucinations where they choose incorrect tools, provide malformed parameters and exhibit 'tool bypass' behavior by performing…

Artificial Intelligence · Computer Science 2026-01-09 Kait Healy , Bharathi Srinivasan , Visakh Madathil , Jing Wu

Large language models confidently produce outdated answers, and no existing method can detect them. We show this is not an engineering failure but a structural one: temporal drift, whether a stored fact has changed since training, is…

Artificial Intelligence · Computer Science 2026-05-12 Rania Elbadry , Ahmed Heakl , Fan Zhang , Dani Bouch , Yuxia Wang , Preslav Nakov , Zhuohan Xie