English
Related papers

Related papers: MemMorph: Tool Hijacking in LLM Agents via Memory …

200 papers

Memory-augmented large language model (LLM) agents use iterative reflection and self-evolution to solve complex tasks, but these mechanisms introduce security risks. Existing agentic memory attacks require privileged access or explicit…

Cryptography and Security · Computer Science 2026-05-20 Kaixiang Wang , Jiong Lou , Zhaojiacheng Zhou , Jie Li

By providing a standardized interface for LLM agents to interact with external tools, the Model Context Protocol (MCP) is quickly becoming a cornerstone of the modern autonomous agent ecosystem. However, it creates novel attack surfaces due…

Cryptography and Security · Computer Science 2025-08-22 Zhiqiang Wang , Yichao Gao , Yanting Wang , Suyuan Liu , Haifeng Sun , Haoran Cheng , Guanquan Shi , Haohua Du , Xiangyang Li

The growth of agentic AI has drawn significant attention to function calling Large Language Models (LLMs), which are designed to extend the capabilities of AI-powered system by invoking external functions. Injection and jailbreaking attacks…

Cryptography and Security · Computer Science 2026-04-24 Yannis Belkhiter , Giulio Zizzo , Sergio Maffeis , Seshu Tirupathi , John D. Kelleher

Memory is a fundamental component for enabling long-context LLM agents, supporting persistent state across interactions through a continuous serve-and-update lifecycle. Despite substantial prior work, existing systems suffer from…

Databases · Computer Science 2026-05-26 Han Chen , Zining Zhang , Wenqi Pei , Bingsheng He , Ming Wu , Jason Zeng , Michael Heinrich , Wei Wu , Hongbao Zhang

Modern language agents must operate over long-horizon, multi-turn histories, yet deploying such agents with Small Language Models (SLMs) remains fundamentally difficult. Full-context prompting causes context overflow, flat retrieval exposes…

Multiagent Systems · Computer Science 2026-05-06 Jiayi Chen , Yingcong Li , Guiling Wang

Large Language Model (LLM)-based agents are increasingly deployed for complex, tool-based tasks where long-term memory is critical to driving actions. Existing benchmarks, however, primarily test a angent's ability to passively retrieve…

Computation and Language · Computer Science 2026-01-29 Yiting Shen , Kun Li , Wei Zhou , Songlin Hu

Large language models (LLMs)-powered AI agents exhibit a high level of autonomy in addressing medical and healthcare challenges. With the ability to access various tools, they can operate within an open-ended action space. However, with the…

Cryptography and Security · Computer Science 2025-04-08 Jianing Qiu , Lin Li , Jiankai Sun , Hao Wei , Zhe Xu , Kyle Lam , Wu Yuan

Large Language Model (LLM)-based agents have demonstrated remarkable capabilities in reasoning, planning, and tool usage. The recently proposed Model Context Protocol (MCP) has emerged as a unifying framework for integrating external tools…

Cryptography and Security · Computer Science 2025-12-03 Yuanhe Zhang , Weiliu Wang , Zhenhong Zhou , Kun Wang , Jie Zhang , Li Sun , Yang Liu , Sen Su

To standardize interactions between LLM-based agents and their environments, the Model Context Protocol (MCP) was proposed and has since been widely adopted. However, integrating external tools expands the attack surface, exposing agents to…

Cryptography and Security · Computer Science 2026-01-13 Ruiqi Li , Zhiqiang Wang , Yunhao Yao , Xiang-Yang Li

As LLM-based agents increasingly operate in multi-agent systems, understanding adversarial manipulation becomes critical for defensive design. We present a systematic study of intentional deception as an engineered capability, using…

Artificial Intelligence · Computer Science 2026-03-10 Jason Starace , Terence Soule

Recent GUI agents have made substantial progress in visual grounding and action prediction, yet they remain brittle in long-horizon tasks that require maintaining task state across many interface transitions. Existing agents typically rely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Ziyun Zeng , Hang Hua , Bocheng Zou , Mu Cai , Rogerio Feris , Jiebo Luo

This paper investigates some of the risks introduced by "LLM poisoning," the intentional or unintentional introduction of malicious or biased data during model training. We demonstrate how a seemingly improved LLM, fine-tuned on a limited…

Cryptography and Security · Computer Science 2025-11-05 Patrick Karlsen , Even Eilertsen

Embodied Large Language Models (LLMs) enable AI agents to interact with the physical world through natural language instructions and actions. However, beyond the language-level risks inherent to LLMs themselves, embodied LLMs with…

Robotics · Computer Science 2026-03-03 Xinyu Huang , Qiang Yang , Leming Shen , Zijing Ma , Yuanqing Zheng

AI agents, powered by large language models (LLMs), have transformed human-computer interactions by enabling seamless, natural, and context-aware communication. While these advancements offer immense utility, they also inherit and amplify…

Artificial Intelligence · Computer Science 2024-12-06 Xuying Li , Zhuo Li , Yuji Kosuga , Yasuhiro Yoshida , Victor Bian

The robustness of LLMs to jailbreak attacks, where users design prompts to circumvent safety measures and misuse model capabilities, has been studied primarily for LLMs acting as simple chatbots. Meanwhile, LLM agents -- which use external…

The evolution from static ranking models to Agentic Recommender Systems (Agentic RecSys) empowers AI agents to maintain long-term user profiles and autonomously plan service tasks. While this paradigm shift enhances personalization, it…

Cryptography and Security · Computer Science 2026-04-21 Jiachen Qian

Membership inference attacks (MIAs) test whether a target data record belongs to a system's private data, and have become a standard tool to measure privacy leakage in machine learning systems. Prior work has primarily focused on training…

Cryptography and Security · Computer Science 2026-05-28 Kai Chen , Yan Pang , Tianhao Wang

Agents built with large language models (LLMs) have shown great potential across a wide range of domains. However, in complex decision-making tasks, pure LLM-based agents tend to exhibit intrinsic bias in their choice of actions, which is…

Artificial Intelligence · Computer Science 2025-05-30 Zelai Xu , Chao Yu , Fei Fang , Yu Wang , Yi Wu

Long-term memory enables large language model (LLM) agents to support personalized and sustained interactions. However, most work on personalized agents prioritizes utility and user experience, treating memory as a neutral component and…

Artificial Intelligence · Computer Science 2026-05-19 Jiahe Guo , Xiangran Guo , Yulin Hu , Zimo Long , Xingyu Sui , Xuda Zhi , Yongbo Huang , Hao He , Weixiang Zhao , Yanyan Zhao , Bing Qin

Personalized LLM agents maintain persistent cross-session state to support long-horizon collaboration. Yet, this persistence introduces a subtle but critical security vulnerability: routine user-agent interactions can gradually reshape an…

Cryptography and Security · Computer Science 2026-05-11 Xiaoyu Xu , Minxin Du , Qipeng Xie , Haobin Ke , Qingqing Ye , Haibo Hu