English
Related papers

Related papers: Simple Prompt Injection Attacks Can Leak Personal …

200 papers

Large language models (LLMs) are becoming a popular tool as they have significantly advanced in their capability to tackle a wide range of language-based tasks. However, LLMs applications are highly vulnerable to prompt injection attacks,…

Computation and Language · Computer Science 2024-11-11 Md Abdur Rahman , Fan Wu , Alfredo Cuzzocrea , Sheikh Iqbal Ahamed

LLMs are vulnerable to prompt injection attacks. However, this vulnerability has been primarily demonstrated conceptually in academic studies or through a few anecdotal case studies. Its prevalence and impact in real-world LLM-based…

Cryptography and Security · Computer Science 2026-05-29 Mohan Zhang , Yuqi Jia , Zhen Tan , Steven Jiang , Neil Zhenqiang Gong , Tianlong Chen , Dawn Song

Third-party skills are becoming the package ecosystem for LLM agents. They package natural-language instructions, helper scripts, templates, documents, and service configuration into reusable workflows. This makes skills useful, but it also…

Cryptography and Security · Computer Science 2026-05-15 Haomin Zhuang , Hanwen Xing , Yujun Zhou , Yuchen Ma , Yue Huang , Yili Shen , Yufei Han , Xiangliang Zhang

Indirect Prompt Injection attacks exploit the inherent limitation of Large Language Models (LLMs) to distinguish between instructions and data in their inputs. Despite numerous defense proposals, the systematic evaluation against adaptive…

Large Language Models (LLMs) are attracting significant research attention due to their instruction-following abilities, allowing users and developers to leverage LLMs for a variety of tasks. However, LLMs are vulnerable to prompt-injection…

Cryptography and Security · Computer Science 2024-01-10 Julien Piet , Maha Alrashed , Chawin Sitawarin , Sizhe Chen , Zeming Wei , Elizabeth Sun , Basel Alomair , David Wagner

The rise of AI agent frameworks has introduced agent skills, modular packages containing instructions and executable code that dynamically extend agent capabilities. While this architecture enables powerful customization, skills execute…

Cryptography and Security · Computer Science 2026-01-16 Yi Liu , Weizhe Wang , Ruitao Feng , Yao Zhang , Guangquan Xu , Gelei Deng , Yuekang Li , Leo Zhang

Large language model (LLM) agents have demonstrated remarkable capabilities in complex reasoning and decision-making by leveraging external tools. However, this tool-centric paradigm introduces a previously underexplored attack surface,…

Artificial Intelligence · Computer Science 2026-01-08 Kanghua Mo , Li Hu , Yucheng Long , Zhihao Li

As autonomous agents (e.g., OpenClaw) increasingly operate with deep system-level privileges to execute complex tasks, they introduce severe, unmitigated security risks. Current vulnerability analyses overwhelmingly focus on single-turn,…

Cryptography and Security · Computer Science 2026-05-22 Jianan Ma , Xiaohu Du , Ruixiao Lin , Yaoxiang Bian , Jialuo Chen , Jingyi Wang , Xiaofang Yang , Shiwen Cui , Changhua Meng , Xinhao Deng , Zhen Wang

Large Language Models (LLMs) have enabled agents to move beyond conversation toward end-to-end task execution and become more helpful. However, this helpfulness introduces new security risks stem less from direct interface abuse than from…

Cryptography and Security · Computer Science 2026-01-19 Fengchao Chen , Tingmin Wu , Van Nguyen , Carsten Rudolph

Natural language interfaces to structured databases are becoming increasingly common, largely due to advances in large language models (LLMs) that enable users to query data using conversational input rather than formal query languages such…

Cryptography and Security · Computer Science 2026-05-12 Farzad Nourmohammadzadeh Motlagh , Mehrdad Hajizadeh , Mehryar Majd , Pejman Najafi , Feng Cheng , Christoph Meinel

While reasoning large language models (LLMs) demonstrate remarkable performance across various tasks, they also contain notable security vulnerabilities. Recent research has uncovered a "thinking-stopped" vulnerability in DeepSeek-R1, where…

Cryptography and Security · Computer Science 2025-04-30 Yu Cui , Yujun Cai , Yiwei Wang

Large Language Models (LLMs) are increasingly deployed as agents that orchestrate tasks and integrate external tools to execute complex workflows. We demonstrate that these interactive behaviors leave distinctive fingerprints in encrypted…

Cryptography and Security · Computer Science 2025-10-09 Yixiang Zhang , Xinhao Deng , Zhongyi Gu , Yihao Chen , Ke Xu , Qi Li , Jianping Wu

The proliferation of agentic AI coding assistants, including Claude Code, GitHub Copilot, Cursor, and emerging skill-based architectures, has fundamentally transformed software development workflows. These systems leverage Large Language…

Cryptography and Security · Computer Science 2026-01-27 Narek Maloyan , Dmitry Namiot

Security threats like prompt injection attacks pose significant risks to applications that integrate Large Language Models (LLMs), potentially leading to unauthorized actions such as API misuse. Unlike previous approaches that aim to detect…

Cryptography and Security · Computer Science 2025-04-01 Shih-Han Chan

Large Language Models (LLMs) guardrail systems are designed to protect against prompt injection and jailbreak attacks. However, they remain vulnerable to evasion techniques. We demonstrate two approaches for bypassing LLM prompt injection…

Cryptography and Security · Computer Science 2025-07-15 William Hackett , Lewis Birch , Stefan Trawicki , Neeraj Suri , Peter Garraghan

Agentic systems based on large language models (LLMs) operate not merely as text generators but as autonomous entities that dynamically retrieve information and invoke tools. This execution model shifts the attack surface from traditional…

Cryptography and Security · Computer Science 2026-04-21 Xiaochong Jiang , Shiqi Yang , Wenting Yang , Yichen Liu , Cheng Ji

Prompt injection attacks are an emerging threat to large language models (LLMs), enabling malicious users to manipulate outputs through carefully designed inputs. Existing detection approaches often require centralizing prompt data,…

Cryptography and Security · Computer Science 2025-11-18 Hasini Jayathilaka

LLM agents have demonstrated remarkable performance across various applications, primarily due to their advanced capabilities in reasoning, utilizing external knowledge and tools, calling APIs, and executing actions to interact with…

Machine Learning · Computer Science 2024-07-18 Zhaorun Chen , Zhen Xiang , Chaowei Xiao , Dawn Song , Bo Li

Large Language Models (LLMs) are increasingly integrated into real-world applications, from virtual assistants to autonomous agents. However, their flexibility also introduces new attack vectors-particularly Prompt Injection (PI), where…

Cryptography and Security · Computer Science 2025-09-17 Mengxiao Wang , Yuxuan Zhang , Guofei Gu

Prompt injection attacks manipulate large language models (LLMs) by misleading them to deviate from the original input instructions and execute maliciously injected instructions, because of their instruction-following capabilities and…

Cryptography and Security · Computer Science 2025-10-07 Yulin Chen , Haoran Li , Yuan Sui , Yufei He , Yue Liu , Yangqiu Song , Bryan Hooi