English
Related papers

Related papers: IterInject: Indirect Prompt Injection Against LLM …

200 papers

Agentic AI systems use specialized agents to handle tasks within complex workflows, enabling automation and efficiency. However, optimizing these systems often requires labor-intensive, manual adjustments to refine roles, tasks, and…

Computation and Language · Computer Science 2024-12-24 Kamer Ali Yuksel , Hassan Sawaf

Large Language Model (LLM)-based agents with function-calling capabilities are increasingly deployed, but remain vulnerable to Indirect Prompt Injection (IPI) attacks that hijack their tool calls. In response, numerous IPI-centric defense…

Cryptography and Security · Computer Science 2025-11-20 Zimo Ji , Xunguang Wang , Zongjie Li , Pingchuan Ma , Yudong Gao , Daoyuan Wu , Xincheng Yan , Tian Tian , Shuai Wang

Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language understanding and generation, enabling their widespread adoption across various domains. However, their susceptibility to prompt injection attacks…

Cryptography and Security · Computer Science 2025-05-05 Jinsheng Pan , Xiaogeng Liu , Chaowei Xiao

Large language model (LLM) agents have emerged as a promising solution to automate the workflow of machine learning, but most existing methods share a common limitation: they attempt to optimize entire pipelines in a single step before…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Eric Xue , Ke Chen , Zeyi Huang , Yuyang Ji , Haohan Wang

AI agents such as OpenClaw are increasingly deployed in local workflows with access to external tools. This creates indirect prompt-injection (IPI) risk: an agent may execute harmful instructions embedded in untrusted inputs such as email,…

Cryptography and Security · Computer Science 2026-05-26 Lei Zhao , Abhay Bhaskar , Edgar Dobriban

LLM-integrated applications are vulnerable to prompt injection attacks, where an attacker contaminates the input to inject malicious instructions, causing the LLM to follow the attacker's intent instead of the original user's. Existing…

Cryptography and Security · Computer Science 2026-01-27 Wei Zou , Yupei Liu , Yanting Wang , Ying Chen , Neil Gong , Jinyuan Jia

AI agents equipped with tool-calling capabilities are susceptible to Indirect Prompt Injection (IPI) attacks. In this attack scenario, malicious commands hidden within untrusted content trick the agent into performing unauthorized actions.…

Cryptography and Security · Computer Science 2026-02-10 Minbeom Kim , Mihir Parmar , Phillip Wallis , Lesly Miculicich , Kyomin Jung , Krishnamurthy Dj Dvijotham , Long T. Le , Tomas Pfister

Large Language Model (LLM) Agents are an emerging computing paradigm that blends generative machine learning with tools such as code interpreters, web browsing, email, and more generally, external resources. These agent-based systems…

Cryptography and Security · Computer Science 2024-10-23 Xiaohan Fu , Shuheng Li , Zihan Wang , Yihao Liu , Rajesh K. Gupta , Taylor Berg-Kirkpatrick , Earlence Fernandes

Large Language Model (LLM) agents can leverage tools such as Google Search to complete complex tasks. However, this tool usage introduces the risk of indirect prompt injections, where malicious instructions hidden in tool outputs can…

Machine Learning · Computer Science 2025-10-08 Zizhao Wang , Dingcheng Li , Vaishakh Keshava , Phillip Wallis , Ananth Balashankar , Peter Stone , Lukas Rutishauser

Autonomous AI agents powered by large language models (LLMs) with structured function-calling interfaces enable real-time data retrieval, computation, and multi-step orchestration. However, the rapid growth of plugins, connectors, and…

Cryptography and Security · Computer Science 2025-12-16 Mohamed Amine Ferrag , Norbert Tihanyi , Djallel Hamouda , Leandros Maglaras , Abderrahmane Lakas , Merouane Debbah

Large Language Models (LLMs) are increasingly integrated into real-world applications, from virtual assistants to autonomous agents. However, their flexibility also introduces new attack vectors-particularly Prompt Injection (PI), where…

Cryptography and Security · Computer Science 2025-09-17 Mengxiao Wang , Yuxuan Zhang , Guofei Gu

Large language models (LLMs) are increasingly used as analyst assistants in security operations centers (SOCs), where they ingest log and alert data to produce triage labels, incident summaries, or remediation advice. We study a structural…

Cryptography and Security · Computer Science 2026-05-26 Rohan Pandey , Archit Bhujang

Powerful autonomous systems, which reason, plan, and converse using and between numerous tools and agents, are made possible by Large Language Models (LLMs), Vision-Language Models (VLMs), and new agentic AI systems, like LangChain and…

Cryptography and Security · Computer Science 2025-12-30 Toqeer Ali Syed , Mishal Ateeq Almutairi , Mahmoud Abdel Moaty

Large Language Models (LLMs) have enabled the development of powerful agentic systems capable of automating complex workflows across various fields. However, these systems are highly vulnerable to indirect prompt injection attacks, where…

Cryptography and Security · Computer Science 2026-01-16 Hao Li , Yankai Yang , G. Edward Suh , Ning Zhang , Chaowei Xiao

As AI agents automate critical workloads, they remain vulnerable to indirect prompt injection (IPI) attacks. Current defenses rely on monitoring protocols that jointly evaluate an agent's Chain-of-Thought (CoT) and tool-use actions to…

Cryptography and Security · Computer Science 2026-02-26 Jafar Isbarov , Murat Kantarcioglu

This work demonstrates that LLM-based web navigation agents offer powerful automation capabilities but are vulnerable to Indirect Prompt Injection (IPI) attacks. We show that adversaries can embed universal adversarial triggers in webpage…

Cryptography and Security · Computer Science 2025-07-22 Sam Johnson , Viet Pham , Thai Le

LLM-integrated applications and agents are vulnerable to prompt injection attacks, where adversaries embed malicious instructions within seemingly benign input data to manipulate the LLM's intended behavior. Recent defenses based on…

Cryptography and Security · Computer Science 2025-12-09 Sarthak Choudhary , Divyam Anshumaan , Nils Palumbo , Somesh Jha

Large Language Models (LLMs), while powerful, are built and trained to process a single text input. In common applications, multiple inputs can be processed by concatenating them together into a single stream of text. However, the LLM is…

Cryptography and Security · Computer Science 2024-03-25 Keegan Hines , Gary Lopez , Matthew Hall , Federico Zarfati , Yonatan Zunger , Emre Kiciman

System Instructions (SIs), or system prompts, are pivotal for guiding Large Language Models (LLMs) but manual crafting is resource-intensive and often suboptimal. Existing automated methods frequently generate non-human-readable "soft…

Artificial Intelligence · Computer Science 2025-07-08 Jeshwanth Challagundla

Modern scientific discovery increasingly relies on high-performance computing for complex modeling and simulation. A key challenge in improving parallel program performance is efficiently mapping tasks to processors and data to memory, a…

Machine Learning · Computer Science 2025-06-02 Anjiang Wei , Allen Nie , Thiago S. F. X. Teixeira , Rohan Yadav , Wonchan Lee , Ke Wang , Alex Aiken