English
Related papers

Related papers: IterInject: Indirect Prompt Injection Against LLM …

200 papers

Agentic large language model systems increasingly automate tasks by retrieving URLs and calling external tools. We show that this workflow gives rise to implicit prompt injection: adversarial instructions embedded in automatically generated…

Cryptography and Security · Computer Science 2026-02-27 Qianlong Lan , Anuj Kaul , Shaun Jones , Stephanie Westrum

The rapid advancement of large language models (LLMs) has significantly enhanced the capabilities of AI-driven agents across various tasks. However, existing agentic systems, whether based on fixed pipeline algorithms or pre-defined…

Artificial Intelligence · Computer Science 2025-06-03 Xunjian Yin , Xinyi Wang , Liangming Pan , Li Lin , Xiaojun Wan , William Yang Wang

We have seen remarkable progress in large language models (LLMs) empowered multi-agent systems solving complex tasks necessitating cooperation among experts with diverse skills. However, optimizing LLM-based multi-agent systems remains…

Artificial Intelligence · Computer Science 2025-08-08 Ming Shen , Raphael Shu , Anurag Pratik , James Gung , Yubin Ge , Monica Sunkara , Yi Zhang

Recent work has questioned whether large language models (LLMs) can perform genuine in-context learning (ICL) for scientific experimental design, with prior studies suggesting that LLM-based agents exhibit no sensitivity to experimental…

As LLM-based agents increasingly operate in multi-agent systems, understanding adversarial manipulation becomes critical for defensive design. We present a systematic study of intentional deception as an engineered capability, using…

Artificial Intelligence · Computer Science 2026-03-10 Jason Starace , Terence Soule

Large language model (LLM) based web agents are increasingly deployed to automate complex online tasks by directly interacting with web sites and performing actions on users' behalf. While these agents offer powerful capabilities, their…

Cryptography and Security · Computer Science 2026-02-11 Georgios Syros , Evan Rose , Brian Grinstead , Christoph Kerschbaumer , William Robertson , Cristina Nita-Rotaru , Alina Oprea

Agent skills introduce a new and more severe form of indirect injection for LLM agents: unlike traditional indirect prompt injection, attackers can hide malicious instructions inside a dense, action-oriented skill that already functions as…

Cryptography and Security · Computer Science 2026-04-28 Wenjie Xiao , Xuehai Tang , Biyu Zhou , Songlin Hu , Jizhong Han

Large language model agents interleave reasoning, action selection, and observation to solve sequential decision-making tasks. In deployed settings where agents repeatedly handle related multi-step tasks, small action-selection errors can…

Artificial Intelligence · Computer Science 2026-05-13 Sheldon Yu , Junda Wu , Xintong Li , Nikki Lijing Kuang , Sizhe Zhou , Tong Yu , Jiawei Han , Jingbo Shang , Julian McAuley

Deploying large language model (LLM)-driven conversational agents in enterprise settings requires prompts that are simultaneously correct at launch and resilient to the non-deterministic behavioral drift that characterizes production LLM…

Artificial Intelligence · Computer Science 2026-05-18 Keshava Chaitanya , Jahnavi Gundakaram

Traditional control system design, reliant on expert knowledge and precise models, struggles with complex, nonlinear, or uncertain dynamics. This paper introduces AgenticControl, a novel multi-agent framework that automates controller…

Systems and Control · Electrical Eng. & Systems 2025-06-25 Mohammad Narimani , Seyyed Ali Emami

Historically, scientific discovery has been a lengthy and costly process, demanding substantial time and resources from initial conception to final results. To accelerate scientific discovery, reduce research costs, and improve research…

Human-Computer Interaction · Computer Science 2025-06-18 Samuel Schmidgall , Yusheng Su , Ze Wang , Ximeng Sun , Jialian Wu , Xiaodong Yu , Jiang Liu , Michael Moor , Zicheng Liu , Emad Barsoum

Large language models (LLMs) are fluent but largely static after pre-training; new or shifting knowledge is typically added with retrieval-augmented generation (RAG) or fine-tuning. RAG raises latency and engineering overhead and often…

Artificial Intelligence · Computer Science 2025-12-23 Rimom Costa

Machine learning has been widely used to optimize complex engineering workflows across numerous domains. In integrated circuit design, modern flows (e.g., register-transfer level to physical layout) involve extensive configuration via…

Artificial Intelligence · Computer Science 2026-05-01 Amur Ghose , Andrew B. Kahng , Sayak Kundu , Zhiang Wang

Autonomous agents powered by large language models (LLMs) enable novel use cases in domains where responsible action is increasingly important. Yet the inherent unpredictability of LLMs raises safety concerns about agent reliability. In…

Artificial Intelligence · Computer Science 2025-05-19 Jan Chojnacki

Insider threats pose a significant challenge to organizational security, often evading traditional rule-based detection systems due to their subtlety and contextual nature. This paper presents an AI-powered Insider Risk Management (IRM)…

Cryptography and Security · Computer Science 2025-05-08 Lokesh Koli , Shubham Kalra , Rohan Thakur , Anas Saifi , Karanpreet Singh

Large Language Model (LLM) based agents integrated into web browsers (often called agentic AI browsers) offer powerful automation of web tasks. However, they are vulnerable to indirect prompt injection attacks, where malicious instructions…

Cryptography and Security · Computer Science 2025-10-16 Avihay Cohen

Prompt engineering has demonstrated remarkable success in enhancing the performance of large language models (LLMs) across diverse tasks. However, most existing prompt optimization methods only focus on the task-level performance,…

Artificial Intelligence · Computer Science 2025-06-02 Yilun Kong , Hangyu Mao , Qi Zhao , Bin Zhang , Jingqing Ruan , Li Shen , Yongzhe Chang , Xueqian Wang , Rui Zhao , Dacheng Tao

We introduce AegisLLM, a cooperative multi-agent defense against adversarial attacks and information leakage. In AegisLLM, a structured workflow of autonomous agents - orchestrator, deflector, responder, and evaluator - collaborate to…

Machine Learning · Computer Science 2025-06-17 Zikui Cai , Shayan Shabihi , Bang An , Zora Che , Brian R. Bartoldson , Bhavya Kailkhura , Tom Goldstein , Furong Huang

As multimodal agents are increasingly trained to operate graphical user interfaces (GUIs) to complete user tasks, they face a growing threat from indirect prompt injection, attacks in which misleading instructions are embedded into the…

Artificial Intelligence · Computer Science 2025-05-21 Yijie Lu , Tianjie Ju , Manman Zhao , Xinbei Ma , Yuan Guo , ZhuoSheng Zhang

Embodied intelligence empowers agents with a profound sense of perception, enabling them to respond in a manner closely aligned with real-world situations. Large Language Models (LLMs) delve into language instructions with depth, serving a…

Multimedia · Computer Science 2024-07-17 Shuyuan Liu , Jiawei Chen , Shouwei Ruan , Hang Su , Zhaoxia Yin