English
Related papers

Related papers: It's a TRAP! Task-Redirecting Agent Persuasion Ben…

200 papers

Web agents based on large language models have demonstrated promising capability in automating web tasks. However, current web agents struggle to reason out sensible actions due to the limitations of predicting environment changes, and…

Artificial Intelligence · Computer Science 2026-02-18 Zhouzhou Shen , Xueyu Hu , Xiyun Li , Tianqing Fang , Juncheng Li , Shengyu Zhang

Language agents increasingly act as web-enabled systems that search, browse, and synthesize information from diverse sources. However, these sources can include unreliable or adversarial content, and the robustness of agents to adversarial…

Artificial Intelligence · Computer Science 2026-03-03 Shrey Shah , Levent Ozgur

Large Language Models (LLMs) have demonstrated strong capabilities as autonomous agents through tool use, planning, and decision-making abilities, leading to their widespread adoption across diverse tasks. As task complexity grows,…

Multiagent Systems · Computer Science 2025-11-10 Ishan Kavathekar , Hemang Jain , Ameya Rathod , Ponnurangam Kumaraguru , Tanuja Ganu

Large Language Model (LLM) services and models often come with legal rules on who can use them and how they must use them. Assessing the compliance of the released LLMs is crucial, as these rules protect the interests of the LLM contributor…

Machine Learning · Computer Science 2024-06-07 Martin Gubri , Dennis Ulmer , Hwaran Lee , Sangdoo Yun , Seong Joon Oh

Graphical User Interface (GUI) agents extend large language models from text generation to action execution in real-world digital environments. Unlike conversational systems, GUI agents perform irreversible operations such as submitting…

Machine Learning · Computer Science 2026-02-25 Yucheng Shi , Wenhao Yu , Jingyuan Huang , Wenlin Yao , Wenhu Chen , Ninghao Liu

Reinforcement learning (RL) agents improve through trial-and-error, but when reward is sparse and the agent cannot discover successful action sequences, learning stagnates. This has been a notable problem in training deep RL agents to…

Artificial Intelligence · Computer Science 2018-02-27 Evan Zheran Liu , Kelvin Guu , Panupong Pasupat , Tianlin Shi , Percy Liang

Reinforcement learning often uses neural networks to solve complex control tasks. However, neural networks are sensitive to input perturbations, which makes their deployment in safety-critical environments challenging. This work lifts…

Machine Learning · Computer Science 2024-08-20 Manuel Wendl , Lukas Koller , Tobias Ladner , Matthias Althoff

Large language models (LLMs) are now routinely used to autonomously execute complex tasks, from natural language processing to dynamic workflows like web searches. The usage of tool-calling and Retrieval Augmented Generation (RAG) allows…

Cryptography and Security · Computer Science 2026-04-13 Dennis Rall , Bernhard Bauer , Mohit Mittal , Thomas Fraunholz

Large language models (LLMs) are increasingly being integrated into web browsers to create agentic browsing systems that execute actions on behalf of the user. Prior work considering the security of agentic browsers focuses exclusively on…

Cryptography and Security · Computer Science 2026-05-08 Sohom Datta , Alex Nahapetyan , William Enck , Alexandros Kapravelos

Large Language Model (LLM) agents can leverage tools such as Google Search to complete complex tasks. However, this tool usage introduces the risk of indirect prompt injections, where malicious instructions hidden in tool outputs can…

Machine Learning · Computer Science 2025-10-08 Zizhao Wang , Dingcheng Li , Vaishakh Keshava , Phillip Wallis , Ananth Balashankar , Peter Stone , Lukas Rutishauser

Vision-language model (VLM) based web agents demonstrate impressive autonomous GUI interaction but remain vulnerable to deceptive interface elements. Existing approaches either detect deception without task integration or document attacks…

Artificial Intelligence · Computer Science 2026-05-12 Yilin Zhang , Yingkai Hua , Chunyu Wei , Xin Wang , Yueguo Chen

We show that Web and Research Agents (WRAs) -- language-model-based systems that investigate complex topics on the Internet -- are vulnerable to inference attacks by passive network observers. Deployment of WRAs \emph{locally} by…

Cryptography and Security · Computer Science 2026-01-16 Hyejun Jeong , Mohammadreza Teymoorianfard , Abhinav Kumar , Amir Houmansadr , Eugene Bagdasarian

High-privilege LLM agents that autonomously process external documentation are increasingly trusted to automate tasks by reading and executing project instructions, yet they are granted terminal access, filesystem control, and outbound…

Cryptography and Security · Computer Science 2026-03-13 Ching-Yu Kao , Xinfeng Li , Shenyu Dai , Tianze Qiu , Pengcheng Zhou , Eric Hanchen Jiang , Philip Sperl

As LLM-based agents increasingly browse the web on users' behalf, a natural question arises: can websites passively identify which underlying model powers an agent? Doing so would represent a significant security risk, enabling targeted…

Cryptography and Security · Computer Science 2026-05-15 William Lugoloobi , Samuelle Marro , Jabez Magomere , Joss Wright , Chris Russell

Agentic large language model systems increasingly automate tasks by retrieving URLs and calling external tools. We show that this workflow gives rise to implicit prompt injection: adversarial instructions embedded in automatically generated…

Cryptography and Security · Computer Science 2026-02-27 Qianlong Lan , Anuj Kaul , Shaun Jones , Stephanie Westrum

AI agents are vulnerable to indirect prompt injection attacks, where malicious instructions embedded in external content or tool outputs cause unintended or harmful behavior. Inspired by the well-established concept of firewalls, we show…

Cryptography and Security · Computer Science 2026-03-24 Rishika Bhagwatkar , Kevin Kasa , Abhay Puri , Gabriel Huang , Irina Rish , Graham W. Taylor , Krishnamurthy Dj Dvijotham , Alexandre Lacoste

Autonomous browsing agents powered by large language models (LLMs) are increasingly used to automate web-based tasks. However, their reliance on dynamic content, tool execution, and user-provided data exposes them to a broad attack surface.…

Cryptography and Security · Computer Science 2025-05-20 Mykyta Mudryi , Markiyan Chaklosh , Grzegorz Wójcik

Despite rapid progress in autonomous web agents, human involvement remains essential for shaping preferences and correcting agent behavior as tasks unfold. However, current agentic systems lack a principled understanding of when and why…

Computation and Language · Computer Science 2026-03-02 Faria Huq , Zora Zhiruo Wang , Zhanqiu Guo , Venu Arvind Arangarajan , Tianyue Ou , Frank Xu , Shuyan Zhou , Graham Neubig , Jeffrey P. Bigham

Recently, autonomous agents built on large language models (LLMs) have experienced significant development and are being deployed in real-world applications. These agents can extend the base LLM's capabilities in multiple ways. For example,…

Cryptography and Security · Computer Science 2024-07-31 Boyang Zhang , Yicong Tan , Yun Shen , Ahmed Salem , Michael Backes , Savvas Zannettou , Yang Zhang

Large language models are increasingly evaluated as interactive agents, yet standard agent benchmarks conflate two qualitatively distinct sources of success: semantic tool-use and interface-specific interaction pattern memorization. Because…

Machine Learning · Computer Science 2026-02-03 Weizheng Gu , Chengze Li , Zhuohao Yu , Mengyuan Sun , Zhibang Yang , Wei Wang , Hongrui Jia , Shikun Zhang , Wei Ye