English
Related papers

Related papers: MUZZLE: Adaptive Agentic Red-Teaming of Web Agents…

200 papers

Although multimodal large language models (MLLMs) are increasingly deployed in real-world applications, their instruction-following behavior leaves them vulnerable to prompt injection attacks. Existing prompt injection methods predominantly…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Meiwen Ding , Song Xia , Chenqi Kong , Xudong Jiang

Recent work has embodied LLMs as agents, allowing them to access tools, perform actions, and interact with external content (e.g., emails or websites). However, external content introduces the risk of indirect prompt injection (IPI)…

Computation and Language · Computer Science 2024-08-06 Qiusi Zhan , Zhixiang Liang , Zifan Ying , Daniel Kang

Agentic AI and Multi-Agent Systems are poised to dominate industry and society imminently. Powered by goal-driven autonomy, they represent a powerful form of generative AI, marking a transition from reactive content generation into…

Software Engineering · Computer Science 2025-12-29 Brian Bowers , Smita Khapre , Jugal Kalita

Autonomous agents powered by large vision and language models (VLM) have demonstrated significant potential in completing daily computer tasks, such as browsing the web to book travel and operating desktop software, which requires agents to…

Computation and Language · Computer Science 2025-05-27 Yanzhe Zhang , Tao Yu , Diyi Yang

With the advent and widespread deployment of Multimodal Large Language Models (MLLMs), the imperative to ensure their safety has become increasingly pronounced. However, with the integration of additional modalities, MLLMs are exposed to…

Cryptography and Security · Computer Science 2024-03-15 Yu Wang , Xiaogeng Liu , Yu Li , Muhao Chen , Chaowei Xiao

Large Vision-Language Models (LVLMs) empower autonomous mobile agents, yet their security under realistic mobile deployment constraints remains underexplored. While agents are vulnerable to visual prompt injections, stealthily executing…

Cryptography and Security · Computer Science 2026-04-10 Renhua Ding , Xiao Yang , Zhengwei Fang , Jun Luo , Kun He , Jun Zhu

Large Language Model (LLM) agents offer a powerful new paradigm for solving various problems by combining natural language reasoning with the execution of external tools. However, their dynamic and non-transparent behavior introduces…

Cryptography and Security · Computer Science 2025-11-19 Peiran Wang , Yang Liu , Yunfei Lu , Yifeng Cai , Hongbo Chen , Qingyou Yang , Jie Zhang , Jue Hong , Ye Wu

LLM-based agents execute real-world workflows via tools and memory. These affordances enable ill-intended adversaries to also use these agents to carry out complex misuse scenarios. Existing agent misuse benchmarks largely test…

Computation and Language · Computer Science 2026-05-19 Nivya Talokar , Ayush K Tarun , Murari Mandal , Maksym Andriushchenko , Antoine Bosselut

As the AI systems become deeply embedded in social media platforms, we've uncovered a concerning security vulnerability that goes beyond traditional adversarial attacks. It becomes important to assess the risks of LLMs before the general…

Computation and Language · Computer Science 2025-05-30 Nilanjana Das , Edward Raff , Aman Chadha , Manas Gaur

The emergence of agent-to-agent communication protocols mirrors the early internet: powerful connectivity with minimal security infrastructure. When AI agents communicate on behalf of users, every message crosses a trust boundary where the…

Cryptography and Security · Computer Science 2026-03-03 Sahar Abdelnabi , Amr Gomaa , Eugene Bagdasarian , Per Ola Kristensson , Reza Shokri

Multi-agent debate (MAD) systems leverage collaborative interactions among large language models (LLMs) agents to improve reasoning capabilities. While recent studies have focused on increasing the accuracy and scalability of MAD systems,…

Cryptography and Security · Computer Science 2025-07-18 Yu Cui , Hongyang Du

Recent advancements in Large Language Models (LLMs) have led to a rapid growth of agentic systems capable of handling a wide range of complex tasks. However, current research largely relies on manual, task-specific design, limiting their…

Computation and Language · Computer Science 2025-02-28 Yu Shang , Yu Li , Keyu Zhao , Likai Ma , Jiahe Liu , Fengli Xu , Yong Li

Due to their unprecedented ability to process and respond to various types of data, Multimodal Large Language Models (MLLMs) are constantly defining the new boundary of Artificial General Intelligence (AGI). As these advanced generative…

Cryptography and Security · Computer Science 2024-06-04 Zhen Tan , Chengshuai Zhao , Raha Moraffah , Yifan Li , Yu Kong , Tianlong Chen , Huan Liu

Autonomous computer use agents that powered by multimodal large language models (MLLMs) are emerging as capable assistants for completing complex digital workflows. However, real-world execution environments are far from ideal: pop-ups,…

Artificial Intelligence · Computer Science 2026-05-26 Jingwei Sun , Jianing Zhu , Yuanyi Li , Tongliang Liu , Xia HU , Bo Han

Large language models (LLMs) are increasingly used in interactive and retrieval-augmented systems, but they remain vulnerable to prompt injection attacks, where injected secondary prompts force the model to deviate from the user's…

Cryptography and Security · Computer Science 2026-04-02 Md Jahedur Rahman , Ihsen Alouani

Accurate vulnerability-inducing commit identification serves as a foundation for a series of software security tasks, such as vulnerability detection and affected version analysis. A straightforward solution is the SZZ algorithm, which…

Cryptography and Security · Computer Science 2026-04-28 Sicong Cao , Jinxuan Xu , Le Yu , Jing Yang , Xingwei Lin , Linlin Zhu , Fu Xiao

Vision-Language Model (VLM) based Web Agents represent a significant step towards automating complex tasks by simulating human-like interaction with websites. However, their deployment in uncontrolled web environments introduces significant…

Cryptography and Security · Computer Science 2025-05-28 Haowei Wang , Junjie Wang , Xiaojun Jia , Rupeng Zhang , Mingyang Li , Zhe Liu , Yang Liu , Qing Wang

The widespread deployment of LLM-based agents is likely to introduce a critical privacy threat: malicious agents that proactively engage others in multi-turn interactions to extract sensitive information. However, the evolving nature of…

Cryptography and Security · Computer Science 2026-05-11 Yanzhe Zhang , Diyi Yang

Graphical User Interface (GUI) agents are increasingly deployed to interact with online web services, yet their exposure to open-world content renders them vulnerable to Environmental Injection Attacks (EIAs). In these attacks, an attacker…

Cryptography and Security · Computer Science 2026-02-03 Yitong Zhang , Ximo Li , Liyi Cai , Jia Li

Web agents can autonomously complete online tasks by interacting with websites, but their exposure to open web environments makes them vulnerable to prompt injection attacks embedded in HTML content or visual interfaces. Existing guard…

Cryptography and Security · Computer Science 2026-05-15 Tri Cao , Yulin Chen , Hieu Cao , Yibo Li , Khoi Le , Thong Nguyen , Yuexin Li , Yufei He , Yue Liu , Shuicheng Yan , Bryan Hooi