English
Related papers

Related papers: ceLLMate: Sandboxing Browser AI Agents

200 papers

Language-model agents are increasingly used as persistent coworkers that assist users across multiple working days. During such workflows, the surrounding environment may change independently of the agent: new emails arrive, calendar…

AI agents hold the potential to revolutionize scientific productivity by automating literature reviews, replicating experiments, analyzing data, and even proposing new directions of inquiry; indeed, there are now many such agents, ranging…

Agentic AI coding editors driven by large language models have recently become more popular due to their ability to improve developer productivity during software development. Modern editors such as Cursor are designed not just for code…

Cryptography and Security · Computer Science 2026-04-29 Yue Liu , Yanjie Zhao , Yunbo Lyu , Ting Zhang , Haoyu Wang , David Lo

The emergence of Large Language Models (LLMs) has significantly advanced solutions across various domains, from political science to software development. However, these models are constrained by their training data, which is static and…

Artificial Intelligence · Computer Science 2025-09-16 Aadil Gani Ganie

This paper presents SANDMAN, an architecture for cyber deception that leverages Language Agents to emulate convincing human simulacra. Our 'Deceptive Agents' serve as advanced cyber decoys, designed for high-fidelity engagement with…

Artificial Intelligence · Computer Science 2025-03-26 Lewis Newsham , Ryan Hyland , Daniel Prince

Autonomous agents powered by foundation models have seen widespread adoption across various real-world applications. However, they remain highly vulnerable to malicious instructions and attacks, which can result in severe consequences such…

Machine Learning · Computer Science 2025-12-01 Zhaorun Chen , Mintong Kang , Bo Li

Web agents promise to automate complex browser tasks, but current methods remain brittle -- relying on step-by-step UI interactions and heavy LLM reasoning that break under dynamic layouts and long horizons. Humans, by contrast, exploit…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Viraj Prabhu , Yutong Dai , Matthew Fernandez , Jing Gu , Krithika Ramakrishnan , Yanqi Luo , Silvio Savarese , Caiming Xiong , Junnan Li , Zeyuan Chen , Ran Xu

Evaluating Computer Use Agents (CUAs) on interactive environments is fraught with methodological pitfalls that the field has yet to systematically address. We show that a 1MB replay script that blindly executes a recorded action sequence…

Software Engineering · Computer Science 2026-05-12 Pierluca D'Oro , Sneha Silwal , William Wong , Yuxuan Sun , Fanyi Xiao , Manchen Wang , Eric Gan , Allen Bolourchi , Joseph Tighe

AI agents capable of GUI understanding and Model Context Protocol are increasingly deployed to automate mobile tasks. However, their reliance on over-privileged, static permissions creates a critical vulnerability: instruction injection.…

Cryptography and Security · Computer Science 2025-10-31 Yifeng Cai , Ziming Wang , Zhaomeng Deng , Mengyu Yao , Junlin Liu , Yutao Hu , Ziqi Zhang , Yao Guo , Ding Li

AI agents are increasingly deployed to automate complex enterprise workflows, yet evidence of their effectiveness in identity governance is limited. We report results from the first randomized controlled trial (RCT) evaluating an AI agent…

General Economics · Economics 2025-11-19 James Bono , Beibei Cheng , Joaquin Lozano

Computer-use agent (CUA) frameworks, powered by large language models (LLMs) or multimodal LLMs (MLLMs), are rapidly maturing as assistants that can perceive context, reason, and act directly within software environments. Among their most…

Cryptography and Security · Computer Science 2025-10-13 Weidi Luo , Qiming Zhang , Tianyu Lu , Xiaogeng Liu , Bin Hu , Hung-Chun Chiu , Siyuan Ma , Yizhe Zhang , Xusheng Xiao , Yinzhi Cao , Zhen Xiang , Chaowei Xiao

Traditional cybersecurity tabletop exercises (TTXs) provide valuable training but are often scripted, resource-intensive, and difficult to scale. We introduce AgentBnB, a browser-based re-imagining of the Backdoors & Breaches game that…

Computation and Language · Computer Science 2025-11-04 Arman Anwar , Zefang Liu

Although browser-using agents (BUAs) show promise for web tasks and automation, most BUAs terminate after executing a single instruction, failing to support users' complex, nonlinear browsing with ambiguous goals, iterative decision-making,…

Human-Computer Interaction · Computer Science 2025-09-16 Hyeonggeun Yun , Jinkyu Jang

Personalized AI agents rely on access to a user's digital footprint, which often includes sensitive data from private emails, chats and purchase histories. Yet this access creates a fundamental societal and privacy risk: systems lacking…

Computation and Language · Computer Science 2026-01-01 Srija Mukhopadhyay , Sathwik Reddy , Shruthi Muthukumar , Jisun An , Ponnurangam Kumaraguru

AI agents -- systems that combine foundation models with reasoning, planning, memory, and tool use -- are rapidly becoming a practical interface between natural-language intent and real-world computation. This survey synthesizes the…

Artificial Intelligence · Computer Science 2026-01-06 Bin Xu

This paper introduces BioAgent Bench, a benchmark dataset and an evaluation suite designed for measuring the performance and robustness of AI agents in common bioinformatics tasks. The benchmark contains curated end-to-end tasks (e.g.,…

Artificial Intelligence · Computer Science 2026-05-08 Dionizije Fa , Marko Culjak , Bruno Pandza , Mateo Cupic

Large Vision-Language Models (LVLMs) empower autonomous mobile agents, yet their security under realistic mobile deployment constraints remains underexplored. While agents are vulnerable to visual prompt injections, stealthily executing…

Cryptography and Security · Computer Science 2026-04-10 Renhua Ding , Xiao Yang , Zhengwei Fang , Jun Luo , Kun He , Jun Zhu

AI agents equipped with tool-calling capabilities are susceptible to Indirect Prompt Injection (IPI) attacks. In this attack scenario, malicious commands hidden within untrusted content trick the agent into performing unauthorized actions.…

Cryptography and Security · Computer Science 2026-02-10 Minbeom Kim , Mihir Parmar , Phillip Wallis , Lesly Miculicich , Kyomin Jung , Krishnamurthy Dj Dvijotham , Long T. Le , Tomas Pfister

Large vision-language model (LVLM)-based web agents are emerging as powerful tools for automating complex online tasks. However, when deployed in real-world environments, they face serious security risks, motivating the design of security…

Cryptography and Security · Computer Science 2026-04-15 Zonghao Ying , Yangguang Shao , Jianle Gan , Gan Xu , Wenxin Zhang , Quanchen Zou , Junzheng Shi , Zhenfei Yin , Mingchuan Zhang , Aishan Liu , Xianglong Liu

Generative AI agents, software systems powered by Large Language Models (LLMs), are emerging as a promising approach to automate cybersecurity tasks. Among the others, penetration testing is a challenging field due to the task complexity…

Cryptography and Security · Computer Science 2024-10-29 Luca Gioacchini , Marco Mellia , Idilio Drago , Alexander Delsanto , Giuseppe Siracusano , Roberto Bifulco