English
Related papers

Related papers: When Convenience Becomes Risk: A Semantic View of …

200 papers

Large Language Models (LLMs) have enabled agents to move beyond conversation toward end-to-end task execution and become more helpful. However, this helpfulness introduces new security risks stem less from direct interface abuse than from…

Cryptography and Security · Computer Science 2026-01-19 Fengchao Chen , Tingmin Wu , Van Nguyen , Carsten Rudolph

Large language model (LLM) agents are vulnerable to prompt-injection attacks that propagate through multi-step workflows, tool interactions, and persistent context, making input-output filtering alone insufficient for reliable protection.…

Artificial Intelligence · Computer Science 2026-04-21 Hailin Liu , Eugene Ilyushin , Jie Ni , Min Zhu

Language model (LM) agents have demonstrated significant potential for automating real-world tasks, yet they pose a diverse array of potential, severe risks in safety-critical scenarios. In this work, we identify a significant gap between…

Artificial Intelligence · Computer Science 2025-08-20 Yuzhi Tang , Tianxiao Li , Elizabeth Li , Chris J. Maddison , Honghua Dong , Yangjun Ruan

Tool-enabled AI agents are increasingly deployed in cloud-hosted environments and offered as services, where they perform side-effecting operations through privileged tools within execution environments. While such agents enable powerful…

Cryptography and Security · Computer Science 2026-05-12 Hardik Goel

Judging an action's safety requires knowledge of the context in which the action takes place. To human agents who act in various contexts, this may seem obvious: performing an action such as email deletion may or may not be appropriate…

Cryptography and Security · Computer Science 2025-04-18 Lillian Tsai , Eugene Bagdasarian

OpenClaw-like agents offer substantial productivity benefits, yet they are insecure by default because they combine untrusted inputs, autonomous action, extensibility, and privileged system access within a single execution loop. We use…

Cryptography and Security · Computer Science 2026-03-16 Zongwei Li , Wenkai Li , Xiaoqi Li

Computer-use agents extend language models from text generation to persistent action over tools, files, and execution environments. Unlike chat systems, they maintain state across interactions and translate intermediate outputs into…

Artificial Intelligence · Computer Science 2026-04-06 Yunhao Feng , Yifan Ding , Yingshui Tan , Xingjun Ma , Yige Li , Yutao Wu , Yifeng Gao , Kun Zhai , Yanming Guo

Large Language Model agents deployed in complex environments frequently encounter a conflict between maximizing goal achievement and adhering to safety constraints. This paper identifies a new concept called Agentic Pressure, which…

Artificial Intelligence · Computer Science 2026-04-21 Hengle Jiang , Ke Tang

Agentic language-model systems increasingly rely on mutable execution contexts, including files, memory, tools, skills, and auxiliary artifacts, creating security risks beyond explicit user prompts. This paper presents DeepTrap, an…

Cryptography and Security · Computer Science 2026-05-13 Hongwei Yao , Yiming Liu , Yiling He , Bingrun Yang

Computer-use agents (CUAs) can now autonomously complete complex tasks in real digital environments, but when misled, they can also be used to automate harmful actions programmatically. Existing safety evaluations largely target explicit…

Cryptography and Security · Computer Science 2026-04-20 Xuwei Ding , Skylar Zhai , Linxin Song , Jiate Li , Taiwei Shi , Nicholas Meade , Siva Reddy , Jian Kang , Jieyu Zhao

The acquisition of agentic capabilities has transformed LLMs from "knowledge providers" to "action executors", a trend that while expanding LLMs' capability boundaries, significantly increases their susceptibility to malicious use. Previous…

Cryptography and Security · Computer Science 2025-05-30 Jinchuan Zhang , Lu Yin , Yan Zhou , Songlin Hu

For artificial intelligence to be beneficial to humans the behaviour of AI agents needs to be aligned with what humans want. In this paper we discuss some behavioural issues for language agents, arising from accidental misspecification by…

Artificial Intelligence · Computer Science 2021-03-30 Zachary Kenton , Tom Everitt , Laura Weidinger , Iason Gabriel , Vladimir Mikulik , Geoffrey Irving

While autonomous agents often surpass humans in their ability to handle vast and complex data, their potential misalignment (i.e., lack of transparency regarding their true objective) has thus far hindered their use in critical applications…

Artificial Intelligence · Computer Science 2024-12-03 Frédéric Berdoz , Roger Wattenhofer

Multi-agent systems where the agents are developed by parties with competing interests, and where there is no access to an agent's internal state, are often classified as `open'. The member agents of such systems may inadvertently fail to,…

Multiagent Systems · Computer Science 2010-05-27 Alexander Artikis

We study a variant of the principal-agent problem in which the principal does not directly observe the agent's effort outcome; rather, she gets a signal about the agent's action according to a variable information structure designed by a…

Computer Science and Game Theory · Computer Science 2024-09-06 Yakov Babichenko , Inbal Talgam-Cohen , Haifeng Xu , Konstantin Zabarnyi

When users work with AI agents, they form conscious or subconscious expectations of them. Meeting user expectations is crucial for such agents to engage in successful interactions and teaming. However, users may form expectations of an…

Artificial Intelligence · Computer Science 2025-09-26 Akkamahadevi Hanni , Jonathan Montaño , Yu Zhang

Open agentic systems combine LLM-based planning with external capabilities, persistent memory, and privileged execution. They are used in coding assistants, browser copilots, and enterprise automation. OpenClaw is a visible instance of this…

Cryptography and Security · Computer Science 2026-03-30 Shiping Chen , Qin Wang , Guangsheng Yu , Xu Wang , Liming Zhu

Browser agents enable autonomous web interaction but face critical reliability and security challenges in production. This paper presents findings from building and operating a production browser agent. The analysis examines where current…

Software Engineering · Computer Science 2025-11-26 Aram Vardanyan

Autonomous web agents solve complex browsing tasks, yet existing benchmarks measure only whether an agent finishes a task, ignoring whether it does so safely or in a way enterprises can trust. To integrate these agents into critical…

Artificial Intelligence · Computer Science 2026-03-03 Ido Levy , Ben Wiesel , Sami Marreed , Alon Oved , Avi Yaeli , Segev Shlomov

Experience-driven self-evolution has emerged as a promising paradigm for improving the autonomy of large language model agents, yet its reliance on self-curated experience introduces underexplored safety risks. In this study, we investigate…

Computation and Language · Computer Science 2026-04-21 Weixiang Zhao , Yichen Zhang , Yingshuo Wang , Yang Deng , Yanyan Zhao , Xuda Zhi , Yongbo Huang , HaoHe , Wanxiang Che , Bing Qin , Ting Liu
‹ Prev 1 2 3 10 Next ›