中文
相关论文

相关论文: When Convenience Becomes Risk: A Semantic View of …

200 篇论文

Large Language Models (LLMs) have enabled agents to move beyond conversation toward end-to-end task execution and become more helpful. However, this helpfulness introduces new security risks stem less from direct interface abuse than from…

密码学与安全 · 计算机科学 2026-01-19 Fengchao Chen , Tingmin Wu , Van Nguyen , Carsten Rudolph

Large language model (LLM) agents are vulnerable to prompt-injection attacks that propagate through multi-step workflows, tool interactions, and persistent context, making input-output filtering alone insufficient for reliable protection.…

人工智能 · 计算机科学 2026-04-21 Hailin Liu , Eugene Ilyushin , Jie Ni , Min Zhu

Language model (LM) agents have demonstrated significant potential for automating real-world tasks, yet they pose a diverse array of potential, severe risks in safety-critical scenarios. In this work, we identify a significant gap between…

人工智能 · 计算机科学 2025-08-20 Yuzhi Tang , Tianxiao Li , Elizabeth Li , Chris J. Maddison , Honghua Dong , Yangjun Ruan

Tool-enabled AI agents are increasingly deployed in cloud-hosted environments and offered as services, where they perform side-effecting operations through privileged tools within execution environments. While such agents enable powerful…

密码学与安全 · 计算机科学 2026-05-12 Hardik Goel

Judging an action's safety requires knowledge of the context in which the action takes place. To human agents who act in various contexts, this may seem obvious: performing an action such as email deletion may or may not be appropriate…

密码学与安全 · 计算机科学 2025-04-18 Lillian Tsai , Eugene Bagdasarian

OpenClaw-like agents offer substantial productivity benefits, yet they are insecure by default because they combine untrusted inputs, autonomous action, extensibility, and privileged system access within a single execution loop. We use…

密码学与安全 · 计算机科学 2026-03-16 Zongwei Li , Wenkai Li , Xiaoqi Li

Computer-use agents extend language models from text generation to persistent action over tools, files, and execution environments. Unlike chat systems, they maintain state across interactions and translate intermediate outputs into…

人工智能 · 计算机科学 2026-04-06 Yunhao Feng , Yifan Ding , Yingshui Tan , Xingjun Ma , Yige Li , Yutao Wu , Yifeng Gao , Kun Zhai , Yanming Guo

Large Language Model agents deployed in complex environments frequently encounter a conflict between maximizing goal achievement and adhering to safety constraints. This paper identifies a new concept called Agentic Pressure, which…

人工智能 · 计算机科学 2026-04-21 Hengle Jiang , Ke Tang

Agentic language-model systems increasingly rely on mutable execution contexts, including files, memory, tools, skills, and auxiliary artifacts, creating security risks beyond explicit user prompts. This paper presents DeepTrap, an…

密码学与安全 · 计算机科学 2026-05-13 Hongwei Yao , Yiming Liu , Yiling He , Bingrun Yang

Computer-use agents (CUAs) can now autonomously complete complex tasks in real digital environments, but when misled, they can also be used to automate harmful actions programmatically. Existing safety evaluations largely target explicit…

密码学与安全 · 计算机科学 2026-04-20 Xuwei Ding , Skylar Zhai , Linxin Song , Jiate Li , Taiwei Shi , Nicholas Meade , Siva Reddy , Jian Kang , Jieyu Zhao

The acquisition of agentic capabilities has transformed LLMs from "knowledge providers" to "action executors", a trend that while expanding LLMs' capability boundaries, significantly increases their susceptibility to malicious use. Previous…

密码学与安全 · 计算机科学 2025-05-30 Jinchuan Zhang , Lu Yin , Yan Zhou , Songlin Hu

For artificial intelligence to be beneficial to humans the behaviour of AI agents needs to be aligned with what humans want. In this paper we discuss some behavioural issues for language agents, arising from accidental misspecification by…

人工智能 · 计算机科学 2021-03-30 Zachary Kenton , Tom Everitt , Laura Weidinger , Iason Gabriel , Vladimir Mikulik , Geoffrey Irving

While autonomous agents often surpass humans in their ability to handle vast and complex data, their potential misalignment (i.e., lack of transparency regarding their true objective) has thus far hindered their use in critical applications…

人工智能 · 计算机科学 2024-12-03 Frédéric Berdoz , Roger Wattenhofer

Multi-agent systems where the agents are developed by parties with competing interests, and where there is no access to an agent's internal state, are often classified as `open'. The member agents of such systems may inadvertently fail to,…

多智能体系统 · 计算机科学 2010-05-27 Alexander Artikis

We study a variant of the principal-agent problem in which the principal does not directly observe the agent's effort outcome; rather, she gets a signal about the agent's action according to a variable information structure designed by a…

计算机科学与博弈论 · 计算机科学 2024-09-06 Yakov Babichenko , Inbal Talgam-Cohen , Haifeng Xu , Konstantin Zabarnyi

When users work with AI agents, they form conscious or subconscious expectations of them. Meeting user expectations is crucial for such agents to engage in successful interactions and teaming. However, users may form expectations of an…

人工智能 · 计算机科学 2025-09-26 Akkamahadevi Hanni , Jonathan Montaño , Yu Zhang

Open agentic systems combine LLM-based planning with external capabilities, persistent memory, and privileged execution. They are used in coding assistants, browser copilots, and enterprise automation. OpenClaw is a visible instance of this…

密码学与安全 · 计算机科学 2026-03-30 Shiping Chen , Qin Wang , Guangsheng Yu , Xu Wang , Liming Zhu

Browser agents enable autonomous web interaction but face critical reliability and security challenges in production. This paper presents findings from building and operating a production browser agent. The analysis examines where current…

软件工程 · 计算机科学 2025-11-26 Aram Vardanyan

Autonomous web agents solve complex browsing tasks, yet existing benchmarks measure only whether an agent finishes a task, ignoring whether it does so safely or in a way enterprises can trust. To integrate these agents into critical…

人工智能 · 计算机科学 2026-03-03 Ido Levy , Ben Wiesel , Sami Marreed , Alon Oved , Avi Yaeli , Segev Shlomov

Experience-driven self-evolution has emerged as a promising paradigm for improving the autonomy of large language model agents, yet its reliance on self-curated experience introduces underexplored safety risks. In this study, we investigate…

计算与语言 · 计算机科学 2026-04-21 Weixiang Zhao , Yichen Zhang , Yingshuo Wang , Yang Deng , Yanyan Zhao , Xuda Zhi , Yongbo Huang , HaoHe , Wanxiang Che , Bing Qin , Ting Liu
‹ 上一页 1 2 3 10 下一页 ›