中文
相关论文

相关论文: Red-Teaming Agent Execution Contexts: Open-World S…

200 篇论文

With the rise of personalized, persistent LLM agent frameworks such as OpenClaw, human-centered agentic social networks in which teams of collaborative AI agents serve individual users in a social network across multiple domains are…

人工智能 · 计算机科学 2026-04-07 Prince Zizhuang Wang , Shuli Jiang

Large language model (LLM)-based agents combine LLMs with external tools to automate tasks such as scheduling meetings, managing documents, or booking travel. While these integrations unlock powerful capabilities, they also create new and…

密码学与安全 · 计算机科学 2026-04-22 Jonathan Evertz , Merlin Chlosta , Lea Schönherr , Thorsten Eisenhofer

Generative language models are increasingly used for contract drafting and enhancement, creating a scenario where competing parties deploy different language models against each other. This introduces not only a game-theory challenge but…

计算与语言 · 计算机科学 2025-01-03 Arinbjörn Kolbeinsson , Benedikt Kolbeinsson

Agentic methods have emerged as a powerful and autonomous paradigm that enhances reasoning, collaboration, and adaptive control, enabling systems to coordinate and independently solve complex tasks. We extend this paradigm to safety…

人工智能 · 计算机科学 2025-10-30 Juan Ren , Mark Dras , Usman Naseem

Large language models are increasingly being used to support network operations (NetOps) and artificial intelligence for IT operations (AIOps), including incident investigation, root-cause analysis, configuration synthesis, and limited…

网络与互联网体系结构 · 计算机科学 2026-05-14 Muhammad Bilal , Jon Crowcroft , Ruizhi Wang , Xiaolong Xu , Schahram Dustdar

AI-enabled Security Orchestration, Automation, and Response (SOAR) systems increasingly employ autonomous agents for cyber defense, yet their resilience to adaptive adversaries is underexplored. We introduce an autonomous red teaming…

密码学与安全 · 计算机科学 2026-05-19 Ayan Javeed Shaikh , Nathaniel D. Bastian , Ankit Shah

Authorizing Large Language Model (LLM)-driven agents to dynamically invoke tools and access protected resources introduces significant security risks, and the risks grow dramatically as agents engage in multi-turn conversations and scale…

人工智能 · 计算机科学 2026-05-05 Majed El Helou , Benjamin Ryder , Chiara Troiani , Jean Diaconu , Hervé Muyal , Marcelo Yannuzzi

Reusable skills are becoming a common interface for extending large language model agents, packaging procedural guidance with access to files, tools, memory, and execution environments. However, this modularity introduces attack surfaces…

密码学与安全 · 计算机科学 2026-05-28 Chang Jin , An Wang , Zeming Wei , Kai Wang , Biaojie Zeng , Qiaosheng Zhang , Chao Yang , Jingjing Qu , Xia Hu , Xingcheng Xu

We present an openly documented methodology for fine-tuning language models to detect temporal attack patterns in multi-agent AI workflows using OpenTelemetry trace analysis. We curate a dataset of 80,851 examples from 18 public…

人工智能 · 计算机科学 2026-01-06 Ron F. Del Rosario

AI agents that autonomously interact with external tools and environments have shown great promise across real-world applications. However, their reliance on external data exposes them to serious indirect prompt injection attacks, where…

密码学与安全 · 计算机科学 2026-05-08 Hao Li , Ruoyao Wen , Shanghao Shi , Ning Zhang , Yevgeniy Vorobeychik , Chaowei Xiao

As autonomous AI agents are increasingly deployed in high-stakes environments, ensuring their safety and alignment with human values is becoming a practical deployment concern. Current benchmarks for AI agents primarily evaluate refusal of…

人工智能 · 计算机科学 2026-05-12 Miles Q. Li , Benjamin C. M. Fung , Martin Weiss , Pulei Xiong , Khalil Al-Hussaeni , Claude Fachkha

Agentic AI represents a paradigm shift in enhancing the capabilities of generative AI models. While these systems demonstrate immense potential and power, current evaluation techniques primarily focus on assessing their efficacy in…

人工智能 · 计算机科学 2025-09-30 Hassen Dhrif

Large Language Models (LLMs) are increasingly deployed as agentic systems that plan, memorize, and act in open-world environments. This shift brings new security problems: failures are no longer only unsafe text generation, but can become…

密码学与安全 · 计算机科学 2026-03-03 Zhihang Deng , Jiaping Gui , Weinan Zhang

Vision-Language-Action (VLA) systems have shown strong potential for language-driven robotic manipulation. However, scaling them to long-horizon tasks remains challenging. Existing pipelines typically separate data collection, policy…

Red teaming is critical for identifying vulnerabilities and building trust in current LLMs. However, current automated methods for Large Language Models (LLMs) rely on brittle prompt templates or single-turn attacks, failing to capture the…

机器学习 · 计算机科学 2025-08-07 Roman Belaire , Arunesh Sinha , Pradeep Varakantham

Autonomous AI agents powered by Large Language Models can reason, plan, and execute complex tasks, but their ability to autonomously retrieve information and run code introduces significant security risks. Existing approaches attempt to…

密码学与安全 · 计算机科学 2026-04-09 Hongyi Lu , Nian Liu , Shuai Wang , Fengwei Zhang

AI agents deployed as persistent assistants must maintain correct beliefs as their information environment evolves. In practice, evidence is scattered across heterogeneous sources that often contradict one another, new information can…

机器学习 · 计算机科学 2026-05-19 Haonian Ji , Kaiwen Xiong , Siwei Han , Peng Xia , Shi Qiu , Yiyang Zhou , Jiaqi Liu , Jinlong Li , Bingzhou Li , Zeyu Zheng , Cihang Xie , Huaxiu Yao

The performance of large language model (LLM) agents depends critically on the execution harness, the system layer that orchestrates tool use, context management, and state persistence. Yet this same architectural centrality makes the…

密码学与安全 · 计算机科学 2026-05-12 Xixun Lin , Yang Liu , Yancheng Chen , Yongxuan Wu , Yucheng Ning , Yilong Liu , Nan Sun , Shun Zhang , Bin Chong , Chuan Zhou , Yanan Cao

Large Language Model (LLM)-based agents are widely used in real-world applications such as customer service, web navigation, and software engineering. As these systems become more autonomous and are deployed at scale, understanding why an…

人工智能 · 计算机科学 2026-02-06 Chen Qian , Peng Wang , Dongrui Liu , Junyao Yang , Dadi Guo , Ling Tang , Jilin Mei , Qihan Ren , Shuai Shao , Yong Liu , Jie Fu , Jing Shao , Xia Hu

As frontier AI models are deployed in high-stakes decision pipelines, their ability to maintain metacognitive stability (knowing what they do not know, detecting errors, seeking clarification) under adversarial pressure is a critical safety…

人工智能 · 计算机科学 2026-05-15 Rahul Kumar