中文
相关论文

相关论文: Lessons from Penetration Tests on Large-Scale Agen…

200 篇论文

Evolving AI systems increasingly deploy multi-agent architectures where autonomous agents collaborate, share information, and delegate tasks through developing protocols. This connectivity, while powerful, introduces novel security risks.…

密码学与安全 · 计算机科学 2025-07-30 Gauri Sharma , Vidhi Kulkarni , Miles King , Ken Huang

Artificial intelligence (AI) systems are increasingly adopted as tool-using agents that can plan, observe their environment, and take actions over extended time periods. This evolution challenges current evaluation practices where the AI…

密码学与安全 · 计算机科学 2026-03-17 Simone Aonzo , Merve Sahin , Aurélien Francillon , Daniele Perito

For over a decade, cybersecurity has relied on human labor scarcity to limit attackers to high-value targets manually or generic automated attacks at scale. Building sophisticated exploits requires deep expertise and manual effort, leading…

密码学与安全 · 计算机科学 2026-02-04 Terry Yue Zhuo , Yangruibo Ding , Wenbo Guo , Ruijie Meng

Agentic AI systems are increasingly capable of performing professional and personal tasks with limited human involvement. However, tracking these developments is difficult because the AI agent ecosystem is complex, rapidly evolving, and…

计算机与社会 · 计算机科学 2026-05-07 Leon Staufer , Kevin Feng , Kevin Wei , Luke Bailey , Yawen Duan , Mick Yang , A. Pinar Ozisik , Stephen Casper , Noam Kolt

Recent advancements in Web AI agents have demonstrated remarkable capabilities in addressing complex web navigation tasks. However, emerging research shows that these agents exhibit greater vulnerability compared to standalone Large…

机器学习 · 计算机科学 2025-09-23 Jeffrey Yang Fan Chiang , Seungjae Lee , Jia-Bin Huang , Furong Huang , Yizheng Chen

AI agents powered by large language models (LLMs) are being deployed at scale, yet we lack a systematic understanding of how the choice of backbone LLM affects agent security. The non-deterministic sequential nature of AI agents complicates…

密码学与安全 · 计算机科学 2026-02-25 Julia Bazinska , Max Mathys , Francesco Casucci , Mateo Rojas-Carulla , Xander Davies , Alexandra Souly , Niklas Pfister

Autonomous browsing agents powered by large language models (LLMs) are increasingly used to automate web-based tasks. However, their reliance on dynamic content, tool execution, and user-provided data exposes them to a broad attack surface.…

密码学与安全 · 计算机科学 2025-05-20 Mykyta Mudryi , Markiyan Chaklosh , Grzegorz Wójcik

Artificial Intelligence (AI) agents have rapidly evolved from specialized, rule-based programs to versatile, learning-driven autonomous systems capable of perception, reasoning, and action in complex environments. The explosion of data,…

Agentic AI systems, specifically LLM-driven agents that plan, invoke tools, maintain persistent memory, and delegate tasks to peer agents via protocols such as MCP and A2A, introduce a threat surface that differs materially from standalone…

密码学与安全 · 计算机科学 2026-05-08 Javad Forough , Marios Kogias , Hamed Haddadi

The rapid evolution of large language model (LLM)-driven autonomous agents has given rise to OpenClaw, a new class of open-source agent frameworks that operate as continuously running, skill-augmented systems with persistent memory,…

人工智能 · 计算机科学 2026-05-26 Yuntao Wang , Jianle Ba , Han Liu , Yanghe Pan , Jintao Wei , Zhou Su , Tom H. Luan , Linkang Du

Recent advances have enabled LLM-powered AI agents to autonomously execute complex tasks by combining language model reasoning with tools, memory, and web access. But can these systems be trusted to follow deployment policies in realistic…

We investigate the emerging prospect of self-sovereign agents -- AI systems that can economically sustain and extend their own operation without human involvement. Recent advances in large language models and agent frameworks have…

密码学与安全 · 计算机科学 2026-04-13 Wenjie Qu , Xuandong Zhao , Jiaheng Zhang , Dawn Song

Autonomous AI agents powered by Large Language Models can reason, plan, and execute complex tasks, but their ability to autonomously retrieve information and run code introduces significant security risks. Existing approaches attempt to…

密码学与安全 · 计算机科学 2026-04-09 Hongyi Lu , Nian Liu , Shuai Wang , Fengwei Zhang

Embedded into information systems, artificial intelligence (AI) faces security threats that exploit AI-specific vulnerabilities. This paper provides an accessible overview of adversarial attacks unique to predictive and generative AI…

密码学与安全 · 计算机科学 2025-07-01 Naoto Kiribuchi , Kengo Zenitani , Takayuki Semitsu

Autonomous Artificial Intelligence (AI) agents, powered by Large Language Models (LLMs), advance rapidly toward interconnected systems -- an Internet of Agents (IoA). This vision enables complex problem-solving while introducing systemic…

多智能体系统 · 计算机科学 2026-04-28 Juan A. Wibowo , George C. Polyzos

Recent advances in AI are transforming AI's ubiquitous presence in our world from that of standalone AI-applications into deeply integrated AI-agents. These changes have been driven by agents' increasing capability to autonomously make…

密码学与安全 · 计算机科学 2025-07-04 Jose Sanchez Vicarte , Marcin Spoczynski , Mostafa Elsaid

A multi-agent AI system (MAS) is composed of multiple autonomous agents that interact, exchange information, and make decisions based on internal generative models. Recent advances in large language models and tool-using agents have made…

There have been recent adversarial attacks that are difficult to find. These new adversarial attacks methods may pose challenges to current deep learning cyber defense systems and could influence the future defense of cyberattacks. The…

机器学习 · 计算机科学 2023-08-25 John Harshith , Mantej Singh Gill , Madhan Jothimani

Tool-augmented AI agents substantially extend the practical capabilities of large language models, but they also introduce security risks that cannot be identified through model-only evaluation. In this paper, we present a systematic…

密码学与安全 · 计算机科学 2026-04-06 Yuhang Wang , Haichang Gao , Zhenxing Niu , Zhaoxiang Liu , Wenjing Zhang , Xiang Wang , Shiguo Lian

Autonomous AI agents powered by large language models are being deployed in production with capabilities including shell execution, file system access, database queries, and multi-party communication. Recent red teaming research…

密码学与安全 · 计算机科学 2026-03-19 Saikat Maiti