中文
相关论文

相关论文: Optimizing AI Agent Attacks With Synthetic Data

200 篇论文

Generative AI agents in life sciences face a critical challenge: determining the optimal approach for diverse queries ranging from simple factoid questions to complex mechanistic reasoning. Traditional methods rely on fixed rules or…

机器学习 · 计算机科学 2025-12-04 Nihir Chadderwala

Single-agent reinforcement learning algorithms in a multi-agent environment are inadequate for fostering cooperation. If intelligent agents are to interact and work together to solve complex problems, methods that counter non-cooperative…

机器学习 · 计算机科学 2022-03-09 Ted Fujimoto , Arthur Paul Pedersen

Organisations are starting to adopt LLM-based AI agents, with their deployments naturally evolving from single agents towards interconnected, multi-agent networks. Yet a collection of safe agents does not guarantee a safe collection of…

多智能体系统 · 计算机科学 2025-08-11 Alistair Reid , Simon O'Callaghan , Liam Carroll , Tiberio Caetano

Designing autonomous drone swarms is hampered by a vast design space spanning platform, algorithmic, and numerical-strength choices. We perform large-scale agent-based simulations in three canonical scenarios: swarm-on-swarm battle,…

系统与控制 · 电气工程与系统科学 2026-05-25 Abram H. Clark , Liraz Mudrik , Colton Kawamura , Nathan C. Redder , João P. Hespanha , Isaac Kaminer

Current AI agent frameworks commit early to a single interaction protocol, a fixed tool integration strategy, and static user models, limiting their deployment across diverse interaction paradigms. To address these constraints, we introduce…

人工智能 · 计算机科学 2026-03-25 Alfred Shen , Aaron Shen

Skill-based agent systems tackle complex tasks by composing reusable skills, improving modularity and scalability while introducing a largely unexamined security attack surface. We propose SkillTrojan, a backdoor attack that targets skill…

密码学与安全 · 计算机科学 2026-05-29 Yunhao Feng , Yifan Ding , Yingshui Tan , Boren Zheng , Yanming Guo , Xiaolong Li , Kun Zhai , Yishan Li , Wenke Huang

Autonomous Artificial Intelligence (AI) agents, powered by Large Language Models (LLMs), advance rapidly toward interconnected systems -- an Internet of Agents (IoA). This vision enables complex problem-solving while introducing systemic…

多智能体系统 · 计算机科学 2026-04-28 Juan A. Wibowo , George C. Polyzos

Autonomous AI agents that can follow instructions and perform complex multi-step tasks have tremendous potential to boost human productivity. However, to perform many of these tasks, the agents need access to personal information from their…

Autonomous AI agents extend large language models into full runtime systems that load skills, ingest external content, maintain memory, plan multi-step actions, and invoke privileged tools. In such systems, security failures rarely remain…

密码学与安全 · 计算机科学 2026-04-28 Yixiang Zhang , Xinhao Deng , Jiaqing Wu , Yue Xiao , Ke Xu , Qi Li

An Artificial Intelligence (AI) agent is a software entity that autonomously performs tasks or makes decisions based on pre-defined objectives and data inputs. AI agents, capable of perceiving user inputs, reasoning and planning tasks, and…

密码学与安全 · 计算机科学 2025-11-26 Zehang Deng , Yongjian Guo , Changzhou Han , Wanlun Ma , Junwu Xiong , Sheng Wen , Yang Xiang

Training intelligent agents through reinforcement learning is a notoriously unstable procedure. Massive parallelization on GPUs and distributed systems has been exploited to generate a large amount of training experiences and consequently…

机器学习 · 计算机科学 2019-02-08 Greg Heinrich , Iuri Frosio

We evaluate the autonomous cyber-attack capabilities of frontier AI models on two purpose-built cyber ranges-a 32-step corporate network attack and a 7-step industrial control system attack-that require chaining heterogeneous capabilities…

In recent years, agentic artificial intelligence (AI) systems are becoming increasingly widespread. These systems allow agents to use various tools, such as web browsers, compilers, and more. However, despite their popularity, agentic AI…

Future AI agents might run autonomously with elevated privileges. If these agents are misaligned, they might abuse these privileges to cause serious damage. The field of AI control develops techniques that make it harder for misaligned AIs…

密码学与安全 · 计算机科学 2025-12-18 Adam Kaufman , James Lucassen , Tyler Tracy , Cody Rushing , Aryan Bhatt

Synthetic data has emerged as a cost-effective alternative to real data for training artificial neural networks (ANN). However, the disparity between synthetic and real data results in a domain gap. That gap leads to poor performance and…

机器学习 · 计算机科学 2025-09-03 Paul Wachter , Lukas Niehaus , Julius Schöning

The discovery of Behavior Trees (BTs) impacted the field of Artificial Intelligence (AI) in games, by providing flexible and natural representation of non-player characters (NPCs) logic, manageable by game-designers. Nevertheless, increased…

人工智能 · 计算机科学 2021-11-25 Andrzej Kozik , Tomasz Machalewski , Mariusz Marek , Adrian Ochmann

Complex scheduling problems require a large amount computation power and innovative solution methods. The objective of this paper is the conception and implementation of a multi-agent system that is applicable in various problem domains.…

多智能体系统 · 计算机科学 2020-04-21 Peter Hillmann , Tobias Uhlig , Gabi Dreo Rodosek , Oliver Rose

We address the problem of allocating limited resources in a network under persistent yet statistically unknown adversarial attacks. Each node in the network may be degraded, but not fully disabled, depending on its available defensive…

数据结构与算法 · 计算机科学 2025-07-01 Mansoor Davoodi , Setareh Maghsudi

This survey paper examines the recent advancements in AI agent implementations, with a focus on their ability to achieve complex goals that require enhanced reasoning, planning, and tool execution capabilities. The primary objectives of…

人工智能 · 计算机科学 2024-04-18 Tula Masterman , Sandi Besen , Mason Sawtell , Alex Chao

This work focuses on the problem of distributed optimization in multi-agent cyberphysical systems, where a legitimate agent's iterates are influenced both by the values it receives from potentially malicious neighboring agents, and by its…

机器人学 · 计算机科学 2025-01-16 Michal Yemini , Angelia Nedić , Andrea J. Goldsmith , Stephanie Gil