中文
相关论文

相关论文: Invisible Orchestrators Suppress Protective Behavi…

200 篇论文

Large Language Models (LLMs) are increasingly applied in healthcare, yet ensuring their ethical integrity and safety compliance remains a major barrier to clinical deployment. This work introduces a multi-agent refinement framework designed…

Recent advances in AI agents capable of solving complex, everyday tasks, from scheduling to customer service, have enabled deployment in real-world settings, but their possibilities for unsafe behavior demands rigorous evaluation. While…

Multi-agent LLM orchestration incurs synchronization costs scaling as O(n x S x |D|) in agents, steps, and artifact size under naive broadcast -- a regime I term broadcast-induced triply-multiplicative overhead. I argue this pathology is a…

分布式、并行与集群计算 · 计算机科学 2026-03-17 Vladyslav Parakhin

Insider threats pose a persistent and critical security risk, yet are notoriously difficult to detect in complex enterprise environments, where malicious actions are often hidden within seemingly benign user behaviors. Although…

密码学与安全 · 计算机科学 2026-01-06 Jiongchi Yu , Xiaofei Xie , Qiang Hu , Yuhan Ma , Ziming Zhao

Collections of interacting AI agents can form coalitions, creating emergent group-level organization that is critical for AI safety and alignment. However, observing agent behavior alone is often insufficient to distinguish genuine…

人工智能 · 计算机科学 2026-05-11 Cameron Berg , Susan L. Schneider , Mark M. Bailey

LLM agents do not act on raw interaction history; they act on a bounded decision state assembled by truncation, summarization, reordering, and rewriting. If directive-bearing state is dropped, weakened, or rebound during that step, an agent…

密码学与安全 · 计算机科学 2026-05-20 Igor Santos-Grueiro

The dark patterns, deceptive interface designs manipulating user behaviors, have been extensively studied for their effects on human decision-making and autonomy. Yet, with the rising prominence of LLM-powered GUI agents that automate tasks…

As agentic AI becomes more widespread, agents with distinct and possibly conflicting goals will interact in complex ways. These multi-agent interactions pose a fundamental challenge, particularly in social dilemmas, where agents' individual…

机器学习 · 计算机科学 2025-12-02 Dereck Piche , Mohammed Muqeeth , Milad Aghajohari , Juan Duque , Michael Noukhovitch , Aaron Courville

Multi-agent Large Language Model (LLM) systems have emerged as powerful architectures for complex task decomposition and collaborative problem-solving. However, their long-term behavioral stability remains largely unexamined. This study…

人工智能 · 计算机科学 2026-01-08 Abhishek Rath

Modern LLM based agents are no longer passive text generators. They read repositories, call tools, browse the web, execute code, maintain memory, communicate with other agents, and act through long horizon workflows. This shift moves the…

多智能体系统 · 计算机科学 2026-05-12 Tianxiao Li , Yixing Ma , Haiquan Wen , Zhenglin Huang , Qianyu Zhou , Zeyu Fu , Guangliang Cheng

Consider a multi-agent systems setup in which a principal (a supervisor agent) assigns subtasks to specialized agents and aggregates their responses into a single system-level output. A core property of such systems is information…

多智能体系统 · 计算机科学 2026-02-02 Paulius Rauba , Simonas Cepenas , Mihaela van der Schaar

We report an exploratory red-teaming study of autonomous language-model-powered agents deployed in a live laboratory environment with persistent memory, email accounts, Discord access, file systems, and shell execution. Over a two-week…

We argue that LLM agent security is fundamentally an agent-human interaction (AHI) problem, not a purely algorithmic one. To substantiate this position, we conduct a systematic analysis of 59 academic papers, 21 production agent systems,…

密码学与安全 · 计算机科学 2026-05-26 Peiran Wang , Ying Li , Yuan Tian

LLM agents in markets present algorithmic collusion risks. While prior work shows LLM agents reach supracompetitive prices through tacit coordination, existing research focuses on hand-crafted prompts. The emerging paradigm of prompt…

人工智能 · 计算机科学 2026-04-21 Yingtao Tian

As autonomous agents powered by LLM are increasingly deployed in society, understanding their collective behaviour in social dilemmas becomes critical. We introduce an evaluation framework where LLMs generate strategies encoded as…

多智能体系统 · 计算机科学 2026-02-19 Richard Willis , Jianing Zhao , Yali Du , Joel Z. Leibo

Agentic AI systems -- Large Language Models (LLMs) augmented with planning, tool use, memory, and long-horizon interactions -- can execute complex tasks autonomously, but their multi-step trajectories introduce new failure modes that…

Multi-agent LLM systems fail in production at rates between 41% and 87%, mostly due to coordination defects rather than base-model capability. Existing responses split between cataloguing failure modes empirically and shipping declarative…

多智能体系统 · 计算机科学 2026-05-06 Maksym Nechepurenko , Pavel Shuvalov

Service system performance depends on how participants respond to design choices, but modeling these responses is hard due to the complexity of human behavior. We introduce an LLM-powered multi-agent simulation (LLM-MAS) framework for…

人工智能 · 计算机科学 2026-04-07 Yanyuan Wang , Xiaowei Zhang

Self-organization is a process where a stable pattern is formed by the cooperative behavior between parts of an initially disordered system without external control or influence. It has been introduced to multi-agent systems as an internal…

人工智能 · 计算机科学 2021-05-27 Jieting Luo , Beishui Liao , John-Jules Meyer

Safe multi-agent coordination in uncertain environments can benefit from learning constraints from other agents. Implicitly communicating safety constraints through actions is a promising approach, allowing agents to coordinate and maintain…

系统与控制 · 电气工程与系统科学 2026-04-06 Minh Nguyen , Jingqi Li , Gechen Qu , Claire J. Tomlin