中文
相关论文

相关论文: Safe Multi-Agent Behavior Must Be Maintained, Not …

200 篇论文

Autonomous driving has made significant strides through data-driven techniques, achieving robust performance in standardized tasks. However, existing methods frequently overlook user-specific preferences, offering limited scope for…

机器人学 · 计算机科学 2025-05-13 Chengkai Xu , Jiaqi Liu , Yicheng Guo , Yuhang Zhang , Peng Hang , Jian Sun

Autonomous Large Language Model (LLM) agents are increasingly deployed to conduct complex tasks by interacting with external tools, APIs, and memory stores. However, processing untrusted external data exposes these agents to severe security…

密码学与安全 · 计算机科学 2026-04-28 Yuandao Cai , Wensheng Tang , Cheng Wen , Shengchao Qin

As Large Language Models (LLMs) continue to be increasingly applied across various domains, their widespread adoption necessitates rigorous monitoring to prevent unintended negative consequences and ensure robustness. Furthermore, LLMs must…

计算与语言 · 计算机科学 2025-07-09 Seshu Tirupathi , Dhaval Salwala , Elizabeth Daly , Inge Vejsbjerg

With the rapid advancement of post-training techniques for reasoning and information seeking, large language models (LLMs) can incorporate a large quantity of retrieved knowledge to solve complex tasks. However, the limited context window…

计算与语言 · 计算机科学 2026-04-21 Zijun Liu , Zhennan Wan , Peng Li , Ming Yan , Fei Huang , Yang Liu

Large Language Models (LLMs) have enabled collaborative Multi-Agent (MA) systems, where interacting agents improve performance through diverse reasoning and iterative refinement. However, these systems remain vulnerable to error…

多智能体系统 · 计算机科学 2026-05-21 Yong Jin Chun , Iftekhar Ahmed

With recent advances in Large Language Models (LLMs), Agentic AI has become phenomenal in real-world applications, moving toward multiple LLM-based agents to perceive, learn, reason, and act collaboratively. These LLM-based Multi-Agent…

人工智能 · 计算机科学 2025-01-14 Khanh-Tung Tran , Dung Dao , Minh-Duong Nguyen , Quoc-Viet Pham , Barry O'Sullivan , Hoang D. Nguyen

Agentic systems for business process automation often require compliance with policies governing conditional updates to the system state. Evaluation of policy adherence in LLM-based agentic workflows is typically performed by comparing the…

计算与语言 · 计算机科学 2026-05-15 Ella Rabinovich , David Boaz , Naama Zwerdling , Ateret Anaby-Tavor

Autonomous agents based on large language models (LLMs) are rapidly emerging as a general-purpose technology, with recent systems such as OpenClaw extending their capabilities through broad tool use, third-party skills, and deeper…

密码学与安全 · 计算机科学 2026-05-15 Lukas Pirch , Micha Horlboge , Patrick Großmann , Syeda Mahnur Asif , Klim Kireev , Thorsten Holz , Konrad Rieck

Large Language Model (LLM)-powered agents demonstrate strong capabilities in autonomous task execution, tool use, and multi-step reasoning. However, their increasing autonomy also introduces a new attack surface: adversarial interactions…

人工智能 · 计算机科学 2026-05-05 Sheldon Yu , Yingcheng Sun , Hanqing Guo , Julian McAuley , Qianqian Tong

Autonomous agents empowered by Large Language Models (LLMs) have undergone significant improvements, enabling them to generalize across a broad spectrum of tasks. However, in real-world scenarios, cooperation among individuals is often…

The shift from monolithic LLMs to distributed multi-agent architectures demands new frameworks for verifying and securing autonomous coordination. Unlike traditional multi-agent systems focused on cooperative state alignment, modern LLM…

多智能体系统 · 计算机科学 2026-03-06 Muhammad Umar Javed

The construction industry is characterized by both high physical and psychological risks, yet supports of mental health remain limited. While advancements in artificial intelligence (AI), particularly large language models (LLMs), offer…

人机交互 · 计算机科学 2025-06-10 Fan Yang , Yuan Tian , Jiansong Zhang

Reinforcement Learning (RL) agents have great successes in solving tasks with large observation and action spaces from limited feedback. Still, training the agents is data-intensive and there are no guarantees that the learned behavior is…

人工智能 · 计算机科学 2021-10-20 Helge Spieker

Safety-oriented instruction-following is supposed to keep LLM-controlled robots safe. We show it also creates an availability attack surface. By injecting short safety-plausible phrases (1-5 tokens) into a robots audio channel, an adversary…

密码学与安全 · 计算机科学 2026-04-29 Jonathan Steinberg , Oren Gal

We introduce Simulation Streams, a programming paradigm designed to efficiently control and leverage Large Language Models (LLMs) for complex, dynamic simulations and agentic workflows. Our primary goal is to create a minimally interfering…

人工智能 · 计算机科学 2025-02-03 Peter Sunehag , Joel Z. Leibo

Large language model (LLM)-based agents are increasingly used to perform complex, multi-step workflows in regulated settings such as compliance and due diligence. However, many agentic architectures rely primarily on prompt engineering of a…

人工智能 · 计算机科学 2026-02-03 Ananya Joshi , Michael Rudow

The rapid evolution of sophisticated cyberattacks has strained modern Security Operations Centers (SOC), which traditionally rely on rule-based or signature-driven detection systems. These legacy frameworks often generate high volumes of…

密码学与安全 · 计算机科学 2026-03-03 Chuanming Tang , Ling Qing , Shifeng Chen

Safe navigation is essential for autonomous systems operating in hazardous environments. Traditional planning methods excel at long-horizon tasks but rely on a predefined graph with fixed distance metrics. In contrast, safe Reinforcement…

机器人学 · 计算机科学 2025-09-12 Meng Feng , Viraj Parimi , Brian Williams

The integration of Large Language Models (LLMs) into robotics has unlocked unprecedented capabilities in high-level task planning. However, most current systems operate in an open-loop fashion, where LLMs act as one-shot planners, rendering…

机器人学 · 计算机科学 2025-12-30 Anjali R. Menon , Rohit K. Sharma , Priya Singh , Chengyu Wang , Aurora M. Ferreira , Mateja Novak

While Large Language Model (LLM) capabilities have scaled, safety guardrails remain largely stateless, treating multi-turn dialogues as a series of disconnected events. This lack of temporal awareness facilitates a "Safety Gap" where…

人工智能 · 计算机科学 2026-02-20 Justin Albrethsen , Yash Datta , Kunal Kumar , Sharath Rajasekar