中文
相关论文

相关论文: Reframing LLM Agent Security as an Agent-Human Int…

200 篇论文

As NLP evaluation shifts from static benchmarks to multi-turn interactive settings, LLM-based simulators have become widely used as user proxies, serving two roles: generating user turns and providing evaluation signals. Yet, these…

The widespread deployment of LLM-based agents is likely to introduce a critical privacy threat: malicious agents that proactively engage others in multi-turn interactions to extract sensitive information. However, the evolving nature of…

密码学与安全 · 计算机科学 2026-05-11 Yanzhe Zhang , Diyi Yang

AI agent frameworks connecting large language model (LLM) reasoning to host execution surfaces -- shell, filesystem, containers, and messaging -- introduce security challenges structurally distinct from conventional software. We present a…

密码学与安全 · 计算机科学 2026-05-15 Surada Suwansathit , Yuxuan Zhang , Guofei Gu

Large Language Models (LLMs) have transformed software development, enabling AI-powered applications known as LLM-based agents that promise to automate tasks across diverse apps and workflows. Yet, the security implications of deploying…

密码学与安全 · 计算机科学 2025-11-07 Chenghao Du , Quanfeng Huang , Tingxuan Tang , Zihao Wang , Adwait Nadkarni , Yue Xiao

Large Language Models (LLMs) are increasingly deployed as agentic systems that plan, memorize, and act in open-world environments. This shift brings new security problems: failures are no longer only unsafe text generation, but can become…

密码学与安全 · 计算机科学 2026-03-03 Zhihang Deng , Jiaping Gui , Weinan Zhang

Large Language Models (LLMs) are increasingly deployed as agents that orchestrate tasks and integrate external tools to execute complex workflows. We demonstrate that these interactive behaviors leave distinctive fingerprints in encrypted…

密码学与安全 · 计算机科学 2025-10-09 Yixiang Zhang , Xinhao Deng , Zhongyi Gu , Yihao Chen , Ke Xu , Qi Li , Jianping Wu

Large Language Model (LLM)-based agents increasingly interact, collaborate, and delegate tasks to one another autonomously with minimal human interaction. Industry guidelines for agentic system governance emphasize the need for users to…

密码学与安全 · 计算机科学 2025-09-01 Georgios Syros , Anshuman Suri , Jacob Ginesin , Cristina Nita-Rotaru , Alina Oprea

The emergence of Large Language Models (LLMs) has significantly advanced solutions across various domains, from political science to software development. However, these models are constrained by their training data, which is static and…

人工智能 · 计算机科学 2025-09-16 Aadil Gani Ganie

Third-party skills are becoming the package ecosystem for LLM agents. They package natural-language instructions, helper scripts, templates, documents, and service configuration into reusable workflows. This makes skills useful, but it also…

密码学与安全 · 计算机科学 2026-05-15 Haomin Zhuang , Hanwen Xing , Yujun Zhou , Yuchen Ma , Yue Huang , Yili Shen , Yufei Han , Xiangliang Zhang

The acquisition of agentic capabilities has transformed LLMs from "knowledge providers" to "action executors", a trend that while expanding LLMs' capability boundaries, significantly increases their susceptibility to malicious use. Previous…

密码学与安全 · 计算机科学 2025-05-30 Jinchuan Zhang , Lu Yin , Yan Zhou , Songlin Hu

Large Language Models (LLMs) have enabled multi-agent systems to perform autonomous code generation for complex tasks. Despite the recent growth in research and industrial applications in this area, there is little work on synthesizing…

软件工程 · 计算机科学 2026-04-21 Zeeshan Rasheeda , Muhammad Waseema , Kai-Kristian Kemella , Mika Saari , Pekka Abrahamsson

This paper examines why safety mechanisms designed for human-model interaction do not scale to environments where large language models (LLMs) interact with each other. Most current governance practices still rely on single-agent safety…

多智能体系统 · 计算机科学 2025-12-03 Piercosma Bisconti , Marcello Galisai , Federico Pierucci , Marcantonio Bracale , Matteo Prandi

Agentic AI systems powered by large language models (LLMs) and endowed with planning, tool use, memory, and autonomy, are emerging as powerful, flexible platforms for automation. Their ability to autonomously execute tasks across web,…

人工智能 · 计算机科学 2026-04-07 Anshuman Chhabra , Shrestha Datta , Shahriar Kabir Nahin , Prasant Mohapatra

AI agents are beginning to interact with each other directly and across internet platforms and physical environments, creating security challenges beyond traditional cybersecurity and AI safety frameworks. Free-form protocols are essential…

For a long time, humanity has pursued artificial intelligence (AI) equivalent to or surpassing the human level, with AI agents considered a promising vehicle for this pursuit. AI agents are artificial entities that sense their environment,…

The rapid deployment of LLM-based autonomous agents has introduced safety risks that extend far beyond traditional LLM concerns, prompting a proliferation of safety benchmarks since late 2023. However, these benchmarks have developed…

计算机与社会 · 计算机科学 2026-05-19 Miles Q. Li , Benjamin C. M. Fung , Boyang Li , Heba Ismail , Farkhund Iqbal

Autonomous Driving Systems (ADSs) are revolutionizing transportation by reducing human intervention, improving operational efficiency, and enhancing safety. Large Language Models (LLMs) have been integrated into ADSs to support high-level…

多智能体系统 · 计算机科学 2025-10-15 Yaozu Wu , Dongyuan Li , Yankai Chen , Renhe Jiang , Henry Peng Zou , Wei-Chieh Huang , Yangning Li , Liancheng Fang , Zhen Wang , Philip S. Yu

Human autonomy and sense of agency are increasingly recognised as critical for user well-being, motivation, and the ethical deployment of robots in human-robot interaction (HRI). Given the rapid development of artificial intelligence, robot…

人机交互 · 计算机科学 2026-05-25 Felix Glawe , Tim Schmeckel , Philipp Brauner , Martina Ziefle

Autonomous agent systems powered by Large Language Models (LLMs) have demonstrated promising capabilities in automating complex tasks. However, current evaluations largely rely on success rates without systematically analyzing the…

人工智能 · 计算机科学 2025-08-19 Ruofan Lu , Yichen Li , Yintong Huo

Agentic AI systems, which leverage multiple autonomous agents and large language models (LLMs), are increasingly used to address complex, multi-step tasks. The safety, security, and functionality of these systems are critical, especially in…

人工智能 · 计算机科学 2026-04-16 Edoardo Allegrini , Ananth Shreekumar , Z. Berkay Celik