中文
相关论文

相关论文: Shadows in the Code: Exploring the Risks and Defen…

200 篇论文

Recently, applications powered by Large Language Models (LLMs) have made significant strides in tackling complex tasks. By harnessing the advanced reasoning capabilities and extensive knowledge embedded in LLMs, these applications can…

密码学与安全 · 计算机科学 2025-06-13 Yuyang Zhang , Kangjie Chen , Jiaxin Gao , Ronghao Cui , Run Wang , Lina Wang , Tianwei Zhang

Large Language Model (LLM) based agents integrated into web browsers (often called agentic AI browsers) offer powerful automation of web tasks. However, they are vulnerable to indirect prompt injection attacks, where malicious instructions…

密码学与安全 · 计算机科学 2025-10-16 Avihay Cohen

Individual Large Language Models (LLMs) have demonstrated significant capabilities across various domains, such as healthcare and law. Recent studies also show that coordinated multi-agent systems exhibit enhanced decision-making and…

计算与语言 · 计算机科学 2025-10-16 Fengyuan Liu , Rui Zhao , Shuo Chen , Guohao Li , Philip Torr , Lei Han , Jindong Gu

The widespread deployment of LLM-based agents is likely to introduce a critical privacy threat: malicious agents that proactively engage others in multi-turn interactions to extract sensitive information. However, the evolving nature of…

密码学与安全 · 计算机科学 2026-05-11 Yanzhe Zhang , Diyi Yang

Multi-Agent Debate (MAD), leveraging collaborative interactions among Large Language Models (LLMs), aim to enhance reasoning capabilities in complex tasks. However, the security implications of their iterative dialogues and role-playing…

密码学与安全 · 计算机科学 2025-04-24 Senmao Qi , Yifei Zou , Peng Li , Ziyi Lin , Xiuzhen Cheng , Dongxiao Yu

The rapid adoption of large language models (LLMs) in multi-agent systems has highlighted their impressive capabilities in various applications, such as collaborative problem-solving and autonomous negotiation. However, the security…

计算与语言 · 计算机科学 2024-07-24 Tianjie Ju , Yiting Wang , Xinbei Ma , Pengzhou Cheng , Haodong Zhao , Yulong Wang , Lifeng Liu , Jian Xie , Zhuosheng Zhang , Gongshen Liu

Large language models (LLMs) are now routinely used to autonomously execute complex tasks, from natural language processing to dynamic workflows like web searches. The usage of tool-calling and Retrieval Augmented Generation (RAG) allows…

密码学与安全 · 计算机科学 2026-04-13 Dennis Rall , Bernhard Bauer , Mohit Mittal , Thomas Fraunholz

Recent advances in large language models (LLMs) have catalyzed the rise of autonomous AI agents capable of perceiving, reasoning, and acting in dynamic, open-ended environments. These large-model agents mark a paradigm shift from static…

人工智能 · 计算机科学 2025-07-01 Hang Su , Jun Luo , Chang Liu , Xiao Yang , Yichi Zhang , Yinpeng Dong , Jun Zhu

Manual software beta testing is costly and time-consuming, while single-agent large language model (LLM) approaches suffer from hallucinations and inconsistent behavior. We propose a multi-agent committee framework in which diverse…

软件工程 · 计算机科学 2025-12-29 Sumanth Bharadwaj Hachalli Karanam , Dhiwahar Adhithya Kennady

Despite extensive pre-training in moral alignment to prevent generating harmful information, large language models (LLMs) remain vulnerable to jailbreak attacks. In this paper, we propose AutoDefense, a multi-agent defense framework that…

机器学习 · 计算机科学 2024-11-15 Yifan Zeng , Yiran Wu , Xiao Zhang , Huazheng Wang , Qingyun Wu

Large Language Models (LLMs) have been increasingly integrated into computer-use agents, which can autonomously operate tools on a user's computer to accomplish complex tasks. However, due to the inherently unstable and unpredictable nature…

密码学与安全 · 计算机科学 2025-09-10 Haitao Hu , Peng Chen , Yanpeng Zhao , Yuqi Chen

Mobile agents powered by vision-language models (VLMs) are increasingly adopted for tasks such as UI automation and camera-based assistance. These agents are typically fine-tuned using small-scale, user-collected data, making them…

密码学与安全 · 计算机科学 2025-09-08 Xuan Wang , Siyuan Liang , Zhe Liu , Yi Yu , Aishan Liu , Yuliang Lu , Xitong Gao , Ee-Chien Chang

Membership inference attacks (MIAs), which enable adversaries to determine whether specific data points were part of a model's training dataset, have emerged as an important framework to understand, assess, and quantify the potential…

密码学与安全 · 计算机科学 2026-03-23 Toan Tran , Olivera Kotevska , Li Xiong

LLM-based coding agents are rapidly being deployed in software development, yet their safety implications remain poorly understood. These agents, while capable of accelerating software development, may exhibit unsafe behaviors during normal…

人工智能 · 计算机科学 2025-08-26 Matous Kozak , Roshanak Zilouchian Moghaddam , Siva Sivaraman

This position paper examines the use of Large Language Models (LLMs) in social simulation, analyzing their potential and limitations from a computational social science perspective. We first review recent findings on LLMs' ability to…

As researchers continue to optimize AI agents for more effective task execution within operating systems, they often overlook a critical security concern: the ability of these agents to detect "impostors" within their environment. Through…

计算与语言 · 计算机科学 2025-08-07 Yurun Chen , Xavier Hu , Keting Yin , Juncheng Li , Shengyu Zhang

Large Language Model (LLM)-based agents increasingly interact, collaborate, and delegate tasks to one another autonomously with minimal human interaction. Industry guidelines for agentic system governance emphasize the need for users to…

密码学与安全 · 计算机科学 2025-09-01 Georgios Syros , Anshuman Suri , Jacob Ginesin , Cristina Nita-Rotaru , Alina Oprea

Despite their growing adoption across domains, large language model (LLM)-powered agents face significant security risks from backdoor attacks during training and fine-tuning. These compromised agents can subsequently be manipulated to…

密码学与安全 · 计算机科学 2025-06-12 Li Changjiang , Liang Jiacheng , Cao Bochuan , Chen Jinghui , Wang Ting

Large Language Model (LLM) agents use memory to learn from past interactions, enabling autonomous planning and decision-making in complex environments. However, this reliance on memory introduces a critical security risk: an adversary can…

密码学与安全 · 计算机科学 2025-10-06 Qianshan Wei , Tengchao Yang , Yaochen Wang , Xinfeng Li , Lijun Li , Zhenfei Yin , Yi Zhan , Thorsten Holz , Zhiqiang Lin , XiaoFeng Wang

Since the official release of ChatGPT in 2022, large language models (LLMs) have rapidly evolved from chatbot-style interfaces into agentic systems that can delegate work through tools and newly spawned subagents. While these capabilities…

密码学与安全 · 计算机科学 2026-05-12 Ziwen Cai , Yihe Zhang , Xiali Hei