English
Related papers

Related papers: The Trust Paradox in LLM-Based Multi-Agent Systems…

200 papers

Tool-using LLM agents increasingly rely on external tools to make consequential decisions, yet most existing agent-security benchmarks and defenses implicitly assume that tool feedback is trustworthy once a tool has been selected. We study…

Cryptography and Security · Computer Science 2026-05-19 Lecheng Yan , Ruizhe Li , Xicheng Han , Wenxi Li , Binwu Wang , Longyue Wang , Chenyang Lyu , Guanhua Chen

Large language model-based multi-agent systems have shown great abilities across various tasks due to the collaboration of expert agents, each focusing on a specific domain. However, the impact of clumsy or even malicious agents--those who…

Artificial Intelligence · Computer Science 2025-05-30 Jen-tse Huang , Jiaxu Zhou , Tailin Jin , Xuhui Zhou , Zixi Chen , Wenxuan Wang , Youliang Yuan , Michael R. Lyu , Maarten Sap

Large language models (LLMs) deployed as agents introduce significant safety risks in clinical settings due to their potential for error and single points of failure. We introduce Tiered Agentic Oversight (TAO), a hierarchical multi-agent…

The rapid integration of Large Language Model (LLM) agents into autonomous task execution has introduced significant privacy concerns within cross-tool data flows. In this paper, we systematically investigate and define a novel risk termed…

Software Engineering · Computer Science 2026-03-10 Yixi Lin , Jiangrong Wu , Yuhong Nan , Xueqiang Wang , Xinyuan Zhang , Zibin Zheng

With the continuous development of large language models (LLMs), transformer-based models have made groundbreaking advances in numerous natural language processing (NLP) tasks, leading to the emergence of a series of agents that use LLMs as…

Artificial Intelligence · Computer Science 2024-11-15 Yuyou Gan , Yong Yang , Zhe Ma , Ping He , Rui Zeng , Yiming Wang , Qingming Li , Chunyi Zhou , Songze Li , Ting Wang , Yunjun Gao , Yingcai Wu , Shouling Ji

As the industry increasingly adopts agentic AI systems, understanding their unique vulnerabilities becomes critical. Prior research suggests that security flaws at the model level do not fully capture the risks present in agentic…

Artificial Intelligence · Computer Science 2025-09-23 Ilham Wicaksono , Zekun Wu , Rahul Patel , Theo King , Adriano Koshiyama , Philip Treleaven

The digital world is witnessing the rapid rise of LLM-based multi-agent systems (MASs) and their powerful applications. However, their security remains insufficiently understood, as existing evaluations are largely limited to narrow attack…

Cryptography and Security · Computer Science 2026-05-05 Ruichao Liang , Le Yin , Jing Chen , Yebo Feng , Cong Wu , Xiaoyu Zhang , Huangpeng Gu , Zijian Zhang , Yang Liu

Existing safety evaluation methods for large language models (LLMs) suffer from inherent limitations, including evaluator bias and detection failures arising from model homogeneity, which collectively undermine the robustness of risk…

Artificial Intelligence · Computer Science 2025-10-24 Xiuyuan Chen , Jian Zhao , Yuchen Yuan , Tianle Zhang , Huilin Zhou , Zheng Zhu , Ping Hu , Linghe Kong , Chi Zhang , Weiran Huang , Xuelong Li

The increasing connectivity and intricate remote access environment have made traditional perimeter-based network defense vulnerable. Zero trust becomes a promising approach to provide defense policies based on agent-centric trust…

Artificial Intelligence · Computer Science 2023-03-07 Yunfei Ge , Tao Li , Quanyan Zhu

High-privilege LLM agents that autonomously process external documentation are increasingly trusted to automate tasks by reading and executing project instructions, yet they are granted terminal access, filesystem control, and outbound…

Cryptography and Security · Computer Science 2026-03-13 Ching-Yu Kao , Xinfeng Li , Shenyu Dai , Tianze Qiu , Pengcheng Zhou , Eric Hanchen Jiang , Philip Sperl

This paper introduces a novel framework for simulating and analyzing how uncooperative behaviors can destabilize or collapse LLM-based multi-agent systems. Our framework includes two key components: (1) a game theory-based taxonomy of…

Multiagent Systems · Computer Science 2026-01-13 Devang Kulshreshtha , Wanyu Du , Raghav Jain , Srikanth Doss , Hang Su , Sandesh Swamy , Yanjun Qi

Multi-agent LLM systems decompose workflows across agents, tools, shared context, memory, and decision gates. This modularity improves interpretability, but creates a propagation risk: a bounded perturbation to one component can be reused…

Cryptography and Security · Computer Science 2026-05-28 Md Hafizur Rahman , Zafaryab Haider , Tanzim Mahfuz , Prabuddha Chakraborty

Large Language Models (LLMs) have demonstrated strong capabilities as autonomous agents through tool use, planning, and decision-making abilities, leading to their widespread adoption across diverse tasks. As task complexity grows,…

Multiagent Systems · Computer Science 2025-11-10 Ishan Kavathekar , Hemang Jain , Ameya Rathod , Ponnurangam Kumaraguru , Tanuja Ganu

As large language models (LLMs) increasingly interact with each other, most notably in multi-agent setups, we may expect (and hope) that `trust' relationships develop between them, mirroring trust relationships between human colleagues,…

Multiagent Systems · Computer Science 2025-08-25 Maarten Buyl , Yousra Fettach , Guillaume Bied , Tijl De Bie

LLM-based coding agents are increasingly used to generate code, tests, and documentation. Still, their outputs can be plausible yet misaligned with developer intent and provide limited evidence for review in evolving projects. This limits…

Software Engineering · Computer Science 2026-04-14 Ragib Shahariar Ayon

Lacking security awareness, sensor fusion in systems with multi-agent networks such as smart cities is vulnerable to attacks. To guard against recent threats, we design security-aware sensor fusion that is based on the estimates of…

Cryptography and Security · Computer Science 2025-03-10 R. Spencer Hallyburton , Miroslav Pajic

Large Language Models (LLMs) are increasingly deployed in sensitive domains such as healthcare, finance, and law, yet their integration raises pressing concerns around trust, accountability, and reliability. This paper explores adaptive…

Software Engineering · Computer Science 2026-01-15 Tejaswini Bollikonda

This paper explores the parallels between Thompson's "Reflections on Trusting Trust" and modern challenges in LLM-based code generation. We examine how Thompson's insights about compiler backdoors take on new relevance in the era of large…

Software Engineering · Computer Science 2025-02-25 Bradley McDanel

Agentification serves as a critical enabler of Edge General Intelligence (EGI), transforming massive edge devices into cognitive agents through integrating Large Language Models (LLMs) and perception, reasoning, and acting modules. These…

Networking and Internet Architecture · Computer Science 2025-08-28 Yinqiu Liu , Ruichen Zhang , Haoxiang Luo , Yijing Lin , Geng Sun , Dusit Niyato , Hongyang Du , Zehui Xiong , Yonggang Wen , Abbas Jamalipour , Dong In Kim , Ping Zhang

Deception is a pervasive feature of human communication and an emerging concern in large language models (LLMs). While recent studies document instances of LLM deception, most evaluations remain confined to single-turn prompts and fail to…

Computation and Language · Computer Science 2026-02-06 Yang Xu , Xuanming Zhang , Samuel Yeh , Jwala Dhamala , Ousmane Dia , Rahul Gupta , Sharon Li