English
Related papers

Related papers: DynaTrust: Defending Multi-Agent Systems Against S…

200 papers

Large language model (LLM)-based multi-agent systems (MAS) have shown strong capabilities in solving complex tasks. As MAS become increasingly autonomous in various safety-critical tasks, detecting malicious agents has become a critical…

Cryptography and Security · Computer Science 2025-12-23 Junjun Pan , Yixin Liu , Rui Miao , Kaize Ding , Yu Zheng , Quoc Viet Hung Nguyen , Alan Wee-Chung Liew , Shirui Pan

The rise of Agent AI and Large Language Model-powered Multi-Agent Systems (LLM-MAS) has underscored the need for responsible and dependable system operation. Tools like LangChain and Retrieval-Augmented Generation have expanded LLM…

Multiagent Systems · Computer Science 2025-02-05 Jinwei Hu , Yi Dong , Shuang Ao , Zhuoyun Li , Boxuan Wang , Lokesh Singh , Guangliang Cheng , Sarvapali D. Ramchurn , Xiaowei Huang

Multi-agent systems leverage advanced AI models as autonomous agents that interact, cooperate, or compete to complete complex tasks across applications such as robotics and traffic management. Despite their growing importance, safety in…

Multiagent Systems · Computer Science 2025-05-28 Falong Fan , Xi Li

Trust evaluation assesses trust relationships between entities and facilitates decision-making. Machine Learning (ML) shows great potential for trust evaluation owing to its learning capabilities. In recent years, Graph Neural Networks…

Machine Learning · Computer Science 2024-02-06 Jie Wang , Zheng Yan , Jiahe Lan , Elisa Bertino , Witold Pedrycz

Large Language Models (LLMs) are increasingly used in agentic systems, where their interactions with diverse tools and environments create complex, multi-stage safety challenges. However, existing benchmarks mostly rely on static,…

Cryptography and Security · Computer Science 2026-02-03 Liming Lu , Xiang Gu , Junyu Huang , Jiawei Du , Xu Zheng , Yunhuai Liu , Yongbin Zhou , Shuchao Pang

The rapid advancement of large language models (LLMs) has empowered intelligent agents to leverage diverse external tools for solving complex real-world problems. However, this reliance introduces new challenges, as extended contexts and…

Artificial Intelligence · Computer Science 2025-09-03 Zhitian Xie , Qintong Wu , Chengyue Yu , Chenyi Zhuang , Jinjie Gu

Graph Attention Networks(GATs) are useful deep learning models to deal with the graph data. However, recent works show that the classical GAT is vulnerable to adversarial attacks. It degrades dramatically with slight perturbations.…

Machine Learning · Computer Science 2022-08-05 Xianchen Zhou , Yaoyun Zeng , Hongxia Wang

The emergence of Large Language Models (LLMs) is rapidly accelerating the development of autonomous multi-agent systems (MAS), paving the way for the Internet of Agents. However, traditional centralized MAS architectures present significant…

Multiagent Systems · Computer Science 2025-12-03 Yepeng Ding , Ahmed Twabi , Junwei Yu , Lingfeng Zhang , Tohru Kondo , Hiroyuki Sato

Large language model-based multi-agent systems have shown great abilities across various tasks due to the collaboration of expert agents, each focusing on a specific domain. However, the impact of clumsy or even malicious agents--those who…

Artificial Intelligence · Computer Science 2025-05-30 Jen-tse Huang , Jiaxu Zhou , Tailin Jin , Xuhui Zhou , Zixi Chen , Wenxuan Wang , Youliang Yuan , Michael R. Lyu , Maarten Sap

In multiagent dynamical systems, privacy protection corresponds to avoid disclosing the initial states of the agents while accomplishing a distributed task. The system-theoretic framework described in this paper for this scope, denoted…

Systems and Control · Computer Science 2020-12-16 Claudio Altafini

This paper presents a defense framework for enhancing the safety of large language model (LLM) empowered multi-agent systems (MAS) in safety-critical domains such as aerospace. We apply randomized smoothing, a statistical robustness…

Artificial Intelligence · Computer Science 2025-07-08 Jinwei Hu , Yi Dong , Zhengtao Ding , Xiaowei Huang

Dialogue policy plays an important role in task-oriented spoken dialogue systems. It determines how to respond to users. The recently proposed deep reinforcement learning (DRL) approaches have been used for policy optimization. However,…

Computation and Language · Computer Science 2019-05-28 Lu Chen , Zhi Chen , Bowen Tan , Sishan Long , Milica Gasic , Kai Yu

Graph-theoretic problems arise in real-world applications like logistics, communication networks, and traffic optimization. These problems are often complex, noisy, and irregular, posing challenges for traditional algorithms. Large language…

Multiagent Systems · Computer Science 2025-11-12 Zike Yuan , Ming Liu , Hui Wang , Bing Qin

Large language model-based multi-agent systems (LLM-MAS) effectively accomplish complex and dynamic tasks through inter-agent communication, but this reliance introduces substantial safety vulnerabilities. Existing attack methods targeting…

Cryptography and Security · Computer Science 2025-08-06 Bingyu Yan , Ziyi Zhou , Xiaoming Zhang , Chaozhuo Li , Ruilin Zeng , Yirui Qi , Tianbo Wang , Litian Zhang

Large Language Model based multi-agent systems are revolutionizing autonomous communication and collaboration, yet they remain vulnerable to security threats like unauthorized access and data breaches. To address this, we introduce…

Artificial Intelligence · Computer Science 2025-07-09 Junyuan Mao , Fanci Meng , Yifan Duan , Miao Yu , Xiaojun Jia , Junfeng Fang , Yuxuan Liang , Kun Wang , Qingsong Wen

Recent advances in large language models (LLMs) have raised concerns about jailbreaking attacks, i.e., prompts that bypass safety mechanisms. This paper investigates the use of multi-agent LLM systems as a defence against such attacks. We…

Artificial Intelligence · Computer Science 2025-07-01 Maria Carolina Cornelia Wit , Jun Pang

Large language model (LLM)-powered multi-agent systems (MAS) enable agents to communicate and share information, achieving strong performance on complex tasks. However, this communication also creates an attack surface where malicious…

Cryptography and Security · Computer Science 2026-05-05 Lingxi Zhang , Guangtao Zheng , Hanjie Chen

Large Language Model-based Multi-Agent Systems (MASs) have demonstrated strong advantages in addressing complex real-world tasks. However, due to the introduction of additional attack surfaces, MASs are particularly vulnerable to…

Computation and Language · Computer Science 2025-06-03 Zherui Li , Yan Mi , Zhenhong Zhou , Houcheng Jiang , Guibin Zhang , Kun Wang , Junfeng Fang

The multi-agent system (MAS) enables the sharing of capabilities among agents, such that collaborative tasks can be accomplished with high scalability and efficiency. MAS is increasingly widely applied in various fields. Meanwhile, the…

Multiagent Systems · Computer Science 2022-09-16 Guojun He

Deep reinforcement learning (RL) is emerging as a viable strategy for automated cyber defense (ACD). The traditional RL approach represents networks as a list of computers in various states of safety or threat. Unfortunately, these models…

Machine Learning · Computer Science 2025-09-22 Isaiah J. King , Benjamin Bowman , H. Howie Huang