English
Related papers

Related papers: GUARDIAN: Safeguarding LLM Multi-Agent Collaborati…

200 papers

Large language models (LLMs) are useful tools with the capacity for performing specific types of knowledge work at an effective scale. However, LLM deployments in high-risk and safety-critical domains pose unique challenges, notably the…

Computation and Language · Computer Science 2024-09-05 Joe B Hakim , Jeffery L Painter , Darmendra Ramcharran , Vijay Kara , Greg Powell , Paulina Sobczak , Chiho Sato , Andrew Bate , Andrew Beam

Large language models are extensively applied across a wide range of tasks, such as customer support, content creation, educational tutoring, and providing financial guidance. However, a well-known drawback is their predisposition to…

Computation and Language · Computer Science 2024-07-08 Noa Nonkes , Sergei Agaronian , Evangelos Kanoulas , Roxana Petcu

The shift from monolithic LLMs to distributed multi-agent architectures demands new frameworks for verifying and securing autonomous coordination. Unlike traditional multi-agent systems focused on cooperative state alignment, modern LLM…

Multiagent Systems · Computer Science 2026-03-06 Muhammad Umar Javed

Hallucinations can be produced by conversational AI systems, particularly in multi-turn conversations where context changes and contradictions may eventually surface. By representing the entire conversation as a temporal graph, we present a…

Computation and Language · Computer Science 2026-01-07 Vidhi Rathore , Sambu Aneesh , Himanshu Singh

Driven by the rapid advancements of Large Language Models (LLMs), LLM-based agents have emerged as powerful intelligent systems capable of human-like cognition, reasoning, and interaction. These agents are increasingly being deployed across…

As Large Language Models (LLMs) continue to be increasingly applied across various domains, their widespread adoption necessitates rigorous monitoring to prevent unintended negative consequences and ensure robustness. Furthermore, LLMs must…

Computation and Language · Computer Science 2025-07-09 Seshu Tirupathi , Dhaval Salwala , Elizabeth Daly , Inge Vejsbjerg

Recent capability increases in large language models (LLMs) open up applications in which groups of communicating generative AI agents solve joint tasks. This poses privacy and security challenges concerning the unauthorised sharing of…

Empowered by large language models (LLMs), intelligent agents have become a popular paradigm for interacting with open environments to facilitate AI deployment. However, hallucinations generated by LLMs-where outputs are inconsistent with…

Machine Learning · Computer Science 2025-07-23 Siyuan Liu , Wenjing Liu , Zhiwei Xu , Xin Wang , Bo Chen , Tao Li

The rapid advancement of large language model (LLM) agents has raised new concerns regarding their safety and security. In this paper, we propose GuardAgent, the first guardrail agent to protect target agents by dynamically checking whether…

Machine Learning · Computer Science 2025-05-30 Zhen Xiang , Linzhi Zheng , Yanjie Li , Junyuan Hong , Qinbin Li , Han Xie , Jiawei Zhang , Zidi Xiong , Chulin Xie , Carl Yang , Dawn Song , Bo Li

The rise of large language model (LLM)-based multi-agent systems (MAS) introduces new security and reliability challenges. While these systems show great promise in decomposing and coordinating complex tasks, they also face multi-faceted…

Artificial Intelligence · Computer Science 2025-06-02 Xu He , Di Wu , Yan Zhai , Kun Sun

Large language models (LLMs) are increasingly being adopted as the cognitive core of embodied agents. However, inherited hallucinations, which stem from failures to ground user instructions in the observed physical environment, can lead to…

While large language model-based agents demonstrate great potential in collaborative tasks, their interactivity also introduces security vulnerabilities. In this paper, we propose and model group collusive attacks, a highly destructive…

Artificial Intelligence · Computer Science 2026-03-17 Yiling Tao , Xinran Zheng , Shuo Yang , Meiling Tao , Xingjun Wang

Large Language Models have rapidly advanced in their ability to interpret and generate natural language. In enterprise settings, they are frequently augmented with closed-source domain knowledge to deliver more contextually informed…

Computation and Language · Computer Science 2025-12-03 Tanmay Agrawal

To sustain coherent long-term interactions, Large Language Model (LLM) agents must navigate the tension between acquiring new information and retaining prior knowledge. Current unified stream-based memory systems facilitate context updates…

Artificial Intelligence · Computer Science 2026-04-15 Zhaofen Wu , Hanrong Zhang , Fulin Lin , Wujiang Xu , Xinran Xu , Yankai Chen , Henry Peng Zou , Shaowen Chen , Weizhi Zhang , Xue Liu , Philip S. Yu , Hongwei Wang

The collaboration between agents has gradually become an important topic in multi-agent systems. The key is how to efficiently solve the credit assignment problems. This paper introduces MGAN for collaborative multi-agent reinforcement…

Multiagent Systems · Computer Science 2021-05-14 Zhiwei Xu , Bin Zhang , Yunpeng Bai , Dapeng Li , Guoliang Fan

Large language models (LLMs) frequently generate confident yet inaccurate responses, introducing significant risks for deployment in safety-critical domains. We present a novel, test-time approach to detecting model hallucination through…

Machine Learning · Computer Science 2025-10-07 Hazel Kim , Tom A. Lamb , Adel Bibi , Philip Torr , Yarin Gal

Graph Neural Networks (GNNs) show great promise for Network Intrusion Detection Systems (NIDS), particularly in IoT environments, but suffer performance degradation due to distribution drift and lack robustness against realistic adversarial…

Cryptography and Security · Computer Science 2025-06-27 Zhonghao Zhan , Huichi Zhou , Hamed Haddadi

Large language models (LLMs) have empowered nodes within multi-agent networks with intelligence, showing growing applications in both academia and industry. However, how to prevent these networks from generating malicious information…

Multiagent Systems · Computer Science 2024-10-22 Miao Yu , Shilong Wang , Guibin Zhang , Junyuan Mao , Chenlong Yin , Qijiong Liu , Qingsong Wen , Kun Wang , Yang Wang

With the recent development of natural language generation models - termed as large language models (LLMs) - a potential use case has opened up to improve the way that humans interact with robot assistants. These LLMs should be able to…

Multiagent Systems · Computer Science 2024-11-27 Mitchell Rosser , Marc. G Carmichael

Generative AI is increasingly important in software engineering, including safety engineering, where its use ensures that software does not cause harm to people. This also leads to high quality requirements for generative AI. Therefore, the…

Software Engineering · Computer Science 2024-04-25 Florian Geissler , Karsten Roscher , Mario Trapp
‹ Prev 1 2 3 10 Next ›