English
Related papers

Related papers: Audit-LLM: Multi-Agent Collaboration for Log-based…

200 papers

Large Language Models (LLMs) are increasingly applied in healthcare, yet ensuring their ethical integrity and safety compliance remains a major barrier to clinical deployment. This work introduces a multi-agent refinement framework designed…

Large language models (LLMs) now mediate many web-based mental-health, crisis, and other emotionally sensitive services, yet their psychosocial safety in these settings remains poorly understood and weakly evaluated. We present DialogGuard,…

Artificial Intelligence · Computer Science 2025-12-03 Han Luo , Guy Laban

As large language models (LLMs) are increasingly integrated into multi-agent and human-AI systems, understanding their awareness of both self-context and conversational partners is essential for ensuring reliable performance and robust…

Computation and Language · Computer Science 2025-08-29 Younwoo Choi , Changling Li , Yongjin Yang , Zhijing Jin

Enterprises and organizations are faced with potential threats from insider employees that may lead to serious consequences. Previous studies on insider threat detection (ITD) mainly focus on detecting abnormal users or abnormal time…

Cryptography and Security · Computer Science 2024-03-19 Xiangrui Cai , Yang Wang , Sihan Xu , Hao Li , Ying Zhang , Zheli Liu , Xiaojie Yuan

Large Language Model (LLM) agents increasingly act through external tools, making their safety contingent on tool-call workflows rather than text generation alone. While recent benchmarks evaluate agents across diverse environments and risk…

Software Engineering · Computer Science 2026-03-20 Xuan Chen , Lu Yan , Ruqi Zhang , Xiangyu Zhang

IT environments typically have logging mechanisms to monitor system health and detect issues. However, the huge volume of generated logs makes manual inspection impractical, highlighting the importance of automated log analysis in IT…

Software Engineering · Computer Science 2025-11-20 Pranjal Gupta , Karan Bhukar , Harshit Kumar , Seema Nagar , Prateeti Mohapatra , Debanjana Kar

As LLM-based agents become increasingly prevalent, backdoors can be implanted into agents through user queries or environment feedback, raising critical concerns regarding safety vulnerabilities. However, backdoor attacks are typically…

Cryptography and Security · Computer Science 2025-10-14 Pengyu Zhu , Zhenhong Zhou , Yuanhe Zhang , Shilinlu Yan , Kun Wang , Sen Su

Insider threats wield an outsized influence on organizations, disproportionate to their small numbers. This is due to the internal access insiders have to systems, information, and infrastructure. %One example of this influence is where…

Cryptography and Security · Computer Science 2025-06-05 Haywood Gelman , John D. Hastings

Large Language Model (LLM) agent systems have advanced rapidly, driven by their strong generalization in zero-shot settings. To further enhance reasoning and accuracy on complex tasks, Multi-Agent Debate (MAD) has emerged as a promising…

Computation and Language · Computer Science 2025-12-03 Wei Fan , JinYi Yoon , Bo Ji

Despite their growing adoption across domains, large language model (LLM)-powered agents face significant security risks from backdoor attacks during training and fine-tuning. These compromised agents can subsequently be manipulated to…

Cryptography and Security · Computer Science 2025-06-12 Li Changjiang , Liang Jiacheng , Cao Bochuan , Chen Jinghui , Wang Ting

Large language models (LLMs) are rapidly evolving into autonomous agents that cooperate across organizational boundaries, enabling joint disaster response, supply-chain optimization, and other tasks that demand decentralized expertise…

Cryptography and Security · Computer Science 2025-07-16 Ronny Ko , Jiseong Jeong , Shuyuan Zheng , Chuan Xiao , Tae-Wan Kim , Makoto Onizuka , Won-Yong Shin

The growing dependence on mobile phones and their apps has made multi-user interactive features, like chat calls, live streaming, and video conferencing, indispensable for bridging the gaps in social connectivity caused by physical and…

Software Engineering · Computer Science 2025-09-17 Sidong Feng , Changhao Du , Huaxiao Liu , Qingnan Wang , Zhengwei Lv , Mengfei Wang , Chunyang Chen

Organisations are starting to adopt LLM-based AI agents, with their deployments naturally evolving from single agents towards interconnected, multi-agent networks. Yet a collection of safe agents does not guarantee a safe collection of…

Multiagent Systems · Computer Science 2025-08-11 Alistair Reid , Simon O'Callaghan , Liam Carroll , Tiberio Caetano

We examine one particular dimension of AI governance: how to monitor and audit AI-enabled products and services throughout the AI development lifecycle, from pre-deployment testing to post-deployment auditing. Combining principles from…

Artificial Intelligence · Computer Science 2026-05-18 Parand A. Alamdari , Toryn Q. Klassen , Sheila A. McIlraith

Specialized machine learning models, regardless of architecture and training, are susceptible to failures in deployment. With their increasing use in high risk situations, the ability to audit these models by determining their operational…

Robotics · Computer Science 2025-09-11 Rebecca Martin , Jay Patrikar , Sebastian Scherer

Multi-agent systems, where LLM agents communicate through free-form language, enable sophisticated coordination for solving complex cooperative tasks. This surfaces a unique safety problem when a group of agents forms a coalition and…

Internal threat detection (IDT) aims to address security threats within organizations or enterprises by identifying potential or already occurring malicious threats within vast amounts of logs. Although organizations or enterprises have…

Cryptography and Security · Computer Science 2025-03-14 Chenyu Li , Zhengjia Zhu , Jiyan He , Xiu Zhang

Evaluating the security of multi-agent systems (MASs) powered by large language models (LLMs) is challenging, primarily because of the systems' complex internal dynamics and the evolving nature of LLM vulnerabilities. Traditional attack…

Cryptography and Security · Computer Science 2025-06-04 Parth Atulbhai Gandhi , Akansha Shukla , David Tayouri , Beni Ifland , Yuval Elovici , Rami Puzis , Asaf Shabtai

The rapid advancement of Large Language Models (LLMs) presents new opportunities for automated software vulnerability detection, a crucial task in securing modern codebases. This paper presents a comparative study on the effectiveness of…

Software Engineering · Computer Science 2026-01-05 Md Hasan Saju , Maher Muhtadi , Akramul Azim

LLM-based coding agents are increasingly used to generate code, tests, and documentation. Still, their outputs can be plausible yet misaligned with developer intent and provide limited evidence for review in evolving projects. This limits…

Software Engineering · Computer Science 2026-04-14 Ragib Shahariar Ayon