English
Related papers

Related papers: HARP: Measuring Harm Amplification in Multi-Agent …

200 papers

Agent-based models (ABMs) have shown promise for modelling various real world phenomena incompatible with traditional equilibrium analysis. However, a critical concern is the manual definition of behavioural rules in ABMs. Recent…

Multiagent Systems · Computer Science 2024-02-02 Benjamin Patrick Evans , Sumitra Ganesh

It has long been recognized that multi-agent reinforcement learning (MARL) faces significant scalability issues due to the fact that the size of the state and action spaces are exponentially large in the number of agents. In this paper, we…

Optimization and Control · Mathematics 2020-06-12 Guannan Qu , Yiheng Lin , Adam Wierman , Na Li

Integrating Large Language Models (LLMs) with external tools via multi-agent systems offers a promising new paradigm for decomposing and solving complex problems. However, training these systems remains notoriously difficult due to the…

Artificial Intelligence · Computer Science 2026-02-10 Yanming Li , Xuelin Zhang , WenJie Lu , Ziye Tang , Maodong Wu , Haotian Luo , Tongtong Wu , Zijie Peng , Hongze Mi , Yibo Feng , Naiqiang Tan , Chao Huang , Hong Chen , Li Shen

We consider a decentralized formulation of the active hypothesis testing (AHT) problem, where multiple agents gather noisy observations from the environment with the purpose of identifying the correct hypothesis. At each time step, agents…

Machine Learning · Statistics 2023-09-18 Hadar Szostak , Kobi Cohen

Large language model-based multi-agent systems (LLM-MAS) effectively accomplish complex and dynamic tasks through inter-agent communication, but this reliance introduces substantial safety vulnerabilities. Existing attack methods targeting…

Cryptography and Security · Computer Science 2025-08-06 Bingyu Yan , Ziyi Zhou , Xiaoming Zhang , Chaozhuo Li , Ruilin Zeng , Yirui Qi , Tianbo Wang , Litian Zhang

Ensuring the safety of large language models (LLMs) is paramount, yet identifying potential vulnerabilities is challenging. While manual red teaming is effective, it is time-consuming, costly and lacks scalability. Automated red teaming…

Cryptography and Security · Computer Science 2024-12-24 Bojian Jiang , Yi Jing , Tianhao Shen , Tong Wu , Qing Yang , Deyi Xiong

Safety guard models that detect malicious queries aimed at large language models (LLMs) are essential for ensuring the secure and responsible deployment of LLMs in real-world applications. However, deploying existing safety guard models…

Computation and Language · Computer Science 2025-02-25 Seanie Lee , Haebin Seong , Dong Bok Lee , Minki Kang , Xiaoyin Chen , Dominik Wagner , Yoshua Bengio , Juho Lee , Sung Ju Hwang

Multi-agent hierarchical reinforcement learning (MAHRL) has been studied as an effective means to solve intelligent decision problems in complex and large-scale environments. However, most current MAHRL algorithms follow the traditional way…

Artificial Intelligence · Computer Science 2024-11-05 Chanjuan Liu , Jinmiao Cong , Bingcai Chen , Yaochu Jin , Enqiang Zhu

The increasing operational reliance on complex Multi-Agent Systems (MAS) across safety-critical domains necessitates rigorous adversarial robustness assessment. Modern MAS are inherently heterogeneous, integrating conventional Multi-Agent…

Cryptography and Security · Computer Science 2025-12-19 Akhil Sharma , Shaikh Yaser Arafat , Jai Kumar Sharma , Ken Huang

Personalized LLM agents maintain persistent cross-session state to support long-horizon collaboration. Yet, this persistence introduces a subtle but critical security vulnerability: routine user-agent interactions can gradually reshape an…

Cryptography and Security · Computer Science 2026-05-11 Xiaoyu Xu , Minxin Du , Qipeng Xie , Haobin Ke , Qingqing Ye , Haibo Hu

Multi-agent reinforcement learning (MARL) has been increasingly adopted in many real-world applications. While MARL enables decentralized deployment on resource-constrained edge devices, it suffers from severe non-stationarity due to the…

Multi-Agent Reinforcement Learning (MARL) has shown clear effectiveness in coordinating multiple agents across simulated benchmarks and constrained scenarios. However, its deployment in real-world multi-agent systems (MAS) remains limited,…

Artificial Intelligence · Computer Science 2025-07-15 Siyi Hu , Mohamad A Hady , Jianglin Qiao , Jimmy Cao , Mahardhika Pratama , Ryszard Kowalczyk

State-of-the-art techniques for addressing scaling-related main memory errors identify and repair bits that are at risk of error from within the memory controller. Unfortunately, modern main memory chips internally use on-die error…

Hardware Architecture · Computer Science 2021-12-21 Minesh Patel , Geraldo F. Oliveira , Onur Mutlu

The necessity for cooperation among intelligent machines has popularised cooperative multi-agent reinforcement learning (MARL) in the artificial intelligence (AI) research community. However, many research endeavors have been focused on…

Multiagent Systems · Computer Science 2022-08-04 Jakub Grudzien Kuba , Xidong Feng , Shiyao Ding , Hao Dong , Jun Wang , Yaodong Yang

Millions of individuals' well-being are challenged by the harms of substance use. Harm reduction as a public health strategy is designed to improve their health outcomes and reduce safety risks. Some large language models (LLMs) have…

Computation and Language · Computer Science 2025-07-30 Kaixuan Wang , Chenxin Diao , Jason T. Jacques , Zhongliang Guo , Shuai Zhao

We consider robustness against data corruption in offline multi-agent reinforcement learning from human feedback (MARLHF) under a strong-contamination model: given a dataset $D$ of trajectory-preference tuples (each preference being an…

Machine Learning · Computer Science 2026-04-10 Andi Nika , Debmalya Mandal , Parameswaran Kamalaruban , Adish Singla , Goran Radanović

Current evaluations of tool-integrated LLM agents typically focus on end-to-end tool-usage evaluation while neglecting their stability. This limits their real-world applicability, as various internal or external factors can cause agents to…

Computation and Language · Computer Science 2025-06-30 Weimin Xiong , Ke Wang , Yifan Song , Hanchao Liu , Sai Zhou , Wei Peng , Sujian Li

Autonomous computer use agents that powered by multimodal large language models (MLLMs) are emerging as capable assistants for completing complex digital workflows. However, real-world execution environments are far from ideal: pop-ups,…

Artificial Intelligence · Computer Science 2026-05-26 Jingwei Sun , Jianing Zhu , Yuanyi Li , Tongliang Liu , Xia HU , Bo Han

Cooperative multi-agent reinforcement learning (MARL) is making rapid progress for solving tasks in a grid world and real-world scenarios, in which agents are given different attributes and goals, resulting in different behavior through the…

Multiagent Systems · Computer Science 2022-07-13 Siyi Hu , Chuanlong Xie , Xiaodan Liang , Xiaojun Chang

While large language models are capable diagnostic tools, the impact of multi-agent topology on diagnostic accuracy remains underexplored. This study evaluates four agent topologies, Control (single agent), Hierarchical, Adversarial, and…

Multiagent Systems · Computer Science 2026-03-10 Ahmed Almasoud