English
Related papers

Related papers: Multi-Agent Diagnostics for Robustness via Illumin…

200 papers

A key challenge in training generally-capable agents is the design of training tasks that facilitate broad generalization and robustness to environment variations. This challenge motivates the problem setting of Unsupervised Environment…

Machine Learning · Computer Science 2023-08-23 Ishita Mediratta , Minqi Jiang , Jack Parker-Holder , Michael Dennis , Eugene Vinitsky , Tim Rocktäschel

While large language models are capable diagnostic tools, the impact of multi-agent topology on diagnostic accuracy remains underexplored. This study evaluates four agent topologies, Control (single agent), Hierarchical, Adversarial, and…

Multiagent Systems · Computer Science 2026-03-10 Ahmed Almasoud

Reinforcement learning agents are prone to undesired behaviors due to reward mis-specification. Finding a set of reward functions to properly guide agent behaviors is particularly challenging in multi-agent scenarios. Inverse reinforcement…

Machine Learning · Computer Science 2019-08-01 Lantao Yu , Jiaming Song , Stefano Ermon

In many real-world systems, such as adaptive robotics, achieving a single, optimised solution may be insufficient. Instead, a diverse set of high-performing solutions is often required to adapt to varying contexts and requirements. This is…

Machine Learning · Computer Science 2023-11-06 Garðar Ingvarsson , Mikayel Samvelyan , Bryan Lim , Manon Flageat , Antoine Cully , Tim Rocktäschel

The widespread adoption of open-source software (OSS) necessitates the mitigation of vulnerability risks. Most vulnerability detection (VD) methods are limited by inadequate contextual understanding, restrictive single-round interactions,…

Cryptography and Security · Computer Science 2025-10-02 Youpeng Li , Kartik Joshi , Xinda Wang , Eric Wong

Detection of adversarial examples has been a hot topic in the last years due to its importance for safely deploying machine learning algorithms in critical applications. However, the detection methods are generally validated by assuming a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Federica Granese , Marine Picot , Marco Romanelli , Francisco Messina , Pablo Piantanida

We consider a scenario where an agent has multiple available strategies to explore an unknown environment. For each new interaction with the environment, the agent must select which exploration strategy to use. We provide a new…

Machine Learning · Computer Science 2018-08-24 Fabien C. Y. Benureau , Pierre-Yves Oudeyer

The performance and safety of autonomous vehicles (AVs) deteriorates under adverse environments and adversarial actors. The investment in multi-sensor, multi-agent (MSMA) AVs is meant to promote improved efficiency of travel and mitigate…

Robotics · Computer Science 2024-01-18 R. Spencer Hallyburton , David Hunt , Shaocheng Luo , Miroslav Pajic

The vulnerability of machine learning systems to adversarial attacks questions their usage in many applications. In this paper, we propose a randomized diversification as a defense strategy. We introduce a multi-channel architecture in a…

Machine Learning · Computer Science 2019-04-02 Olga Taran , Shideh Rezaeifar , Taras Holotyak , Slava Voloshynovskiy

LLM-based agents are increasingly deployed in multi-agent systems (MAS). As these systems move toward real-world applications, their security becomes paramount. Existing research largely evaluates single-agent security, leaving a critical…

Multiagent Systems · Computer Science 2025-11-17 Nirmit Arora , Sathvik Joel , Ishan Kavathekar , Palak , Rohan Gandhi , Yash Pandya , Tanuja Ganu , Aditya Kanade , Akshay Nambi

Our study assesses the adversarial robustness of LiDAR-camera fusion models in 3D object detection. We introduce an attack technique that, by simply adding a limited number of physically constrained adversarial points above a car, can make…

Robotics · Computer Science 2024-01-10 Bo Yang , Xiaoyu Ji , Zizhi Jin , Yushi Cheng , Wenyuan Xu

Cooperative multi-agent reinforcement learning (CMARL) has shown to be promising for many real-world applications. Previous works mainly focus on improving coordination ability via solving MARL-specific challenges (e.g., non-stationarity,…

Multiagent Systems · Computer Science 2023-05-11 Lei Yuan , Zi-Qian Zhang , Ke Xue , Hao Yin , Feng Chen , Cong Guan , Li-He Li , Chao Qian , Yang Yu

Evolutionary science provides evidence that diversity confers resilience in natural systems. Yet, traditional multi-agent reinforcement learning techniques commonly enforce homogeneity to increase training sample efficiency. When a system…

Multiagent Systems · Computer Science 2024-09-11 Matteo Bettini , Ajay Shankar , Amanda Prorok

Recent studies have shown that robustness to adversarial attacks can be transferred across networks. In other words, we can make a weak model more robust with the help of a strong teacher model. We ask if instead of learning from a static…

Machine Learning · Computer Science 2023-02-13 Jiang Liu , Chun Pong Lau , Hossein Souri , Soheil Feizi , Rama Chellappa

Multi-Agent Reinforcement Learning (MARL) is a branch of machine learning in which agents interact and learn optimal policies through trial and error, addressing complex scenarios where multiple agents interact and learn in the same…

Human-Computer Interaction · Computer Science 2025-12-03 Changhee Lee , Jeongmin Rhee , DongHwa Shin

Recently, multi-agent collaborative (MAC) perception has been proposed and outperformed the traditional single-agent perception in many applications, such as autonomous driving. However, MAC perception is more vulnerable to adversarial…

Cryptography and Security · Computer Science 2024-07-09 Yangheng Zhao , Zhen Xiang , Sheng Yin , Xianghe Pang , Siheng Chen , Yanfeng Wang

Adversarial attacks and robustness in Deep Reinforcement Learning (DRL) have been widely studied in various threat models; however, few consider environmental state perturbations, which are natural in embodied scenarios. To improve the…

Machine Learning · Computer Science 2025-06-11 Chenxu Wang , Huaping Liu

This paper presents an adversary detection mechanism and a resilient control framework for multi-agent systems under spatiotemporal constraints. Safety in multi-agent systems is typically addressed under the assumption that all agents…

Systems and Control · Electrical Eng. & Systems 2022-07-22 Aquib Mustafa , Dimitra Panagou

Achieving the capability of adapting to ever-changing environments is a critical step towards building fully autonomous robots that operate safely in complicated scenarios. In multiagent competitive scenarios, agents may have to adapt to…

Machine Learning · Computer Science 2022-03-16 Macheng Shen , Jonathan P. How

The security of LLM-based multi-agent systems (MAS) is critically threatened by propagation vulnerability, where malicious agents can distort collective decision-making through inter-agent message interactions. While existing supervised…

Artificial Intelligence · Computer Science 2026-04-28 Rui Miao , Yixin Liu , Yili Wang , Xu Shen , Yue Tan , Yiwei Dai , Shirui Pan , Xin Wang