English
Related papers

Related papers: Certifiably Robust Policy Learning against Adversa…

200 papers

We study communication over a Multiple Access Channel (MAC) where users can possibly be adversarial. The receiver is unaware of the identity of the adversarial users (if any). When all users are non-adversarial, we want their messages to be…

Information Theory · Computer Science 2023-09-12 Neha Sangwan , Mayank Bakshi , Bikash Kumar Dey , Vinod M. Prabhakaran

In recent years, a proliferation of methods were developed for cooperative multi-agent reinforcement learning (c-MARL). However, the robustness of c-MARL agents against adversarial attacks has been rarely explored. In this paper, we propose…

Machine Learning · Computer Science 2023-09-12 Nhan H. Pham , Lam M. Nguyen , Jie Chen , Hoang Thanh Lam , Subhro Das , Tsui-Wei Weng

Multi-agent systems coordinate LLM-based agents to perform tasks on users' behalf. In real-world applications, multi-agent systems will inevitably interact with untrusted inputs, such as malicious Web content, files, email attachments, and…

Cryptography and Security · Computer Science 2025-09-16 Harold Triedman , Rishi Jha , Vitaly Shmatikov

Communication enables coordination in multi-agent reinforcement learning (MARL), but many real-world applications, e.g., search-and-rescue with drone swarms, operate under severe bandwidth constraints. Many communication architectures still…

Multiagent Systems · Computer Science 2026-05-21 Alexi Canesse , Benoît Goupil , Jesse Read , Sonia Vanier

Many recent successful off-policy multi-agent reinforcement learning (MARL) algorithms for cooperative partially observable environments focus on finding factorized value functions, leading to convoluted network structures. Building on the…

Machine Learning · Computer Science 2023-10-27 Raphaël Avalos , Mathieu Reymond , Ann Nowé , Diederik M. Roijers

Multi-Agent Systems (MAS) have become a prevalent paradigm for Large Language Model (LLM) applications. However, the complex multi-agent design in MAS introduces unique trustworthiness concerns: adversarial agents can inject misleading…

Cryptography and Security · Computer Science 2026-05-27 Chengcan Wu , Zhixin Zhang , Mingqian Xu , Zeming Wei , Meng Sun

Reinforcement learning often uses neural networks to solve complex control tasks. However, neural networks are sensitive to input perturbations, which makes their deployment in safety-critical environments challenging. This work lifts…

Machine Learning · Computer Science 2024-08-20 Manuel Wendl , Lukas Koller , Tobias Ladner , Matthias Althoff

Communication can improve coordination in partially observed multi-agent reinforcement learning (MARL), but learning \emph{when} and \emph{who} to communicate with requires choosing among many possible sender-recipient pairs, and the effect…

Multiagent Systems · Computer Science 2026-03-06 Manav Vora , Gokul Puthumanaillam , Hiroyasu Tsukamoto , Melkior Ornik

Many emerging agentic paradigms require agents to collaborate with one another (or people) to achieve shared goals. Unfortunately, existing approaches to learning policies for such collaborative problems produce brittle solutions that fail…

Machine Learning · Computer Science 2026-03-02 Chengrui Qu , Yizhou Zhang , Nicolas Lanzetti , Eric Mazumdar

Cooperation is central to multi-agent reinforcement learning (MARL), yet learned coordination can be fragile when external perturbations disrupt inter-agent interactions. Prior robust MARL methods have primarily considered value-oriented…

Machine Learning · Computer Science 2026-05-19 Sunwoo Lee , Mingu Kang , Yonghyeon Jo , Seungyul Han

Large Language Model based multi-agent systems are revolutionizing autonomous communication and collaboration, yet they remain vulnerable to security threats like unauthorized access and data breaches. To address this, we introduce…

Artificial Intelligence · Computer Science 2025-07-09 Junyuan Mao , Fanci Meng , Yifan Duan , Miao Yu , Xiaojun Jia , Junfeng Fang , Yuxuan Liang , Kun Wang , Qingsong Wen

Safety and scalability are two critical challenges faced by practical Multi-Agent Systems (MAS). However, existing Multi-Agent Reinforcement Learning (MARL) algorithms that rely solely on reward shaping are ineffective in ensuring safety,…

Multiagent Systems · Computer Science 2025-04-02 Haikuo Du , Fandi Gou , Yunze Cai

Recent advances in multi-agent reinforcement learning (MARL) are enabling impressive coordination in heterogeneous multi-robot teams. However, existing approaches often overlook the challenge of generalizing learned policies to teams of new…

Robotics · Computer Science 2024-01-25 Pierce Howell , Max Rudolph , Reza Torbati , Kevin Fu , Harish Ravichandar

We consider resilient versions of discrete-time multi-agent consensus in the presence of faulty or even malicious agents in the network. In particular, we develop event-triggered update rules which can mitigate the influence of the…

Systems and Control · Computer Science 2019-06-18 Yuan Wang , Hideaki Ishii

We investigate the problem of reliable communication in the presence of active adversaries that can tamper with the transmitted data. We consider a legitimate transmitter-receiver pair connected over multiple communication paths (routes).…

Information Theory · Computer Science 2014-04-28 Mahtab Mirmohseni , Panagiotis Papadimitratos

Autonomous agents are increasingly deployed in both offensive and defensive cyber operations, creating high-speed, closed-loop interactions in critical infrastructure environments. Advanced Persistent Threat (APT) actors exploit "Living off…

Cryptography and Security · Computer Science 2026-04-07 Yiyao Zhang , Diksha Goel , Hussain Ahmad

We consider a multi-agent consensus problem in the presence of adversarial agents. The adversaries are able to listen to the inter-agent communications and try to estimate the state of the agents. The agents have a limited bit-rate for…

Systems and Control · Electrical Eng. & Systems 2021-11-09 Dipankar Maity , Panagiotis Tsiotras

In this work, we propose a novel memory-based multi-agent meta-learning architecture and learning procedure that allows for learning of a shared communication policy that enables the emergence of rapid adaptation to new and unseen…

Finding a balance between collaboration and competition is crucial for artificial agents in many real-world applications. We investigate this using a Multi-Agent Reinforcement Learning (MARL) setup on the back of a high-impact problem. The…

Artificial Intelligence · Computer Science 2024-11-08 Philipp Dominic Siedler

Cooperative multi-agent reinforcement learning (c-MARL) has been widely deployed in real-world applications, such as social robots, embodied intelligence, UAV swarms, etc. Nevertheless, many adversarial attacks still exist to threaten…

Machine Learning · Computer Science 2026-03-24 Men Niu , Xinxin Fan , Quanliang Jing , Shaoye Luo , Yunfeng Lu