English
Related papers

Related papers: Low Entropy Communication in Multi-Agent Reinforce…

200 papers

We present a hybrid systems framework for multi-agent optimization in which agents execute computations in continuous time and communicate in discrete time. The optimization algorithm is a hybrid version of parallelized coordinate descent.…

Optimization and Control · Mathematics 2021-10-04 Katherine Hendrickson , Dawn Hustig-Schultz , Matthew Hale , Ricardo G. Sanfelice

With the rise of online e-commerce platforms, more and more customers prefer to shop online. To sell more products, online platforms introduce various modules to recommend items with different properties such as huge discounts. A web page…

Machine Learning · Computer Science 2020-09-01 Xu He , Bo An , Yanghua Li , Haikai Chen , Rundong Wang , Xinrun Wang , Runsheng Yu , Xin Li , Zhirong Wang

Eliciting cooperation in multi-agent LLM systems is critical for AI alignment. We investigate two approaches: direct communication and curriculum learning. In a 4-player Stag Hunt, a one-word "cheap talk" channel increases cooperation from…

Machine Learning · Computer Science 2026-03-12 Hachem Madmoun , Salem Lahlou

Recent studies in multi-agent communicative reinforcement learning (MACRL) have demonstrated that multi-agent coordination can be greatly improved by allowing communication between agents. Meanwhile, adversarial machine learning (ML) has…

Machine Learning · Computer Science 2022-01-27 Wanqi Xue , Wei Qiu , Bo An , Zinovi Rabinovich , Svetlana Obraztsova , Chai Kiat Yeo

How do we know if communication is emerging in a multi-agent system? The vast majority of recent papers on emergent communication show that adding a communication channel leads to an increase in reward or task success. This is a useful…

Machine Learning · Computer Science 2019-03-14 Ryan Lowe , Jakob Foerster , Y-Lan Boureau , Joelle Pineau , Yann Dauphin

A challenge in reinforcement learning (RL) is minimizing the cost of sampling associated with exploration. Distributed exploration reduces sampling complexity in multi-agent RL (MARL). We investigate the benefits to performance in MARL when…

Machine Learning · Computer Science 2022-05-03 Justin Lidard , Udari Madhushani , Naomi Ehrich Leonard

In this paper, we propose a max-min entropy framework for reinforcement learning (RL) to overcome the limitation of the soft actor-critic (SAC) algorithm implementing the maximum entropy RL in model-free sample-based learning. Whereas the…

Machine Learning · Computer Science 2021-12-21 Seungyul Han , Youngchul Sung

Modern statistical estimation is often performed in a distributed setting where each sample belongs to a single user who shares their data with a central server. Users are typically concerned with preserving the privacy of their samples,…

Machine Learning · Computer Science 2023-05-16 Gecia Bravo-Hermsdorff , Róbert Busa-Fekete , Mohammad Ghavamzadeh , Andres Muñoz Medina , Umar Syed

We consider a multi-agent reinforcement learning problem where each agent seeks to maximize a shared reward while interacting with other agents, and they may or may not be able to communicate. Typically the agents do not have access to…

Multiagent Systems · Computer Science 2021-04-26 Alex Tong Lin , Mark J. Debord , Katia Estabridis , Gary Hewer , Guido Montufar , Stanley Osher

Shannon's information entropy measures of the uncertainty of an event's outcome. If learning about a system reflects a decrease in uncertainty, then a plausible intuition is that learning should be accompanied by a decrease in the entropy…

Robotics · Computer Science 2015-02-20 Paul E. Smaldino

Multi-agent systems using large language models (LLMs) have demonstrated impressive capabilities across various domains. However, current agent communication suffers from verbose output that overload context and increase computational…

Computation and Language · Computer Science 2026-04-09 Danqing Wang , Da Yin , Ruta Desai , Lei Li , Asli Celikyilmaz , Ansong Ni

Communication is an important factor for the big multi-agent world to stay organized and productive. Recently, the AI community has applied the Deep Reinforcement Learning (DRL) to learn the communication strategy and the control policy for…

Multiagent Systems · Computer Science 2019-03-14 Hangyu Mao , Zhibo Gong , Zhengchao Zhang , Zhen Xiao , Yan Ni

Communicating in natural language is a powerful tool in multi-agent settings, as it enables independent agents to share information in partially observable settings and allows zero-shot coordination with humans. However, most prior works…

Artificial Intelligence · Computer Science 2025-02-11 Bidipta Sarkar , Warren Xia , C. Karen Liu , Dorsa Sadigh

Multi-agent LLM systems usually collaborate by exchanging natural-language messages. This interface is simple and interpretable, but it forces each sender's intermediate computation to be serialized into tokens and then reprocessed by the…

Computation and Language · Computer Science 2026-05-14 Wenrui Bao , Huan Wang , Jian Wang , Zhangyang Wang , Kai Wang , Yuzhang Shang

In Multi-Agent Reinforcement Learning, communication is critical to encourage cooperation among agents. Communication in realistic wireless networks can be highly unreliable due to network conditions varying with agents' mobility, and…

Artificial Intelligence · Computer Science 2022-09-16 Diyi Hu , Chi Zhang , Viktor Prasanna , Bhaskar Krishnamachari

In this paper, we investigate the problem of fast spectrum sharing in vehicle-to-everything communication. In order to improve the spectrum efficiency of the whole system, the spectrum of vehicle-to-infrastructure links is reused by…

Information Theory · Computer Science 2023-10-02 Kai Huang , Le Liang , Shi Jin , Geoffrey Ye Li

There are several real-world tasks that would benefit from applying multiagent reinforcement learning (MARL) algorithms, including the coordination among self-driving cars. The real world has challenging conditions for multiagent learning…

Multiagent Systems · Computer Science 2020-02-19 Rose E. Wang , Michael Everett , Jonathan P. How

Nowadays, cooperative multi-agent systems are used to learn how to achieve goals in large-scale dynamic environments. However, learning in these environments is challenging: from the effect of search space size on learning time to…

Multiagent Systems · Computer Science 2022-01-19 Mahnoosh Mahdavimoghaddam , Amin Nikanjam , Monireh Abdoos

We consider the problem of the limited-bandwidth communication for multi-agent reinforcement learning, where agents cooperate with the assistance of a communication protocol and a scheduler. The protocol and scheduler jointly determine…

Artificial Intelligence · Computer Science 2020-06-24 Rundong Wang , Xu He , Runsheng Yu , Wei Qiu , Bo An , Zinovi Rabinovich

For communication to happen successfully, a common language is required between agents to understand information communicated by one another. Inducing the emergence of a common language has been a difficult challenge to multi-agent learning…

Artificial Intelligence · Computer Science 2022-05-03 Yat Long Lo , Biswa Sengupta