English
Related papers

Related papers: Biases for Emergent Communication in Multi-agent R…

200 papers

The literature in modern machine learning has only negative results for learning to communicate between competitive agents using standard RL. We introduce a modified sender-receiver game to study the spectrum of partially-competitive…

Machine Learning · Computer Science 2021-01-26 Michael Noukhovitch , Travis LaCroix , Angeliki Lazaridou , Aaron Courville

Language interfaces with many other cognitive domains. This paper explores how interactions at these interfaces can be studied with deep learning methods, focusing on the relation between language emergence and visual perception. To model…

Social and Information Networks · Computer Science 2023-01-11 Xenia Ohmer , Michael Marino , Michael Franke , Peter König

Many real-world problems require the coordination of multiple autonomous agents. Recent work has shown the promise of Graph Neural Networks (GNNs) to learn explicit communication strategies that enable complex multi-agent coordination.…

Robotics · Computer Science 2020-11-05 Jan Blumenkamp , Amanda Prorok

Natural language has the universal properties of being compositional and grounded in reality. The emergence of linguistic properties is often investigated through simulations of emergent communication in referential games. However, these…

Computation and Language · Computer Science 2024-07-26 Tom Kouwenhoven , Max Peeperkorn , Bram van Dijk , Tessa Verhoef

Exposure bias describes the phenomenon that a language model trained under the teacher forcing schema may perform poorly at the inference stage when its predictions are conditioned on its previous predictions unseen from the training…

Computation and Language · Computer Science 2020-04-02 Yifan Xu , Kening Zhang , Haoyu Dong , Yuezhou Sun , Wenlong Zhao , Zhuowen Tu

To build agents that can collaborate effectively with others, recent research has trained artificial agents to communicate with each other in Lewis-style referential games. However, this often leads to successful but uninterpretable…

Computation and Language · Computer Science 2022-01-11 Jesse Mu , Noah Goodman

We present a method for combining multi-agent communication and traditional data-driven approaches to natural language learning, with an end goal of teaching agents to communicate with humans in natural language. Our starting point is a…

Computation and Language · Computer Science 2020-05-15 Angeliki Lazaridou , Anna Potapenko , Olivier Tieleman

Communication is a powerful tool for coordination in multi-agent RL. But inducing an effective, common language is a difficult challenge, particularly in the decentralized setting. In this work, we introduce an alternative perspective where…

Artificial Intelligence · Computer Science 2024-02-05 Yat Long Lo , Biswa Sengupta , Jakob Foerster , Michael Noukhovitch

Recently, emergence of signaling conventions, among which language is a prime example, draws a considerable interdisciplinary interest ranging from game theory, to robotics to evolutionary linguistics. Such a wide spectrum of research is…

Physics and Society · Physics 2018-12-03 Dorota Lipowska , Adam Lipowski

A long-term goal of language agents is to learn and improve through their own experience, ultimately outperforming humans in complex, real-world tasks. However, training agents from experience data with reinforcement learning remains…

Languages are shaped by the inductive biases of their users. Using a classical referential game, we investigate how artificial languages evolve when optimised for inductive biases in humans and large language models (LLMs) via Human-Human,…

Computation and Language · Computer Science 2025-05-29 Tom Kouwenhoven , Max Peeperkorn , Roy de Kleijn , Tessa Verhoef

Natural languages display a trade-off among different strategies to convey syntactic structure, such as word order or inflection. This trade-off, however, has not appeared in recent simulations of iterated language learning with neural…

Computation and Language · Computer Science 2021-09-13 Yuchen Lian , Arianna Bisazza , Tessa Verhoef

Effective communication is an important skill for enabling information exchange and cooperation in multi-agent settings. Indeed, emergent communication is now a vibrant field of research, with common settings involving discrete cheap-talk…

Multiagent Systems · Computer Science 2020-12-04 Kalesha Bullard , Franziska Meier , Douwe Kiela , Joelle Pineau , Jakob Foerster

This paper explores a novel approach to achieving emergent compositional communication in multi-agent systems. We propose a training regime implementing template transfer, the idea of carrying over learned biases across contexts. In our…

Machine Learning · Computer Science 2019-10-15 Tomasz Korbak , Julian Zubek , Łukasz Kuciński , Piotr Miłoś , Joanna Rączaszek-Leonardi

Communication is a important factor that enables agents work cooperatively in multi-agent reinforcement learning (MARL). Most previous work uses continuous message communication whose high representational capacity comes at the expense of…

Machine Learning · Computer Science 2021-02-26 Sheng Li , Yutai Zhou , Ross Allen , Mykel J. Kochenderfer

In different wireless network scenarios, multiple network entities need to cooperate in order to achieve a common task with minimum delay and energy consumption. Future wireless networks mandate exchanging high dimensional data in dynamic…

Machine Learning · Computer Science 2023-09-13 Marwa Chafii , Salmane Naoumi , Reda Alami , Ebtesam Almazrouei , Mehdi Bennis , Merouane Debbah

Recent research studies communication emergence in communities of deep network agents assigned a joint task, hoping to gain insights on human language evolution. We propose here a new task capturing crucial aspects of the human environment,…

Computation and Language · Computer Science 2019-05-29 Diane Bouchacourt , Marco Baroni

There is growing interest in studying the languages that emerge when neural agents are jointly trained to solve tasks requiring communication through a discrete channel. We investigate here the information-theoretic complexity of such…

Computation and Language · Computer Science 2020-06-29 Eugene Kharitonov , Rahma Chaabouni , Diane Bouchacourt , Marco Baroni

This paper proposes a generative probabilistic model integrating emergent communication and multi-agent reinforcement learning. The agents plan their actions by probabilistic inference, called control as inference, and communicate using…

Artificial Intelligence · Computer Science 2023-07-12 Tomoaki Nakamura , Akira Taniguchi , Tadahiro Taniguchi

Emergent communication offers insight into how agents develop shared structured representations, yet most research assumes homogeneous modalities or aligned representational spaces, overlooking the perceptual heterogeneity of real-world…

Multiagent Systems · Computer Science 2026-01-30 Naomi Pitzer , Daniela Mihai