English
Related papers

Related papers: Entropy Minimization In Emergent Languages

200 papers

We consider the issue of multiple agents learning to communicate through reinforcement learning within partially observable environments, with a focus on information asymmetry in the second part of our work. We provide a review of the…

Machine Learning · Computer Science 2019-11-14 Mohamed Salah Zaïem , Etienne Bennequin

Emergent communication in artificial agents has been studied to understand language evolution, as well as to develop artificial systems that learn to communicate with humans. We show that agents performing a cooperative navigation task in…

Machine Learning · Computer Science 2020-07-01 Ivana Kajić , Eser Aygün , Doina Precup

For communication to happen successfully, a common language is required between agents to understand information communicated by one another. Inducing the emergence of a common language has been a difficult challenge to multi-agent learning…

Artificial Intelligence · Computer Science 2022-05-03 Yat Long Lo , Biswa Sengupta

We study the problem of emergent communication, in which language arises because speakers and listeners must communicate information in order to solve tasks. In temporally extended reinforcement learning domains, it has proved hard to learn…

Multiagent Systems · Computer Science 2019-12-13 Tom Eccles , Yoram Bachrach , Guy Lever , Angeliki Lazaridou , Thore Graepel

Artificial agents that learn to communicate in order to accomplish a given task acquire communication protocols that are typically opaque to a human. A large body of work has attempted to evaluate the emergent communication via various…

Artificial Intelligence · Computer Science 2024-03-25 Boaz Carmeli , Yonatan Belinkov , Ron Meir

Recently, emergence of signaling conventions, among which language is a prime example, draws a considerable interdisciplinary interest ranging from game theory, to robotics to evolutionary linguistics. Such a wide spectrum of research is…

Physics and Society · Physics 2018-12-03 Dorota Lipowska , Adam Lipowski

With the rapid development of deep learning, most of current state-of-the-art techniques in natural langauge processing are based on deep learning models trained with argescaled static textual corpora. However, we human beings learn and…

Computation and Language · Computer Science 2019-11-05 Shangmin Guo

In the recent shift towards human-centric AI, the need for machines to accurately use natural language has become increasingly important. While a common approach to achieve this is to train large language models, this method presents a form…

Computation and Language · Computer Science 2024-01-09 Nicolo' Brandizzi

Emergent communication has made strides towards learning communication from scratch, but has focused primarily on protocols that resemble human language. In nature, multi-agent cooperation gives rise to a wide range of communication that…

Multiagent Systems · Computer Science 2022-02-08 Niko A. Grupen , Daniel D. Lee , Bart Selman

Researchers are using deep learning models to explore the emergence of language in various language games, where agents interact and develop an emergent language to solve tasks. We focus on the factors that determine the expressivity of…

Computation and Language · Computer Science 2022-03-17 Shangmin Guo , Yi Ren , Kory Mathewson , Simon Kirby , Stefano V. Albrecht , Kenny Smith

Explicit communication among humans is key to coordinating and learning. Social learning, which uses cues from experts, can greatly benefit from the usage of explicit communication to align heterogeneous policies, reduce sample complexity,…

Machine Learning · Computer Science 2023-03-01 Seth Karten , Siva Kailas , Huao Li , Katia Sycara

While most machine translation systems to date are trained on large parallel corpora, humans learn language in a different way: by being grounded in an environment and interacting with other humans. In this work, we propose a communication…

Computation and Language · Computer Science 2018-04-12 Jason Lee , Kyunghyun Cho , Jason Weston , Douwe Kiela

The field of emergent language represents a novel area of research within the domain of artificial intelligence, particularly within the context of multi-agent reinforcement learning. Although the concept of studying language emergence is…

We study emergent communication in a multi-agent reinforcement learning setting, where the agents solve cooperative tasks and have access to a communication channel. The communication channel may consist of either discrete symbols or…

Machine Learning · Computer Science 2024-10-29 John Isak Fjellvang Villanger , Troels Arnfred Bojesen

In many situations, communication between agents is a critical component of cooperative multi-agent systems, however, it can be difficult to learn or evolve. In this paper, we investigate a simple way in which the emergence of communication…

Multiagent Systems · Computer Science 2024-05-28 Dylan Cope , Peter McBurney

We study the entropy of Chinese and English texts, based on characters in case of Chinese texts and based on words for both languages. Significant differences are found between the languages and between different personal styles of debating…

Computation and Language · Computer Science 2017-01-17 R. R. Xie , W. B. Deng , D. J. Wang , L. P. Csernai

Learning interpretable communication is essential for multi-agent and human-agent teams (HATs). In multi-agent reinforcement learning for partially-observable environments, agents may convey information to others via learned communication,…

Machine Learning · Computer Science 2023-01-12 Seth Karten , Mycal Tucker , Huao Li , Siva Kailas , Michael Lewis , Katia Sycara

Emergent communication offers insight into how agents develop shared structured representations, yet most research assumes homogeneous modalities or aligned representational spaces, overlooking the perceptual heterogeneity of real-world…

Multiagent Systems · Computer Science 2026-01-30 Naomi Pitzer , Daniela Mihai

Communication is a important factor that enables agents work cooperatively in multi-agent reinforcement learning (MARL). Most previous work uses continuous message communication whose high representational capacity comes at the expense of…

Machine Learning · Computer Science 2021-02-26 Sheng Li , Yutai Zhou , Ross Allen , Mykel J. Kochenderfer

Natural language allows us to refer to novel composite concepts by combining expressions denoting their parts according to systematic rules, a property known as \emph{compositionality}. In this paper, we study whether the language emerging…

Computation and Language · Computer Science 2020-04-21 Rahma Chaabouni , Eugene Kharitonov , Diane Bouchacourt , Emmanuel Dupoux , Marco Baroni