English
Related papers

Related papers: Structural Inductive Biases in Emergent Communicat…

200 papers

Learning to communicate is considered an essential task to develop a general AI. While recent literature in language evolution has studied emergent language through discrete or continuous message symbols, there has been little work in the…

Multiagent Systems · Computer Science 2021-09-17 Shresth Verma , Joydip Dhar

Agent-based models and signalling games are useful tools with which to study the emergence of linguistic communication in a tractable setting. These techniques have been used to study the compositional property of natural languages, but…

Multiagent Systems · Computer Science 2020-12-09 Graham Todd , Shane Steinert-Threlkeld , Christopher Potts

We study emergent communication in a multi-agent reinforcement learning setting, where the agents solve cooperative tasks and have access to a communication channel. The communication channel may consist of either discrete symbols or…

Machine Learning · Computer Science 2024-10-29 John Isak Fjellvang Villanger , Troels Arnfred Bojesen

We study the problem of emergent communication, in which language arises because speakers and listeners must communicate information in order to solve tasks. In temporally extended reinforcement learning domains, it has proved hard to learn…

Multiagent Systems · Computer Science 2019-12-13 Tom Eccles , Yoram Bachrach , Guy Lever , Angeliki Lazaridou , Thore Graepel

Finding and facilitating commonalities between the linguistic behaviors of large language models and humans could lead to major breakthroughs in our understanding of the acquisition, processing, and evolution of language. However, most…

Computation and Language · Computer Science 2024-11-28 Lukas Galke , Limor Raviv

There is growing interest in the language developed by agents interacting in emergent-communication settings. Earlier studies have focused on the agents' symbol usage, rather than on their representation of visual input. In this paper, we…

Computation and Language · Computer Science 2018-09-14 Diane Bouchacourt , Marco Baroni

In this work, we propose a computational framework in which agents equipped with communication capabilities simultaneously play a series of referential games, where agents are trained using deep reinforcement learning. We demonstrate that…

Computation and Language · Computer Science 2020-03-03 Laura Graesser , Kyunghyun Cho , Douwe Kiela

Emergent communication in artificial agents has been studied to understand language evolution, as well as to develop artificial systems that learn to communicate with humans. We show that agents performing a cooperative navigation task in…

Machine Learning · Computer Science 2020-07-01 Ivana Kajić , Eser Aygün , Doina Precup

Recent work has studied the emergence of language among deep reinforcement learning agents that must collaborate to solve a task. Of particular interest are the factors that cause language to be compositional -- i.e., express meaning by…

Machine Learning · Computer Science 2020-05-29 Michael Cogswell , Jiasen Lu , Stefan Lee , Devi Parikh , Dhruv Batra

Emergent communication (EmCom) with deep neural network-based agents promises to yield insights into the nature of human language, but remains focused primarily on a few subfield-specific goals and metrics that prioritize communication…

Computation and Language · Computer Science 2025-10-22 Miles Gilberti , Shane Storks , Huteng Dai

Several recent works have found the emergence of grounded compositional language in the communication protocols developed by mostly cooperative multi-agent systems when learned end-to-end to maximize performance on a downstream task.…

Artificial Intelligence · Computer Science 2020-07-17 Paul Pu Liang , Jeffrey Chen , Ruslan Salakhutdinov , Louis-Philippe Morency , Satwik Kottur

Compositionality has traditionally been understood as a major factor in productivity of language and, more broadly, human cognition. Yet, recently, some research started to question its status, showing that artificial neural networks are…

Computation and Language · Computer Science 2022-06-13 Michal Auersperger , Pavel Pecina

We investigate the compositional structure of message vectors computed by a deep network trained on a communication game. By comparing truth-conditional representations of encoder-produced message vectors to human-produced referring…

Computation and Language · Computer Science 2017-07-27 Jacob Andreas , Dan Klein

Language interfaces with many other cognitive domains. This paper explores how interactions at these interfaces can be studied with deep learning methods, focusing on the relation between language emergence and visual perception. To model…

Social and Information Networks · Computer Science 2023-01-11 Xenia Ohmer , Michael Marino , Michael Franke , Peter König

By capturing statistical patterns in large corpora, machine learning has enabled significant advances in natural language processing, including in machine translation, question answering, and sentiment analysis. However, for agents to…

Artificial Intelligence · Computer Science 2018-07-25 Igor Mordatch , Pieter Abbeel

The emergence of communication systems between agents which learn to play referential signalling games with realistic images has attracted a lot of attention recently. The majority of work has focused on using fixed, pretrained image…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Daniela Mihai , Jonathon Hare

With the rapid development of deep learning, most of current state-of-the-art techniques in natural langauge processing are based on deep learning models trained with argescaled static textual corpora. However, we human beings learn and…

Computation and Language · Computer Science 2019-11-05 Shangmin Guo

A longstanding question in cognitive science concerns the learning mechanisms underlying compositionality in human cognition. Humans can infer the structured relationships (e.g., grammatical rules) implicit in their sensory observations…

Machine Learning · Computer Science 2021-05-20 Jacob Russin , Roland Fernandez , Hamid Palangi , Eric Rosen , Nebojsa Jojic , Paul Smolensky , Jianfeng Gao

Evidence that visual communication preceded written language and provided a basis for it goes back to prehistory, in forms such as cave and rock paintings depicting traces of our distant ancestors. Emergent communication research has sought…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Daniela Mihai , Jonathon Hare

Artificial neural networks (ANNs) are increasingly used as research models, but questions remain about their generalizability and representational invariance. Biological neural networks under social constraints evolved to enable…

Computation and Language · Computer Science 2023-05-05 Tobias J. Wieczorek , Tatjana Tchumatchenko , Carlos Wert Carvajal , Maximilian F. Eggl