English
Related papers

Related papers: Emergent Communication between Heterogeneous Visua…

200 papers

This paper describes a computational model of multiagent multimodal categorization that realizes emergent communication. We clarify whether the computational model can reproduce the following functions in a symbol emergence system,…

Artificial Intelligence · Computer Science 2021-09-16 Yoshinobu Hagiwara , Kazuma Furukawa , Akira Taniguchi , Tadahiro Taniguchi

There is growing interest in the language developed by agents interacting in emergent-communication settings. Earlier studies have focused on the agents' symbol usage, rather than on their representation of visual input. In this paper, we…

Computation and Language · Computer Science 2018-09-14 Diane Bouchacourt , Marco Baroni

To build agents that can collaborate effectively with others, recent research has trained artificial agents to communicate with each other in Lewis-style referential games. However, this often leads to successful but uninterpretable…

Computation and Language · Computer Science 2022-01-11 Jesse Mu , Noah Goodman

We propose co-creative learning as a novel paradigm where humans and AI, i.e., biological and artificial agents, mutually integrate their partial perceptual information and knowledge to construct shared external representations, a process…

Human-Computer Interaction · Computer Science 2025-06-19 Ryota Okumura , Tadahiro Taniguchi , Akira Taniguchi , Yoshinobu Hagiwara

Multi-agent teaming achieves better performance when there is communication among participating agents allowing them to coordinate their actions for maximizing shared utility. However, when collaborating a team of agents with different…

Multiagent Systems · Computer Science 2021-11-01 Esmaeil Seraj , Zheyuan Wang , Rohan Paleja , Matthew Sklar , Anirudh Patel , Matthew Gombolay

Mobile augmented reality (MAR) is widely acknowledged as one of the ubiquitous interfaces to the digital twin and Metaverse, demanding unparalleled levels of latency, computational power, and energy efficiency. The existing solutions for…

Signal Processing · Electrical Eng. & Systems 2023-08-16 Ruxiao Chen , Shuaishuai Guo

Emergent communication has made strides towards learning communication from scratch, but has focused primarily on protocols that resemble human language. In nature, multi-agent cooperation gives rise to a wide range of communication that…

Multiagent Systems · Computer Science 2022-02-08 Niko A. Grupen , Daniel D. Lee , Bart Selman

Collaborative perception improves task performance by expanding the perception range through information sharing among agents. . Immutable heterogeneity poses a significant challenge in collaborative perception, as participating agents may…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Congzhang Shao , Quan Yuan , Guiyang Luo , Yue Hu , Danni Wang , Yilin Liu , Rui Pan , Bo Chen , Jinglin Li

As large pre-trained image-processing neural networks are being embedded in autonomous agents such as self-driving cars or robots, the question arises of how such systems can communicate with each other about the surrounding world, despite…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Matéo Mahaut , Francesca Franzon , Roberto Dessì , Marco Baroni

Collaborative perception, an emerging paradigm in autonomous driving, has been introduced to mitigate the limitations of single-vehicle systems, such as limited sensor range and occlusion. To improve the robustness of inter-vehicle data…

Signal Processing · Electrical Eng. & Systems 2025-11-26 Mingyi Lu , Guowei Liu , Le Liang , Chongtao Guo , Hao Ye , Shi Jin

Deep reinforcement learning has been applied successfully to solve various real-world problems and the number of its applications in the multi-agent settings has been increasing. Multi-agent learning distinctly poses significant challenges…

Machine Learning · Computer Science 2021-02-24 Ngoc Duy Nguyen , Thanh Thi Nguyen , Doug Creighton , Saeid Nahavandi

In the studies on symbol emergence and emergent communication in a population of agents, a computational model was employed in which agents participate in various language games. Among these, the Metropolis-Hastings naming game (MHNG)…

Computation and Language · Computer Science 2023-06-01 Jun Inukai , Tadahiro Taniguchi , Akira Taniguchi , Yoshinobu Hagiwara

Explicit communication among humans is key to coordinating and learning. Social learning, which uses cues from experts, can greatly benefit from the usage of explicit communication to align heterogeneous policies, reduce sample complexity,…

Machine Learning · Computer Science 2023-03-01 Seth Karten , Siva Kailas , Huao Li , Katia Sycara

In multi-user semantic communication, language mismatche poses a significant challenge when independently trained agents interact. We present a novel semantic equalization algorithm that enables communication between agents with different…

Machine Learning · Computer Science 2024-12-02 Tomás Hüttebräucker , Simone Fiorellino , Mohamed Sana , Paolo Di Lorenzo , Emilio Calvanese Strinati

With the rapid development of deep learning, most of current state-of-the-art techniques in natural langauge processing are based on deep learning models trained with argescaled static textual corpora. However, we human beings learn and…

Computation and Language · Computer Science 2019-11-05 Shangmin Guo

To develop computational agents that better communicate using their own emergent language, we endow the agents with an ability to focus their attention on particular concepts in the environment. Humans often understand an object or scene as…

Computation and Language · Computer Science 2023-05-19 Ryokan Ri , Ryo Ueda , Jason Naradowsky

The literature in modern machine learning has only negative results for learning to communicate between competitive agents using standard RL. We introduce a modified sender-receiver game to study the spectrum of partially-competitive…

Machine Learning · Computer Science 2021-01-26 Michael Noukhovitch , Travis LaCroix , Angeliki Lazaridou , Aaron Courville

Recent advances in AI call for a paradigm shift from bit-centric communication to goal- and semantics-oriented architectures, paving the way for AI-native 6G networks. In this context, we address a key open challenge: enabling heterogeneous…

Multiagent Systems · Computer Science 2025-12-04 Enrico Grimaldi , Mario Edoardo Pandolfo , Gabriele D'Acunto , Sergio Barbarossa , Paolo Di Lorenzo

The emergence of communication systems between agents which learn to play referential signalling games with realistic images has attracted a lot of attention recently. The majority of work has focused on using fixed, pretrained image…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Daniela Mihai , Jonathon Hare

For communication to happen successfully, a common language is required between agents to understand information communicated by one another. Inducing the emergence of a common language has been a difficult challenge to multi-agent learning…

Artificial Intelligence · Computer Science 2022-05-03 Yat Long Lo , Biswa Sengupta