English

A Combinatorial Approach to Neural Emergent Communication

Machine Learning 2024-12-05 v2 Computation and Language

Abstract

Substantial research on deep learning-based emergent communication uses the referential game framework, specifically the Lewis signaling game, however we argue that successful communication in this game typically only need one or two symbols for target image classification because of a sampling pitfall in the training data. To address this issue, we provide a theoretical analysis and introduce a combinatorial algorithm SolveMinSym (SMS) to solve the symbolic complexity for classification, which is the minimum number of symbols in the message for successful communication. We use the SMS algorithm to create datasets with different symbolic complexity to empirically show that data with higher symbolic complexity increases the number of effective symbols in the emergent language.

Keywords

Cite

@article{arxiv.2410.18806,
  title  = {A Combinatorial Approach to Neural Emergent Communication},
  author = {Zheyuan Zhang},
  journal= {arXiv preprint arXiv:2410.18806},
  year   = {2024}
}

Comments

Accepted to COLING 2025

R2 v1 2026-06-28T19:34:22.947Z