English
Related papers

Related papers: Emergent Discrete Communication in Semantic Spaces

200 papers

While natural language is the de facto communication medium for LLM-based agents, it presents a fundamental constraint. The process of downsampling rich, internal latent states into discrete tokens inherently limits the depth and nuance of…

Machine Learning · Computer Science 2026-04-17 Zhuoyun Du , Runze Wang , Huiyu Bai , Zouying Cao , Xiaoyong Zhu , Yu Cheng , Bo Zheng , Wei Chen , Haochao Ying

While state-of-the-art models that rely upon massively multilingual pretrained encoders achieve sample efficiency in downstream applications, they still require abundant amounts of unlabelled text. Nevertheless, most of the world's…

Computation and Language · Computer Science 2024-02-16 Yaoyiran Li , Edoardo M. Ponti , Ivan Vulić , Anna Korhonen

In this paper, we propose a novel design for AI-native goal-oriented communications, exploiting transformer neural networks under dynamic inference constraints on bandwidth and computation. Transformers have become the standard architecture…

Information Theory · Computer Science 2024-05-07 Alessio Devoto , Simone Petruzzi , Jary Pomponi , Paolo Di Lorenzo , Simone Scardapane

A long-term goal of language agents is to learn and improve through their own experience, ultimately outperforming humans in complex, real-world tasks. However, training agents from experience data with reinforcement learning remains…

Recent research in the design of end to end communication system using deep learning has produced models which can outperform traditional communication schemes. Most of these architectures leveraged autoencoders to design the encoder at the…

Information Theory · Computer Science 2020-01-28 Vishnu Raj , Sheetal Kalyani

Successful negotiators must learn how to balance optimizing for self-interest and cooperation. Yet current artificial negotiation agents often heavily depend on the quality of the static datasets they were trained on, limiting their…

Artificial Intelligence · Computer Science 2021-06-17 Minae Kwon , Siddharth Karamcheti , Mariano-Florentino Cuellar , Dorsa Sadigh

Inspired by recent work in meta-learning and generative teaching networks, we propose a framework called Generative Conversational Networks, in which conversational agents learn to generate their own labelled training data (given some seed…

Computation and Language · Computer Science 2021-07-20 Alexandros Papangelis , Karthik Gopalakrishnan , Aishwarya Padmakumar , Seokhwan Kim , Gokhan Tur , Dilek Hakkani-Tur

Discrete diffusion models have recently become competitive with autoregressive models for language modeling, even outperforming them on reasoning tasks requiring planning and global coherence, but they require more computation at inference…

Machine Learning · Computer Science 2026-02-04 Andre He , Sean Welleck , Daniel Fried

The development of artificial agents able to learn through dialog without domain restrictions has the potential to allow machines to learn how to perform tasks in a similar manner to humans and change how we relate to them. However,…

Computation and Language · Computer Science 2022-02-08 Eugénio Ribeiro , Ricardo Ribeiro , David Martins de Matos

Recurrent models for sequences have been recently successful at many tasks, especially for language modeling and machine translation. Nevertheless, it remains challenging to extract good representations from these models. For instance, even…

Machine Learning · Computer Science 2018-01-31 Łukasz Kaiser , Samy Bengio

Multi-Agent Reinforcement Learning (MARL) methods have shown promise in enabling agents to learn a shared communication protocol from scratch and accomplish challenging team tasks. However, the learned language is usually not interpretable…

This work presents a novel communication framework for decentralized multi-agent systems operating in dynamic network environments. Integrated into a multi-agent reinforcement learning system, the framework is designed to enhance…

Multiagent Systems · Computer Science 2025-01-03 Ben McClusky

Semantic communication has emerged as a promising paradigm for enhancing communication efficiency in sixth-generation (6G) networks. However, the broadcast nature of wireless channels makes SemCom systems vulnerable to eavesdropping, which…

Information Theory · Computer Science 2025-04-01 Shunpu Tang , Yuhao Chen , Qianqian Yang , Ruichen Zhang , Dusit Niyato , Zhiguo Shi

In this work we study a multi-agent coordination problem in which agents are only able to communicate with each other intermittently through a cloud server. To reduce the amount of required communication, we develop a self-triggered…

Optimization and Control · Mathematics 2017-04-07 Sean L. Bowman , Cameron Nowzari , George J. Pappas

Natural languages display a trade-off among different strategies to convey syntactic structure, such as word order or inflection. This trade-off, however, has not appeared in recent simulations of iterated language learning with neural…

Computation and Language · Computer Science 2021-09-13 Yuchen Lian , Arianna Bisazza , Tessa Verhoef

The evolution of 6G networking toward agentic AI networking (AgentNet) systems requires a shift from traditional data pipelines to task-aware, agentic AI-native communication solutions. Emergent communication, a novel communication paradigm…

Artificial Intelligence · Computer Science 2026-05-12 Yong Xiao , Jingxuan Chai , Guangming Shi , Ping Zhang

$\textit{No man is an island.}$ Humans communicate with a large community by coordinating with different interlocutors within short conversations. This ability has been understudied by the research on building neural communicative agents.…

Computation and Language · Computer Science 2021-07-14 Hao Zhu , Graham Neubig , Yonatan Bisk

Effective communication requires adapting to the idiosyncrasies of each communicative context--such as the common ground shared with each partner. Humans demonstrate this ability to specialize to their audience in many contexts, such as the…

Machine Learning · Computer Science 2023-05-03 Aaditya K. Singh , David Ding , Andrew Saxe , Felix Hill , Andrew K. Lampinen

This paper presents distributed algorithmic solutions that employ opportunistic inter-agent communication to achieve dynamic average consensus. In our solutions each agent is endowed with a local criterion that enables it to determine…

Optimization and Control · Mathematics 2015-03-03 Solmaz S. Kia , Jorge Cortes , Sonia Martinez

An important aspect of developing conversational agents is to give a bot the ability to improve through communicating with humans and to learn from the mistakes that it makes. Most research has focused on learning from fixed training sets…

Artificial Intelligence · Computer Science 2017-01-17 Jiwei Li , Alexander H. Miller , Sumit Chopra , Marc'Aurelio Ranzato , Jason Weston