中文
相关论文

相关论文: Emergent Discrete Communication in Semantic Spaces

200 篇论文

While natural language is the de facto communication medium for LLM-based agents, it presents a fundamental constraint. The process of downsampling rich, internal latent states into discrete tokens inherently limits the depth and nuance of…

机器学习 · 计算机科学 2026-04-17 Zhuoyun Du , Runze Wang , Huiyu Bai , Zouying Cao , Xiaoyong Zhu , Yu Cheng , Bo Zheng , Wei Chen , Haochao Ying

While state-of-the-art models that rely upon massively multilingual pretrained encoders achieve sample efficiency in downstream applications, they still require abundant amounts of unlabelled text. Nevertheless, most of the world's…

计算与语言 · 计算机科学 2024-02-16 Yaoyiran Li , Edoardo M. Ponti , Ivan Vulić , Anna Korhonen

In this paper, we propose a novel design for AI-native goal-oriented communications, exploiting transformer neural networks under dynamic inference constraints on bandwidth and computation. Transformers have become the standard architecture…

信息论 · 计算机科学 2024-05-07 Alessio Devoto , Simone Petruzzi , Jary Pomponi , Paolo Di Lorenzo , Simone Scardapane

A long-term goal of language agents is to learn and improve through their own experience, ultimately outperforming humans in complex, real-world tasks. However, training agents from experience data with reinforcement learning remains…

Recent research in the design of end to end communication system using deep learning has produced models which can outperform traditional communication schemes. Most of these architectures leveraged autoencoders to design the encoder at the…

信息论 · 计算机科学 2020-01-28 Vishnu Raj , Sheetal Kalyani

Successful negotiators must learn how to balance optimizing for self-interest and cooperation. Yet current artificial negotiation agents often heavily depend on the quality of the static datasets they were trained on, limiting their…

人工智能 · 计算机科学 2021-06-17 Minae Kwon , Siddharth Karamcheti , Mariano-Florentino Cuellar , Dorsa Sadigh

Inspired by recent work in meta-learning and generative teaching networks, we propose a framework called Generative Conversational Networks, in which conversational agents learn to generate their own labelled training data (given some seed…

Discrete diffusion models have recently become competitive with autoregressive models for language modeling, even outperforming them on reasoning tasks requiring planning and global coherence, but they require more computation at inference…

机器学习 · 计算机科学 2026-02-04 Andre He , Sean Welleck , Daniel Fried

The development of artificial agents able to learn through dialog without domain restrictions has the potential to allow machines to learn how to perform tasks in a similar manner to humans and change how we relate to them. However,…

计算与语言 · 计算机科学 2022-02-08 Eugénio Ribeiro , Ricardo Ribeiro , David Martins de Matos

Recurrent models for sequences have been recently successful at many tasks, especially for language modeling and machine translation. Nevertheless, it remains challenging to extract good representations from these models. For instance, even…

机器学习 · 计算机科学 2018-01-31 Łukasz Kaiser , Samy Bengio

Multi-Agent Reinforcement Learning (MARL) methods have shown promise in enabling agents to learn a shared communication protocol from scratch and accomplish challenging team tasks. However, the learned language is usually not interpretable…

This work presents a novel communication framework for decentralized multi-agent systems operating in dynamic network environments. Integrated into a multi-agent reinforcement learning system, the framework is designed to enhance…

多智能体系统 · 计算机科学 2025-01-03 Ben McClusky

Semantic communication has emerged as a promising paradigm for enhancing communication efficiency in sixth-generation (6G) networks. However, the broadcast nature of wireless channels makes SemCom systems vulnerable to eavesdropping, which…

信息论 · 计算机科学 2025-04-01 Shunpu Tang , Yuhao Chen , Qianqian Yang , Ruichen Zhang , Dusit Niyato , Zhiguo Shi

In this work we study a multi-agent coordination problem in which agents are only able to communicate with each other intermittently through a cloud server. To reduce the amount of required communication, we develop a self-triggered…

最优化与控制 · 数学 2017-04-07 Sean L. Bowman , Cameron Nowzari , George J. Pappas

Natural languages display a trade-off among different strategies to convey syntactic structure, such as word order or inflection. This trade-off, however, has not appeared in recent simulations of iterated language learning with neural…

计算与语言 · 计算机科学 2021-09-13 Yuchen Lian , Arianna Bisazza , Tessa Verhoef

The evolution of 6G networking toward agentic AI networking (AgentNet) systems requires a shift from traditional data pipelines to task-aware, agentic AI-native communication solutions. Emergent communication, a novel communication paradigm…

人工智能 · 计算机科学 2026-05-12 Yong Xiao , Jingxuan Chai , Guangming Shi , Ping Zhang

$\textit{No man is an island.}$ Humans communicate with a large community by coordinating with different interlocutors within short conversations. This ability has been understudied by the research on building neural communicative agents.…

计算与语言 · 计算机科学 2021-07-14 Hao Zhu , Graham Neubig , Yonatan Bisk

Effective communication requires adapting to the idiosyncrasies of each communicative context--such as the common ground shared with each partner. Humans demonstrate this ability to specialize to their audience in many contexts, such as the…

机器学习 · 计算机科学 2023-05-03 Aaditya K. Singh , David Ding , Andrew Saxe , Felix Hill , Andrew K. Lampinen

This paper presents distributed algorithmic solutions that employ opportunistic inter-agent communication to achieve dynamic average consensus. In our solutions each agent is endowed with a local criterion that enables it to determine…

最优化与控制 · 数学 2015-03-03 Solmaz S. Kia , Jorge Cortes , Sonia Martinez

An important aspect of developing conversational agents is to give a bot the ability to improve through communicating with humans and to learn from the mistakes that it makes. Most research has focused on learning from fixed training sets…

人工智能 · 计算机科学 2017-01-17 Jiwei Li , Alexander H. Miller , Sumit Chopra , Marc'Aurelio Ranzato , Jason Weston