English
Related papers

Related papers: MT-PingEval: Evaluating Multi-Turn Collaboration w…

200 papers

Communication is a important factor that enables agents work cooperatively in multi-agent reinforcement learning (MARL). Most previous work uses continuous message communication whose high representational capacity comes at the expense of…

Machine Learning · Computer Science 2021-02-26 Sheng Li , Yutai Zhou , Ross Allen , Mykel J. Kochenderfer

Inspired by previous work on emergent communication in referential games, we propose a novel multi-modal, multi-step referential game, where the sender and receiver have access to distinct modalities of an object, and their information…

Machine Learning · Computer Science 2018-04-18 Katrina Evtimova , Andrew Drozdov , Douwe Kiela , Kyunghyun Cho

Recent advancements have expanded the role of Large Language Models in board games from playing agents to creative co-designers. However, a critical gap remains: current systems lack the capacity to offer constructive critique grounded in…

Human-Computer Interaction · Computer Science 2026-04-14 Zizhen Li , Chuanhao Li , Yibin Wang , Yukang Feng , Jianwen Sun , Jiaxin Ai , Fanrui Zhang , Mingzhu Sun , Yifei Huang , Kaipeng Zhang

Large language models (LLMs) have been widely applied in various fields due to their excellent capability for memorizing knowledge and chain of thought (CoT). When these language models are applied in the field of psychological counseling,…

Computation and Language · Computer Science 2023-11-02 Yirong Chen , Xiaofen Xing , Jingkai Lin , Huimin Zheng , Zhenyu Wang , Qi Liu , Xiangmin Xu

As large language models (LLMs) are increasingly deployed as autonomous agents, understanding their cooperation and social mechanisms is becoming increasingly important. In particular, how LLMs balance self-interest and collective…

Artificial Intelligence · Computer Science 2025-07-25 David Guzman Piedrahita , Yongjin Yang , Mrinmaya Sachan , Giorgia Ramponi , Bernhard Schölkopf , Zhijing Jin

Recent advances in video multimodal large language models (Video MLLMs) have significantly enhanced video understanding and multi-modal interaction capabilities. While most existing systems operate in a turn-based manner where the model can…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Yueqian Wang , Songxiang Liu , Disong Wang , Nuo Xu , Guanglu Wan , Huishuai Zhang , Dongyan Zhao

With the continuous evolution and refinement of LLMs, they are endowed with impressive logical reasoning or vertical thinking capabilities. But can they think out of the box? Do they possess proficient lateral thinking abilities? Following…

Computation and Language · Computer Science 2024-03-19 Shulin Huang , Shirong Ma , Yinghui Li , Mengzuo Huang , Wuhe Zou , Weidong Zhang , Hai-Tao Zheng

Large language models (LLMs) are increasingly deployed as conversational assistants in open-domain, multi-turn settings, where users often provide incomplete or ambiguous information. However, existing LLM-focused clarification benchmarks…

Computation and Language · Computer Science 2025-12-25 Sichun Luo , Yi Huang , Mukai Li , Shichang Meng , Fengyuan Liu , Zefa Hu , Junlan Feng , Qi Liu

Multi-agents has exhibited significant intelligence in real-word simulations with Large language models (LLMs) due to the capabilities of social cognition and knowledge retrieval. However, existing research on agents equipped with effective…

Artificial Intelligence · Computer Science 2025-04-23 Yajie Yu , Yue Feng

Interacting with human via high-quality multi-turn dialogues is a key feature of large language models (LLMs). However, human-based evaluation of such capability involves intensive manual labor. This report provides a preliminary evaluation…

Computation and Language · Computer Science 2023-10-23 Haodong Duan , Jueqi Wei , Chonghua Wang , Hongwei Liu , Yixiao Fang , Songyang Zhang , Dahua Lin , Kai Chen

Eliciting cooperation in multi-agent LLM systems is critical for AI alignment. We investigate two approaches: direct communication and curriculum learning. In a 4-player Stag Hunt, a one-word "cheap talk" channel increases cooperation from…

Machine Learning · Computer Science 2026-03-12 Hachem Madmoun , Salem Lahlou

Machines driven by large language models (LLMs) have the potential to augment humans across various tasks, a development with profound implications for business settings where effective communication, collaboration, and stakeholder trust…

Human-Computer Interaction · Computer Science 2025-07-28 Paweł Niszczota , Tomasz Grzegorczyk , Alexander Pastukhov

Large language models (LLMs) and LLM-based agents are increasingly deployed as assistants in planning and decision making, yet most existing systems are implicitly optimized for a single-principal interaction paradigm, in which the model is…

Computation and Language · Computer Science 2026-04-29 Shu Yang , Shenzhe Zhu , Hao Zhu , José Ramón Enríquez , Di Wang , Alex Pentland , Michiel A. Bakker , Jiaxin Pei

Large Language Models (LLMs) have demonstrated impressive capabilities as intelligent agents capable of solving complex problems. However, effective planning in scenarios involving dependencies between API or tool calls-particularly in…

Several recent works have found the emergence of grounded compositional language in the communication protocols developed by mostly cooperative multi-agent systems when learned end-to-end to maximize performance on a downstream task.…

Artificial Intelligence · Computer Science 2020-07-17 Paul Pu Liang , Jeffrey Chen , Ruslan Salakhutdinov , Louis-Philippe Morency , Satwik Kottur

Large Language Models (\textbf{LLMs}), e.g. ChatGPT, have been widely adopted in real-world dialogue applications. However, LLMs' robustness, especially in handling long complex dialogue sessions, including frequent motivation transfer,…

Computation and Language · Computer Science 2025-09-16 Chenghao Yang , Yinbo Luo , Zhoufutu Wen , Qi Chu , Tao Gong , Longxiang Liu , Kaiyuan Zhang , Jianpeng Jiao , Ge Zhang , Wenhao Huang , Nenghai Yu

With an evergrowing number of LLMs reporting superlative performance for English, their ability to perform equitably for different dialects of English ($\textit{i.e.}$, dialect robustness) needs to be ascertained. Specifically, we use…

Computation and Language · Computer Science 2024-12-13 Dipankar Srirag , Nihar Ranjan Sahoo , Aditya Joshi

Large Language Model (LLM) agents are increasingly utilized in AI-aided education to support tutoring and learning. Effective communication strategies among LLM agents improve collaborative problem-solving efficiency and facilitate…

Communication stands as a potent mechanism to harmonize the behaviors of multiple agents. However, existing works primarily concentrate on broadcast communication, which not only lacks practicality, but also leads to information redundancy.…

Multiagent Systems · Computer Science 2024-01-23 Chuxiong Sun , Zehua Zang , Jiabao Li , Jiangmeng Li , Xiao Xu , Rui Wang , Changwen Zheng

Conversational search systems, such as Google Assistant and Microsoft Cortana, enable users to interact with search systems in multiple rounds through natural language dialogues. Evaluating such systems is very challenging given that any…

Information Retrieval · Computer Science 2021-04-29 Zeyang Liu , Ke Zhou , Max L. Wilson