English
Related papers

Related papers: Improving Multi-Agent Debate with Sparse Communica…

200 papers

Large Language Models (LLMs) have revolutionized Natural Language Processing but exhibit limitations, particularly in autonomously addressing novel challenges such as reasoning and problem-solving. Traditional techniques like…

Multiagent Systems · Computer Science 2024-01-03 Sumedh Rasal

Multi-party Conversational Agents (MPCAs) are systems designed to engage in dialogue with more than two participants simultaneously. Unlike traditional two-party agents, designing MPCAs faces additional challenges due to the need to…

Computation and Language · Computer Science 2025-05-27 Sagar Sapkota , Mohammad Saqib Hasan , Mubarak Shah , Santu Karmaker

There is an growing interest in using Large Language Models (LLMs) in multi-agent systems to tackle interactive real-world tasks that require effective collaboration and assessing complex situations. Yet, we still have a limited…

Computation and Language · Computer Science 2024-06-11 Sahar Abdelnabi , Amr Gomaa , Sarath Sivaprasad , Lea Schönherr , Mario Fritz

Large language models (LLMs) often exhibit sycophancy: agreement with user stance even when it conflicts with the model's opinion. While prior work has mostly studied this in single-agent settings, it remains underexplored in collaborative…

Computation and Language · Computer Science 2026-04-06 Vira Kasprova , Amruta Parulekar , Abdulrahman AlRabah , Krishna Agaram , Ritwik Garg , Sagar Jha , Nimet Beyza Bozdag , Dilek Hakkani-Tur

Recent progress in large language model (LLM)-based multi-agent collaboration highlights the power of structured communication in enabling collective intelligence. However, existing methods largely rely on static or graph-based inter-agent…

Artificial Intelligence · Computer Science 2025-11-04 Song Wang , Zhen Tan , Zihan Chen , Shuang Zhou , Tianlong Chen , Jundong Li

Multi-agent debate system (MAD) imitating the process of human discussion in pursuit of truth, aims to align the correct cognition of different agents for the optimal solution. It is challenging to make various agents perform right and…

Computation and Language · Computer Science 2024-07-12 Haotian Wang , Xiyuan Du , Weijiang Yu , Qianglong Chen , Kun Zhu , Zheng Chu , Lian Yan , Yi Guan

Individuals, despite having varied life experiences and learning processes, can communicate effectively through languages. This study aims to explore the efficiency of language as a communication medium. We put forth two specific…

Machine Learning · Computer Science 2024-10-21 Hang Chen , Yuchuan Jang , Weijie Zhou , Cristian Meo , Ziwei Chen , Dianbo Liu

Large language models are increasingly deployed as multi-agent systems, where specialized roles communicate and collaborate through structured interactions to solve complex tasks that often exceed the capacity of a single agent. However,…

Computation and Language · Computer Science 2026-01-28 Yimeng Wang , Jiaxing Zhao , Hongbin Xie , Hexing Ma , Yuzhen Lei , Shuangxue Liu , Xuan Song , Zichen Zhang , Haoran Zhang

Large Language Models (LLMs) demonstrate strong performance but often lack interpretable reasoning. This paper introduces the Multi-Agent Collaboration Framework for Diverse Thinking Modes (DiMo), which enhances both performance and…

Computation and Language · Computer Science 2025-10-21 Zhixuan He , Yue Feng

Large Language Models (LLMs) have enabled collaborative Multi-Agent (MA) systems, where interacting agents improve performance through diverse reasoning and iterative refinement. However, these systems remain vulnerable to error…

Multiagent Systems · Computer Science 2026-05-21 Yong Jin Chun , Iftekhar Ahmed

Recent advancements in large language model (LLM)-powered agents have shown that collective intelligence can significantly outperform individual capabilities, largely attributed to the meticulously designed inter-agent communication…

Multiagent Systems · Computer Science 2024-10-04 Guibin Zhang , Yanwei Yue , Zhixun Li , Sukwon Yun , Guancheng Wan , Kun Wang , Dawei Cheng , Jeffrey Xu Yu , Tianlong Chen

With advancements in reasoning capabilities, Large Language Models (LLMs) are increasingly employed for automated judgment tasks. While LLMs-as-Judges offer promise in automating evaluations, current approaches often rely on simplistic…

Artificial Intelligence · Computer Science 2025-10-15 Tianyu Hu , Zhen Tan , Song Wang , Huaizhi Qu , Tianlong Chen

Large language models (LLMs) are increasingly used to support creative tasks such as research idea generation. While recent work has shown that structured dialogues between LLMs can improve the novelty and feasibility of generated ideas,…

Computation and Language · Computer Science 2025-07-14 Keisuke Ueda , Wataru Hirota , Takuto Asakura , Takahiro Omi , Kosuke Takahashi , Kosuke Arima , Tatsuya Ishigaki

Large Language Models (LLMs) often exhibit pronounced context-dependent variability that undermines predictable multi-agent behavior in tasks requiring strategic thinking. Focusing on models that range from 7 to 9 billion parameters in size…

Multiagent Systems · Computer Science 2026-02-09 Nunzio Lore , Babak Heydari

Large Language Models (LLMs) have advanced autonomous agents' planning and decision-making, yet they struggle with complex tasks requiring diverse expertise and multi-step reasoning. Multi-Agent Debate (MAD) systems, introduced in NLP…

Software Engineering · Computer Science 2025-03-18 Jina Chun , Qihong Chen , Jiawei Li , Iftekhar Ahmed

Unconstructive debate and uncivil communication carry well-documented costs for productivity and cohesion, yet isolating their effect on operational efficiency has proven difficult. Human subject research in this domain is constrained by…

Artificial Intelligence · Computer Science 2026-05-13 Alison Moldovan-Mauer , Benedikt Mangold

Multi-agent debate - multiple instances of large language models discussing problems in turn-based interaction - has shown promise for solving knowledge and reasoning tasks. However, these methods show limitations when solving complex…

Computation and Language · Computer Science 2026-04-10 Jonas Becker , Lars Benedikt Kaesberg , Andreas Stephan , Jan Philip Wahle , Terry Ruas , Bela Gipp

Multi-agent systems - systems with multiple independent AI agents working together to achieve a common goal - are becoming increasingly prevalent in daily life. Drawing inspiration from the phenomenon of human group social influence, we…

Artificial Intelligence · Computer Science 2025-09-25 Tianqi Song , Yugin Tan , Zicheng Zhu , Yibin Feng , Yi-Chieh Lee

Multi-agent techniques such as role playing or multi-turn debates have been shown to be effective in improving the performance of large language models (LLMs) in downstream tasks. Despite their differences in workflows, existing multi-agent…

Computation and Language · Computer Science 2025-09-25 Yichen Tang , Weihang Su , Yujia Zhou , Yiqun Liu , Min Zhang , Shaoping Ma , Qingyao Ai

Natural language has long enabled human cooperation, but its lossy, ambiguous, and indirect nature limits the potential of collective intelligence. While machines are not subject to these constraints, most LLM-based multi-agent systems…

Machine Learning · Computer Science 2025-10-24 Yujia Zheng , Zhuokai Zhao , Zijian Li , Yaqi Xie , Mingze Gao , Lizhu Zhang , Kun Zhang