English
Related papers

Related papers: Representational Collapse in Multi-Agent LLM Commi…

200 papers

In this paper, we propose an algorithm for downlink (DL) channel covariance matrix (CCM) estimation for frequency division duplexing (FDD) massive multiple-input multiple-output (MIMO) communication systems with base station (BS) possessing…

Machine Learning · Computer Science 2025-09-23 Melih Can Zerin , Elif Vural , Ali Özgür Yılmaz

Diversity in training data, architecture, and providers is assumed to mitigate homogeneity in LLMs. However, we lack empirical evidence on whether different LLMs differ meaningfully. We conduct a large-scale empirical evaluation on over 350…

Computation and Language · Computer Science 2025-06-10 Elliot Kim , Avi Garg , Kenny Peng , Nikhil Garg

To improve the reasoning and question-answering capabilities of Large Language Models (LLMs), several multi-agent approaches have been introduced. While these methods enhance performance, the application of collective intelligence-based…

Artificial Intelligence · Computer Science 2024-07-10 Ciaran Regan , Alexandre Gournail , Mizuki Oka

Multi-agent LLM systems usually collaborate by exchanging natural-language messages. This interface is simple and interpretable, but it forces each sender's intermediate computation to be serialized into tokens and then reprocessed by the…

Computation and Language · Computer Science 2026-05-14 Wenrui Bao , Huan Wang , Jian Wang , Zhangyang Wang , Kai Wang , Yuzhang Shang

Emergent communication enables partially observant Autonomous Mobile Robots (AMRs) to coordinate effectively in decentralized multi-agent reinforcement learning (MARL) settings. However, existing approaches often struggle with unstable…

Robotics · Computer Science 2026-05-28 Mahmoud Abouelyazid , Eman Hammad

Linear probes trained on LLM activations are increasingly proposed as deception-detection metrics, yet report AUROC exceeding 0.96 on clean benchmarks while collapsing under distributional shift. This paper systematically pressure-tests…

Computation and Language · Computer Science 2026-05-28 Sachin Kumar

Large language model multi-agent systems (LLM-MAS) offer a promising paradigm for harnessing collective intelligence to achieve more advanced forms of AI behaviour. While recent studies suggest that LLM-MAS can outperform LLM single-agent…

Artificial Intelligence · Computer Science 2025-10-07 Bohan Tang , Huidong Liang , Keyue Jiang , Xiaowen Dong

Recent advancements in Large Language Models (LLMs) have generated growing interest in their structured reasoning capabilities, particularly in tasks involving abstraction and pattern recognition. The Abstraction and Reasoning Corpus (ARC)…

Artificial Intelligence · Computer Science 2025-04-25 Nikhil Khandalkar , Pavan Yadav , Krishna Shinde , Lokesh B. Ramegowda , Rajarshi Das

Large language model (LLM) agents are increasingly expected to operate in enterprise environments, where work is distributed across specialized roles, permission-controlled systems, and cross-departmental procedures. However, existing…

Contrastive methods have led a recent surge in the performance of self-supervised representation learning (SSL). Recent methods like BYOL or SimSiam purportedly distill these contrastive methods down to their essence, removing bells and…

Machine Learning · Computer Science 2022-11-03 Alexander C. Li , Alexei A. Efros , Deepak Pathak

We study multi-agent reinforcement learning (MARL) for the general-sum Markov Games (MGs) under the general function approximation. In order to find the minimum assumption for sample-efficient learning, we introduce a novel complexity…

Machine Learning · Computer Science 2023-10-11 Nuoya Xiong , Zhihan Liu , Zhaoran Wang , Zhuoran Yang

Self-improvement, where models improve beyond their current performance without external supervision, remains a challenge. The core difficulty is sourcing a training signal stronger than what the model itself can currently produce. Majority…

Artificial Intelligence · Computer Science 2026-02-02 Ankur Samanta , Akshayaa Magesh , Runzhe Wu , Ayush Jain , Youliang Yu , Daniel Jiang , Boris Vidolov , Paul Sajda , Yonathan Efroni , Kaveh Hassani

Large Language Models (LLMs) demonstrate strong performance but often lack interpretable reasoning. This paper introduces the Multi-Agent Collaboration Framework for Diverse Thinking Modes (DiMo), which enhances both performance and…

Computation and Language · Computer Science 2025-10-21 Zhixuan He , Yue Feng

As large language models become components of larger agentic systems, evaluation reliability becomes critical: unreliable sub-agents introduce brittleness into downstream system behavior. Yet current evaluation practice, reporting a single…

Artificial Intelligence · Computer Science 2025-12-09 Zairah Mustahsan , Abel Lim , Megna Anand , Saahil Jain , Bryan McCann

Large Language Models (LLMs) have shown remarkable capabilities as autonomous agents, yet existing benchmarks either focus on single-agent tasks or are confined to narrow domains, failing to capture the dynamics of multi-agent coordination…

Multiagent Systems · Computer Science 2025-03-05 Kunlun Zhu , Hongyi Du , Zhaochen Hong , Xiaocheng Yang , Shuyi Guo , Zhe Wang , Zhenhailong Wang , Cheng Qian , Xiangru Tang , Heng Ji , Jiaxuan You

Motivated by the needs of resiliency, scalability, and plug-and-play operation, distributed decision-making is becoming increasingly prevalent. The problem of achieving consensus in a multi-agent system is at the core of distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-21 Vivek Khatana , Murti V. Salapaka

Large language models (LLMs) achieve remarkable performance through ever-increasing parameter counts, but scaling incurs steep computational costs. To better understand LLM scaling, we study representational differences between LLMs and…

As Large Language Models (LLMs) get integrated into diverse workflows, they are increasingly being regarded as "collaborators" with humans, and required to work in coordination with other AI systems. If such AI collaborators are to reliably…

Computation and Language · Computer Science 2026-01-23 Abhijnan Nath , Carine Graff , Nikhil Krishnaswamy

Effectively leveraging diversity has been shown to improve performance for various machine learning models, including large language models (LLMs). However, determining the most effective way of using diversity remains a challenge. In this…

Computation and Language · Computer Science 2026-05-21 Rafael Rosales , Santiago Miret

With the recent advancements in reasoning capabilities, tool calling using MCP servers and Audio Language Models (ALMs), development and integration of multi-modal agents (with voice and text support) has come to the industry forefront.…

Sound · Computer Science 2026-03-03 Anupam Purwar , Aditya Choudhary