English
Related papers

Related papers: Representational Collapse in Multi-Agent LLM Commi…

200 papers

Large Language Models are increasingly proposed as cognitive components for robotic systems, yet their opaque decision processes make it difficult to explain success or failure in closed-loop embodied tasks. Following an empirical AI…

Artificial Intelligence · Computer Science 2026-05-20 Oussama Zenkri , Oliver Brock

Assessing the performance of systems to classify Multi-Party Conversations (MPC) is challenging due to the interconnection between linguistic and structural characteristics of conversations. Conventional evaluation methods often overlook…

Computation and Language · Computer Science 2026-03-30 Nicolò Penzo , Maryam Sajedinia , Bruno Lepri , Sara Tonelli , Marco Guerini

LLM agent systems are built by stacking scaffolding components (planning, tools, memory, self-reflection, retrieval) assuming more is better. We study cross-component interference (CCI): degradation when components interact destructively.…

Artificial Intelligence · Computer Science 2026-05-08 Ming Liu

LLMs enable qualitative coding at large scale, but assessing reliability remains challenging where human experts seldom agree. We investigate confidence-diversity calibration as a quality assessment framework for accessible coding tasks…

Machine Learning · Computer Science 2025-08-19 Zhilong Zhao , Yindi Liu

Large Language Models (LLMs) enable new possibilities for qualitative research at scale, including annotation and qualitative coding of educational data. While LLM-based multi-agent systems (MAS) can emulate human coding workflows, their…

Computation and Language · Computer Science 2026-05-12 Conrad Borchers , Bahar Shahrokhian , Francesco Balzan , Elham Tajik , Sreecharan Sankaranarayanan , Sebastian Simon

Cooperative multi-agent reinforcement learning (MARL) struggles with sample efficiency, interpretability, and generalization. While Large Language Models (LLMs) offer powerful planning capabilities, their application has been hampered by a…

Artificial Intelligence · Computer Science 2026-05-06 Zhiyuan Li , Wenshuai Zhao , Joni Pajarinen

Recent work shows that pricing with symmetric LLM agents leads to algorithmic collusion. We show that collusion is fragile under the heterogeneity typical of real deployments. In a stylized repeated-pricing model, heterogeneity in patience…

Computer Science and Game Theory · Computer Science 2026-03-24 Jussi Keppo , Yuze Li , Gerry Tsoukalas , Nuo Yuan

Multi-stage LLM pipelines that perform multi-agent debate, intrinsic self-correction, or retrieval-augmented verification exhibit puzzling aggregate behaviors: accuracy plateaus and reversals across rounds, non-replication of debate gains…

Multiagent Systems · Computer Science 2026-05-28 Prashanti Nilayam , Kiran Ramanna , Prashil Tumbade

Large Language Models demonstrate remarkable capabilities yet remain fundamentally probabilistic, presenting critical reliability challenges for enterprise deployment. We introduce the Six Sigma Agent, a novel architecture that achieves…

Artificial Intelligence · Computer Science 2026-02-02 Khush Patel , Siva Surendira , Jithin George , Shreyas Kapale

Multi-agent LLM pipelines produce contradictory evidence on whether team diversity improves output quality: heterogeneous Mixture-of-Agents teams outperform single models, yet homogeneous Self-MoA teams consistently win under…

Multiagent Systems · Computer Science 2026-03-24 Artem Maryanskyy

Although behavioral studies have documented numerical reasoning errors in large language models (LLMs), the underlying representational mechanisms remain unclear. We hypothesize that numerical attributes occupy shared latent subspaces and…

Artificial Intelligence · Computer Science 2025-11-11 Hirohane Takagi , Gouki Minegishi , Shota Kizawa , Issey Sukeda , Hitomi Yanaka

Run the same LLM agent on the same task twice: do you get the same behavior? We find the answer is often no. In a study of 3,000 agent runs across three models (Llama 3.1 70B, GPT-4o, and Claude Sonnet 4.5) on HotpotQA, we observe that…

Artificial Intelligence · Computer Science 2026-02-13 Aman Mehta

Large Language Models (LLMs) still struggle with natural language reasoning tasks. Motivated by the society of minds (Minsky, 1988), we propose ReConcile, a multi-model multi-agent framework designed as a round table conference among…

Computation and Language · Computer Science 2024-06-25 Justin Chih-Yao Chen , Swarnadeep Saha , Mohit Bansal

Instruction-tuned large language models produce helpful, structured responses, but how robust is this helpfulness under trivial constraints? We show that simple lexical constraints (banning a single punctuation character or common word)…

Computation and Language · Computer Science 2026-04-28 Erfan Baghaei Potraghloo , Seyedarmin Azizi , Souvik Kundu , Massoud Pedram

Applications based on large language models (LLMs), such as multi-agent simulations, require population diversity among agents. We identify a pervasive failure mode we term \emph{Persona Collapse}: agents each assigned a distinct profile…

Computation and Language · Computer Science 2026-04-28 Yunze Xiao , Vivienne J. Zhang , Chenghao Yang , Ningshan Ma , Weihao Xuan , Jen-tse Huang

Multi-agent deployments of large language models (LLMs) are increasingly embedded in market, allocation, and governance workflows, yet covert coordination among agents can silently erode trust and social welfare. Existing audits are…

Multiagent Systems · Computer Science 2025-10-21 Om Tailor

Cascaded LLM systems coordinate models of varying sizes with human experts to balance accuracy, cost, and abstention under uncertainty. However, single-model tiers at each stage often struggle with ambiguous queries, triggering premature…

Computation and Language · Computer Science 2026-04-15 Raeyoung Chang , Dongwook Kwon , Jisoo Lee , Nikhil Verma

Emerging AI systems in behavioral health and psychiatry use multi-step or multi-agent LLM pipelines for tasks like assessing self-harm risk and screening for depression. However, common evaluation approaches, like LLM-as-a-judge, do not…

Machine Learning · Computer Science 2026-04-27 Meghana Karnam , Ananya Joshi

Large language model (LLM) agents are increasingly acting as human delegates in multi-agent environments, where a representative agent integrates diverse peer perspectives to make a final decision. Drawing inspiration from social…

Computation and Language · Computer Science 2026-05-05 Changgeon Ko , Jisu Shin , Hoyun Song , Huije Lee , Eui Jun Hwang , Jong C. Park

Optimizing the communication structure of large language model based multi-agent systems (LLM-MAS) has been shown to improve downstream performance and reduce token usage. Existing methods typically rely on randomly sampled training tasks.…

Multiagent Systems · Computer Science 2026-05-11 Huchen Yang , Xinghao Dong , Dan Negrut , Jin-Long Wu