English
Related papers

Related papers: When Agents Disagree: The Selection Bottleneck in …

200 papers

Multi-Agent Systems (MAS) with Large Language Model (LLM)-powered agents are gaining attention, yet fewer studies explore their team dynamics. Inspired by human team science, we propose a multi-agent framework to examine core aspects of…

Computation and Language · Computer Science 2025-10-13 Rasika Muralidharan , Haewoon Kwak , Jisun An

Multi-agent systems where Large Language Models (LLMs) deliberate to form consensus have gained significant attention, yet their practical value over simpler methods remains under-scrutinized. We introduce DELIBERATIONBENCH, a controlled…

Computation and Language · Computer Science 2026-01-15 Vaarunay Kaushal , Taranveer Singh

In this paper, we introduce a high-level controller synthesis framework that enables teams of heterogeneous agents to assist each other in resolving environmental conflicts that appear at runtime. This conflict resolution method is built…

Robotics · Computer Science 2022-09-02 Michael Enqi Cao , Jonas Warnke , Yunhai Han , Xinpei Ni , Ye Zhao , Samuel Coogan

Topology optimization can generate efficient structures, but designers often must manually translate qualitative intent, such as desired visual style, product experience, or manufacturability into solver settings that are not directly tied…

Artificial Intelligence · Computer Science 2026-05-22 Isabella A. Stewart , Hongrui Chen , Faez Ahmed

Supply networks require collaboration in a competitive environment. To achieve this, nodes in the network often form symbiotic relationships as they can be adversely effected by the closure of companies in the network, especially where…

Multiagent Systems · Computer Science 2025-01-27 Wan Wang , Haiyan Wang , Adam J. Sobey

Producing high-quality code across multiple programming languages is increasingly important as today's software systems are built on heterogeneous stacks. Large language models (LLMs) have advanced the state of automated programming, yet…

Recent Large Language Model (LLM)-based AutoML systems demonstrate impressive capabilities but face significant limitations such as constrained exploration strategies and a severe execution bottleneck. Exploration is hindered by one-shot…

Artificial Intelligence · Computer Science 2026-04-24 Stepan Kulibaba , Artem Dzhalilov , Roman Pakhomov , Oleg Svidchenko , Alexander Gasnikov , Aleksei Shpilman

Large language models applied to clinical prediction exhibit case-level heterogeneity: simple cases yield consistent outputs, while complex cases produce divergent predictions under minor prompt changes. Existing single-agent strategies…

Artificial Intelligence · Computer Science 2026-04-02 Yuxing Lu , Yushuhong Lin , Jason Zhang

Multi-AI collaboration, such as ensembling or debating large language models (LLMs), is a promising paradigm for aggregating information and boosting performance. A foundational step in these pipelines is to feed the responses of several…

Machine Learning · Computer Science 2026-05-26 Yichi Zhang , Kevin Lu , Yuang Zhang , Jie Gao , Lirong Xia , Fang-Yi Yu

In many real-world systems, such as adaptive robotics, achieving a single, optimised solution may be insufficient. Instead, a diverse set of high-performing solutions is often required to adapt to varying contexts and requirements. This is…

Machine Learning · Computer Science 2023-11-06 Garðar Ingvarsson , Mikayel Samvelyan , Bryan Lim , Manon Flageat , Antoine Cully , Tim Rocktäschel

We consider multi-agent systems where agents' preferences are aggregated via sequential majority voting: each decision is taken by performing a sequence of pairwise comparisons where each comparison is a weighted majority vote among the…

Artificial Intelligence · Computer Science 2012-04-18 Maria Pini , Francesca Rossi , Brent Venable , Toby Walsh

Emerging AI systems in behavioral health and psychiatry use multi-step or multi-agent LLM pipelines for tasks like assessing self-harm risk and screening for depression. However, common evaluation approaches, like LLM-as-a-judge, do not…

Machine Learning · Computer Science 2026-04-27 Meghana Karnam , Ananya Joshi

Multi-agent systems (MAS) are increasingly used for open-ended idea generation, driven by the expectation that collective interaction will broaden the exploration diversity. However, when and why such collaboration truly expands the…

Multiagent Systems · Computer Science 2026-04-22 Nuo Chen , Yicheng Tong , Yuzhe Yang , Yufei He , Xueyi Zhang , Qingyun Zou , Qian Wang , Bingsheng He

Model ensemble is a useful approach in reinforcement learning (RL) for training effective agents. Despite wide success of RL, training effective agents remains difficult due to the multitude of factors requiring careful tuning, such as…

Machine Learning · Computer Science 2025-05-22 Yiwen Song , Qianyue Hao , Qingmin Liao , Jian Yuan , Yong Li

We present ActuBench, a multi-agent LLM pipeline for the automated generation and evaluation of advanced actuarial assessment items aligned with the International Actuarial Association (IAA) Education Syllabus. The pipeline separates four…

Artificial Intelligence · Computer Science 2026-04-23 Jan-Philipp Schmidt

LLMs generate buggy code: 29.6% of SWE-bench solved patches fail, 62% of BaxBench solutions have vulnerabilities, and existing tools only catch 65% of bugs with 35% false positives. We built CodeX-Verify, a multi-agent system that uses four…

Software Engineering · Computer Science 2025-12-05 Shreshth Rajan

Recent studies show that LLMs possess different skills and specialize in different tasks. In fact, we observe that their varied performance occur in several levels of granularity. For example, in the code optimization task, code LLMs excel…

Artificial Intelligence · Computer Science 2025-10-24 Yuanzhe Liu , Ryan Deng , Tim Kaler , Xuhao Chen , Charles E. Leiserson , Yao Ma , Jie Chen

Multi-agent LLM committees replicate the same model under different role prompts and aggregate outputs by majority vote, implicitly assuming that agents contribute complementary evidence. We embed each agent's chain-of-thought rationale and…

Machine Learning · Computer Science 2026-04-07 Dipkumar Patel

Mixture-of-Agents (MoA) inference can suffer from dense inter-agent communication and low hardware utilization, which jointly inflate serving latency. We present a serving design that targets these bottlenecks through an algorithm-system…

Artificial Intelligence · Computer Science 2025-12-23 Zijun Wang , Yijiahao Qi , Hanqiu Chen , Zishen Wan , Gongjin Sun , Dongyang Li , Shuyi Pei , Cong Hao

While AI agents show potential in scientific ideation, most existing frameworks rely on single-agent refinement, limiting creativity due to bounded knowledge and perspective. Inspired by real-world research dynamics, this paper investigates…

Computation and Language · Computer Science 2025-08-07 Nuo Chen , Yicheng Tong , Jiaying Wu , Minh Duc Duong , Qian Wang , Qingyun Zou , Bryan Hooi , Bingsheng He