English
Related papers

Related papers: Multi-Agent Debate for LLM Judges with Adaptive St…

200 papers

The rapid proliferation of recent Multi-Agent Systems (MAS), where Large Language Models (LLMs) and Large Reasoning Models (LRMs) usually collaborate to solve complex problems, necessitates a deep understanding of the persuasion dynamics…

Artificial Intelligence · Computer Science 2025-09-26 Haodong Zhao , Jidong Li , Zhaomin Wu , Tianjie Ju , Zhuosheng Zhang , Bingsheng He , Gongshen Liu

Multi-agent LLM debate improves factuality and reasoning, but most recipes pick a fixed round count, over-spending on easy items and under-spending on hard ones. We adapt Wald's Sequential Probability Ratio Test (SPRT) as a plug-in compute…

Machine Learning · Computer Science 2026-05-20 Andrea Morandi

Multi-agent systems often operate under feedback, adaptation, and non-stationarity, yet many simulation studies retain static decision rules and fixed control parameters. This paper introduces a general adaptive multi-agent learning…

Multiagent Systems · Computer Science 2025-11-26 Roberto Garrone

The reasoning capabilities of LLM (Large Language Model) are widely acknowledged in recent research, inspiring studies on tool learning and autonomous agents. LLM serves as the "brain" of the agent, orchestrating multiple tools for…

Machine Learning · Computer Science 2024-03-26 Xiangyan Liu , Rongxue Li , Wei Ji , Tao Lin

Compound AI systems that combine multiple LLM calls, such as self-refine and multi-agent-debate, achieve strong performance on many AI tasks. We address a core question in optimizing compound systems: for each LLM call or module in the…

Artificial Intelligence · Computer Science 2025-02-21 Lingjiao Chen , Jared Quincy Davis , Boris Hanin , Peter Bailis , Matei Zaharia , James Zou , Ion Stoica

Flocking is a behavior where multiple agents in a system attempt to stay close to each other while avoiding collision and maintaining a desired formation. This is observed in the natural world and has applications in robotics, including…

Artificial Intelligence · Computer Science 2024-12-18 Peihan Li , Vishnu Menon , Bhavanaraj Gudiguntla , Daniel Ting , Lifeng Zhou

The paradigm of using Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) as evaluative judges has emerged as an effective approach in RLHF and inference-time scaling. In this work, we propose Multimodal Reasoner as a…

Computation and Language · Computer Science 2025-05-20 Renjie Pi , Felix Bai , Qibin Chen , Simon Wang , Jiulong Shan , Kieran Liu , Meng Cao

Background: Cognitive biases in clinical decision-making significantly contribute to errors in diagnosis and suboptimal patient outcomes. Addressing these biases presents a formidable challenge in the medical field. Objective: This study…

Computation and Language · Computer Science 2024-05-14 Yu He Ke , Rui Yang , Sui An Lie , Taylor Xin Yi Lim , Hairil Rizal Abdullah , Daniel Shu Wei Ting , Nan Liu

Multi-agent systems have evolved into practical LLM-driven collaborators for many applications, gaining robustness from diversity and cross-checking. However, multi-agent RL (MARL) training is resource-intensive and unstable: co-adapting…

Modern large language models (LLMs) have exhibited cooperative synergy on complex task-solving, and collective decision-making (CDM) is a pivotal component in LLM-based multi-agent collaboration frameworks. Our survey on 52 recent such…

Computation and Language · Computer Science 2024-10-22 Xiutian Zhao , Ke Wang , Wei Peng

Visual geo-localization requires extensive geographic knowledge and sophisticated reasoning to determine image locations without GPS metadata. Traditional retrieval methods are constrained by database coverage and quality. Recent Large…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Heng Zheng , Yuling Shi , Xiaodong Gu , Haochen You , Zijian Zhang , Lubin Gan , Hao Zhang , Wenjun Huang , Jin Huang

As large language models (LLMs) transition from static tools to fully agentic systems, their potential for transforming social science research has become increasingly evident. This paper introduces a structured framework for understanding…

Multiagent Systems · Computer Science 2026-05-19 Jennifer Haase , Sebastian Pokutta

Large Language Models (LLMs) have made significant progress in various fields. However, challenges remain in Multi-Disciplinary Team (MDT) medical consultations. Current research enhances reasoning through role assignment, task…

Artificial Intelligence · Computer Science 2025-03-19 Kai Chen , Xinfeng Li , Tianpei Yang , Hewei Wang , Wei Dong , Yang Gao

We present AutoBench, a fully automated and self-sustaining framework for evaluating Large Language Models (LLMs) through reciprocal peer assessment. This paper provides a rigorous scientific validation of the AutoBench methodology,…

Computation and Language · Computer Science 2025-10-28 Dario Loi , Elena Maria Muià , Federico Siciliano , Giovanni Trappolini , Vincenzo Crisà , Peter Kruger , Fabrizio Silvestri

Recent progress at the intersection of large language models (LLMs) and time series (TS) analysis has revealed both promise and fragility. While LLMs can reason over temporal structure given carefully engineered context, they often struggle…

Artificial Intelligence · Computer Science 2026-01-28 Patara Trirat , Jin Myung Kwak , Jay Heo , Heejun Lee , Sung Ju Hwang

Multi-persona debate systems powered by large language models (LLMs) show promise in reducing confirmation bias, which can fuel echo chambers and social polarization. However, empirical evidence remains limited on whether they meaningfully…

Human-Computer Interaction · Computer Science 2025-09-17 Li Shi , Houjiang Liu , Yian Wong , Utkarsh Mujumdar , Dan Zhang , Jacek Gwizdka , Matthew Lease

As Large Language Models (LLMs) are increasingly deployed as task-oriented agents in enterprise environments, ensuring their strict adherence to complex, domain-specific operational guidelines is critical. While utilizing an LLM-as-a-Judge…

Computation and Language · Computer Science 2026-04-15 Jingbo Yang , Guanyu Yao , Bairu Hou , Xinghan Yang , Nikolai Glushnev , Iwona Bialynicka-Birula , Duo Ding , Shiyu Chang

We introduce two models of consensus following a majority rule on time-evolving stochastic block models (SBM), in which the network evolution is Markovian or non-Markovian. Under the majority rule, in each round, each agent simultaneously…

Probability · Mathematics 2022-09-12 Haoyu Wang , Jiaheng Wei , Zhenyuan Zhang

Large Language Models (LLMs) have demonstrated remarkable success in conversational systems by generating human-like responses. However, they can fall short, especially when required to account for personalization or specific knowledge. In…

Computation and Language · Computer Science 2025-11-12 Soyeong Jeong , Aparna Elangovan , Emine Yilmaz , Oleg Rokhlenko

The integration of Large Language Models (LLMs) into multiagent systems has opened new possibilities for collaborative reasoning and cooperation with AI agents. This paper explores different prompting methods and evaluates their…