English
Related papers

Related papers: Learning to Break: Knowledge-Enhanced Reasoning in…

200 papers

Large language models (LLMs) have demonstrated remarkable capabilities across various natural language processing (NLP) scenarios, but they still face challenges when handling complex arithmetic and logical reasoning tasks. While…

Computation and Language · Computer Science 2025-04-11 Yuting Zeng , Weizhe Huang , Lei Jiang , Tongxuan Liu , Xitai Jin , Chen Tianying Tiana , Jing Li , Xiaohua Xu

Multi-Agent Debate (MAD) has emerged as a promising inference scaling method for Large Language Model (LLM) reasoning. However, it frequently suffers from belief entrenchment, where agents reinforce shared errors rather than correcting…

Machine Learning · Computer Science 2026-02-12 Jihwan Oh , Minchan Jeong , Jongwoo Ko , Se-Young Yun

In recent years, Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse NLP tasks. Extensive research has explored how to enhance the logical reasoning abilities such as Chain-of-Thought, Chain-of-Thought with…

Computation and Language · Computer Science 2025-12-29 Tongxuan Liu , Xingyu Wang , Weizhe Huang , Wenjiang Xu , Yuting Zeng , Lei Jiang , Hailong Yang , Jing Li

Accurate detection of errors in large language models (LLM) responses is central to the success of scalable oversight, or providing effective supervision to superhuman intelligence. Yet, self-diagnosis is often unreliable on complex tasks…

Machine Learning · Computer Science 2025-10-27 Yongqiang Chen , Gang Niu , James Cheng , Bo Han , Masashi Sugiyama

Multi-agent debate (MAD) aims to improve large language model (LLM) reasoning by letting multiple agents exchange answers and then aggregate their opinions. Yet recent studies reveal that agents are not neutral: they are prone to…

Artificial Intelligence · Computer Science 2026-04-13 Hyeong Kyu Choi , Xiaojin Zhu , Sharon Li

Context: Large Language Model (LLM) agents are becoming widely used for various Requirements Engineering (RE) tasks. Research on improving their accuracy mainly focuses on prompt engineering, model fine-tuning, and retrieval augmented…

Software Engineering · Computer Science 2025-11-20 Marc Oriol , Quim Motger , Jordi Marco , Xavier Franch

Generative Large Language Models (LLMs) have demonstrated remarkable performance across a wide range of tasks. Recent research has introduced Multi-Agent Debate (MAD) systems, which leverage multiple LLMs to simulate human debate and…

Computation and Language · Computer Science 2025-09-18 Zijie Lin , Bryan Hooi

Multi-Agent Debate (MAD) is a collaborative framework in which multiple agents iteratively refine solutions through the generation of reasoning and alternating critique cycles. Current work primarily optimizes intra-round topologies and…

Multiagent Systems · Computer Science 2026-04-14 Yiqing Liu , Hantao Yao , Wu Liu , Allen He , Yongdong Zhang

Large language models (LLMs) excel in natural language generation but often confidently produce incorrect responses, especially in tasks like mathematical reasoning. Chain-of-thought prompting, self-verification, and multi-agent debate are…

Computation and Language · Computer Science 2026-03-30 Mahmood Hegazy

Large Language Models (LLMs) have shown remarkable reasoning capabilities in mathematical and scientific tasks. To enhance complex reasoning, multi-agent systems have been proposed to harness the collective intelligence of LLM agents.…

Artificial Intelligence · Computer Science 2025-10-22 Zhenyu Bi , Meng Lu , Yang Li , Swastik Roy , Weijie Guan , Morteza Ziyadi , Xuan Wang

Recent studies on LLM agent scaling have highlighted the potential of Multi-Agent Debate (MAD) to enhance reasoning abilities. However, the critical aspect of role allocation strategies remains underexplored. In this study, we demonstrate…

Artificial Intelligence · Computer Science 2025-11-17 Qian Zhang , Yan Zheng , Jinyi Liu , Hebin Liang , Lanjun Wang

Tabular anomaly detection is often handled by single detectors or static ensembles, even though strong performance on tabular data typically comes from heterogeneous model families (e.g., tree ensembles, deep tabular networks, and tabular…

Machine Learning · Computer Science 2026-02-17 Pinqiao Wang , Sheng Li

Multi-Agent Debate~(MAD) has emerged as a promising paradigm for improving the performance of large language models through collaborative reasoning. Despite recent advances, the key factors driving MAD's effectiveness remain unclear. In…

Computation and Language · Computer Science 2025-10-24 Hyeong Kyu Choi , Xiaojin Zhu , Sharon Li

Large Language Models (LLMs) have demonstrated significant capabilities in understanding and generating human language, contributing to more natural interactions with complex systems. However, they face challenges such as ambiguity in user…

Computation and Language · Computer Science 2025-07-17 Ana Davila , Jacinto Colan , Yasuhisa Hasegawa

Multi-agent debate (MAD) has demonstrated the ability to augment collective intelligence by scaling test-time compute and leveraging expertise. Current frameworks for multi-agent debate are often designed towards tool use, lack integrated…

Multiagent Systems · Computer Science 2025-12-16 Jonas Becker , Lars Benedikt Kaesberg , Niklas Bauer , Jan Philip Wahle , Terry Ruas , Bela Gipp

Large Language Models (LLMs) need to adapt their predictions to diverse cultural contexts to benefit diverse communities across the world. While previous efforts have focused on single-LLM, single-turn approaches, we propose to exploit the…

Computation and Language · Computer Science 2025-09-03 Dayeon Ki , Rachel Rudinger , Tianyi Zhou , Marine Carpuat

While Multi-Agent Debate (MAD) research has advanced, its efficacy in coordinating complex stakeholder interests such as travel planning remains largely unexplored. To bridge this gap, we propose MIND (Multi-agent Inference for Negotiation…

Artificial Intelligence · Computer Science 2026-03-24 Hunmin Do , Taejun Yoon , Kiyong Jung

Multi-agent debate (MAD) has gained significant attention as a promising line of research to improve the factual accuracy and reasoning capabilities of large language models (LLMs). Despite its conceptual appeal, current MAD research…

Computation and Language · Computer Science 2025-06-24 Hangfan Zhang , Zhiyao Cui , Jianhao Chen , Xinrun Wang , Qiaosheng Zhang , Zhen Wang , Dinghao Wu , Shuyue Hu

Multi-agent debate (MAD) systems leverage collective intelligence to enhance reasoning capabilities, yet existing approaches struggle to simultaneously optimize accuracy, consensus formation, and computational efficiency. Static topology…

Artificial Intelligence · Computer Science 2026-03-02 Chao Wang , Han Lin , Huaze Tang , Huijing Lin , Wenbo Ding

Argument Mining (AM) is a foundational technology for automated writing evaluation, yet traditional supervised approaches rely heavily on expensive, domain-specific fine-tuning. While Large Language Models (LLMs) offer a training-free…

Computation and Language · Computer Science 2026-03-31 Jakub Bąba , Jarosław A. Chudziak