English
Related papers

Related papers: Revisiting Multi-Agent Debate as Test-Time Scaling…

200 papers

In recent years, Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse NLP tasks. Extensive research has explored how to enhance the logical reasoning abilities such as Chain-of-Thought, Chain-of-Thought with…

Computation and Language · Computer Science 2025-12-29 Tongxuan Liu , Xingyu Wang , Weizhe Huang , Wenjiang Xu , Yuting Zeng , Lei Jiang , Hailong Yang , Jing Li

Multi-agent systems (MAS) built on large language models (LLMs) offer a promising path toward solving complex, real-world tasks that single-agent systems often struggle to manage. While recent advancements in test-time scaling (TTS) have…

Artificial Intelligence · Computer Science 2025-08-20 Can Jin , Hongwu Peng , Qixin Zhang , Yujin Tang , Dimitris N. Metaxas , Tong Che

Large Language Models (LLMs) trained with reinforcement learning and verifiable rewards have achieved strong results on complex reasoning tasks. Recent work extends this paradigm to a multi-agent setting, where a meta-thinking agent…

Artificial Intelligence · Computer Science 2025-11-05 Zhiwei Zhang , Xiaomin Li , Yudi Lin , Hui Liu , Ramraj Chandradevan , Linlin Wu , Minhua Lin , Fali Wang , Xianfeng Tang , Qi He , Suhang Wang

As AI agents evolve, the community is rapidly shifting from single Large Language Models (LLMs) to Multi-Agent Systems (MAS) to overcome cognitive bottlenecks in automated research. However, the optimal multi-agent coordination framework…

Multiagent Systems · Computer Science 2026-05-12 Yang Shen , Zhenyi Yi , Ziyi Zhao , Lijun Sun , Dongyang Li , Chin-Teng Lin , Yuhui Shi

Recent large language models (LLMs) are trained on diverse corpora and tasks, leading them to develop complementary strengths. Multi-agent debate (MAD) has emerged as a popular way to leverage these strengths for robust reasoning, though it…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Anoop Cherian , River Doyle , Eyal Ben-Dov , Suhas Lohit , Kuan-Chuan Peng

In recent years, large language models have shown exceptional performance in fulfilling diverse human needs. However, their training data can introduce harmful content, underscoring the necessity for robust value alignment. Mainstream…

Artificial Intelligence · Computer Science 2024-12-19 Rui Zou , Mengqi Wei , Jintian Feng , Qian Wan , Jianwen Sun , Sannyuya Liu

Multi-Agent Debate (MAD) is a collaborative framework in which multiple agents iteratively refine solutions through the generation of reasoning and alternating critique cycles. Current work primarily optimizes intra-round topologies and…

Multiagent Systems · Computer Science 2026-04-14 Yiqing Liu , Hantao Yao , Wu Liu , Allen He , Yongdong Zhang

Multi-agent collaboration among models has shown promise in reasoning tasks but is underexplored in long-form generation tasks like summarization and question-answering. We extend multi-agent multi-model reasoning to generation,…

Computation and Language · Computer Science 2025-03-20 David Wan , Justin Chih-Yao Chen , Elias Stengel-Eskin , Mohit Bansal

Fact-checking research has extensively explored verification but less so the generation of natural-language explanations, crucial for user trust. While Large Language Models (LLMs) excel in text generation, their capability for producing…

Computation and Language · Computer Science 2024-02-13 Kyungha Kim , Sangyun Lee , Kung-Hsiang Huang , Hou Pong Chan , Manling Li , Heng Ji

The reasoning abilities of large language models (LLMs) have been substantially improved by reinforcement learning with verifiable rewards (RLVR). At test time, collaborative reasoning through Multi-Agent Debate (MAD) has emerged as a…

Computation and Language · Computer Science 2026-05-19 Chenxi Liu , Yanshuo Chen , Ruibo Chen , Tianyi Xiong , Tong Zheng , Heng Huang

Tabular anomaly detection is often handled by single detectors or static ensembles, even though strong performance on tabular data typically comes from heterogeneous model families (e.g., tree ensembles, deep tabular networks, and tabular…

Machine Learning · Computer Science 2026-02-17 Pinqiao Wang , Sheng Li

While state-of-the-art language models have achieved impressive results, they remain susceptible to inference-time adversarial attacks, such as adversarial prompts generated by red teams arXiv:2209.07858. One approach proposed to improve…

Computation and Language · Computer Science 2024-01-12 Steffi Chern , Zhen Fan , Andy Liu

Large language models (LLMs) have demonstrated remarkable capabilities in language generation, understanding, and few-shot learning in recent years. An extensive body of work has explored how their performance may be further improved…

Computation and Language · Computer Science 2023-05-24 Yilun Du , Shuang Li , Antonio Torralba , Joshua B. Tenenbaum , Igor Mordatch

Large Language Models (LLMs) have shown remarkable capabilities in general natural language processing tasks but often fall short in complex reasoning tasks. Recent studies have explored human-like problem-solving strategies, such as…

Computation and Language · Computer Science 2023-12-19 Zhenran Xu , Senbao Shi , Baotian Hu , Jindi Yu , Dongfang Li , Min Zhang , Yuxiang Wu

Nowadays, single Large Language Model (LLM) struggles with critical issues such as hallucination and inadequate reasoning abilities. To mitigate these issues, Multi-Agent Debate (MAD) has emerged as an effective strategy, where LLM agents…

Artificial Intelligence · Computer Science 2025-07-08 Yiliu Sun , Zicheng Zhao , Sheng Wan , Chen Gong

Large language models (LLMs) have achieved remarkable performance in recent years but are fundamentally limited by the underlying training data. To improve models beyond the training data, recent works have explored how LLMs can be used to…

Computation and Language · Computer Science 2025-03-04 Vighnesh Subramaniam , Yilun Du , Joshua B. Tenenbaum , Antonio Torralba , Shuang Li , Igor Mordatch

Large Language Models (LLMs) have exhibited remarkable capabilities in many complex tasks including mathematical reasoning. However, traditional approaches heavily rely on ensuring self-consistency within single prompting method, which…

Computation and Language · Computer Science 2024-10-15 Gisang Lee , Sangwoo Park , Junyoung Park , Andrew Chung , Sieun Park , Yoonah Park , Byungju Kim , Min-gyu Cho

Multi-agent systems (MAS) extend large language models (LLMs) from independent single-model reasoning to coordinative system-level intelligence. While existing LLM agents depend on text-based mediation for reasoning and communication, we…

Computation and Language · Computer Science 2025-12-09 Jiaru Zou , Xiyuan Yang , Ruizhong Qiu , Gaotang Li , Katherine Tieu , Pan Lu , Ke Shen , Hanghang Tong , Yejin Choi , Jingrui He , James Zou , Mengdi Wang , Ling Yang

Scaling test time compute has shown remarkable success in improving the reasoning abilities of large language models (LLMs). In this work, we conduct the first systematic exploration of applying test-time scaling methods to language agents…

This article explores the dynamic influence of computational entities based on multi-agent systems theory (SMA) combined with large language models (LLM), which are characterized by their ability to simulate complex human interactions, as a…

Artificial Intelligence · Computer Science 2024-03-18 Carlos Jose Xavier Cruz