English
Related papers

Related papers: Weak-Link Optimization for Multi-Agent Reasoning a…

200 papers

Recent progress in LLMs discussion suggests that multi-agent discussion improves the reasoning abilities of LLMs. In this work, we reevaluate this claim through systematic experiments, where we propose a novel group discussion framework to…

Computation and Language · Computer Science 2024-02-29 Qineng Wang , Zihao Wang , Ying Su , Hanghang Tong , Yangqiu Song

We introduce a novel large language model (LLM)-driven agent framework, which iteratively refines queries and filters contextual evidence by leveraging dynamically evolving knowledge. A defining feature of the system is its decoupling of…

Artificial Intelligence · Computer Science 2025-04-02 Seyoung Song

We have seen remarkable progress in large language models (LLMs) empowered multi-agent systems solving complex tasks necessitating cooperation among experts with diverse skills. However, optimizing LLM-based multi-agent systems remains…

Artificial Intelligence · Computer Science 2025-08-08 Ming Shen , Raphael Shu , Anurag Pratik , James Gung , Yubin Ge , Monica Sunkara , Yi Zhang

Real-world visualization tasks involve complex, multi-modal requirements that extend beyond simple text-to-chart generation, requiring reference images, code examples, and iterative refinement. Current systems exhibit fundamental…

Computation and Language · Computer Science 2026-01-27 Jinwei Lu , Yuanfeng Song , Chen Zhang , Raymond Chi-Wing Wong

Large language models (LLMs) demonstrate strong reasoning abilities across mathematical, strategic, and linguistic tasks, yet little is known about how well they reason in dynamic, real-time, multi-agent scenarios, such as collaborative…

Multiagent Systems · Computer Science 2026-01-01 Shaurya Mallampati , Rashed Shelim , Walid Saad , Naren Ramakrishnan

Coordinating multiple embodied agents in dynamic environments remains a core challenge in artificial intelligence, requiring both perception-driven reasoning and scalable cooperation strategies. While recent works have leveraged large…

Artificial Intelligence · Computer Science 2026-01-23 Li Kang , Xiufeng Song , Heng Zhou , Yiran Qin , Jie Yang , Xiaohong Liu , Philip Torr , Lei Bai , Zhenfei Yin

Large Language Models (LLMs) often produce answers with a single chain-of-thought, which restricts their ability to explore reasoning paths or self-correct flawed outputs in complex tasks. In this paper, we introduce MALT (Multi-Agent LLM…

Recent advances in the intrinsic reasoning capabilities of large language models (LLMs) have given rise to LLM-based agent systems that exhibit near-human performance on a variety of automated tasks. However, although these systems share…

Artificial Intelligence · Computer Science 2025-08-26 Bingxi Zhao , Lin Geng Foo , Ping Hu , Christian Theobalt , Hossein Rahmani , Jun Liu

This paper introduces Team-Attention-Actor-Critic (TAAC), a reinforcement learning algorithm designed to enhance multi-agent collaboration in cooperative environments. TAAC employs a Centralized Training/Centralized Execution scheme…

Artificial Intelligence · Computer Science 2025-12-23 Hugo Garrido-Lestache Belinchon , Jeremy Kedziora

Large-scale reinforcement learning with verifiable rewards (RLVR) has demonstrated its effectiveness in harnessing the potential of large language models (LLMs) for single-turn reasoning tasks. In realistic reasoning scenarios, LLMs can…

Training large language models (LLMs) with synthetic reasoning data has become a popular approach to enhancing their reasoning capabilities, while a key factor influencing the effectiveness of this paradigm is the quality of the generated…

Artificial Intelligence · Computer Science 2026-03-24 Zhuojie Yang , Wentao Wan , Keze Wang

Recent advancements in Large Language Models (LLMs) have led to significant breakthroughs in various natural language processing tasks. However, generating factually consistent responses in knowledge-intensive scenarios remains a challenge…

Computation and Language · Computer Science 2025-01-03 Shengbin Yue , Siyuan Wang , Wei Chen , Xuanjing Huang , Zhongyu Wei

This paper introduces OSC (Orchestrating Cognitive Synergy), a knowledge-aware adaptive collaboration framework designed to enhance cognitive synergy in multi-agent systems with large language models. While prior work has advanced agent…

Artificial Intelligence · Computer Science 2025-09-08 Jusheng Zhang , Yijia Fan , Kaitong Cai , Xiaofei Sun , Keze Wang

Multi-agent large language model (LLM) systems have shown promise for solving complex tasks through agent collaboration. However, existing frameworks assign tasks based on predefined roles without considering whether an agent can accurately…

Artificial Intelligence · Computer Science 2026-05-19 Chenyu Wang , Yang Shu

We propose a novel approach to multi-robot collaboration that harnesses the power of pre-trained large language models (LLMs) for both high-level communication and low-level path planning. Robots are equipped with LLMs to discuss and…

Robotics · Computer Science 2023-07-11 Zhao Mandi , Shreeya Jain , Shuran Song

With recent breakthroughs in large language models (LLMs) for reasoning, planning, and complex task generation, artificial intelligence systems are transitioning from isolated single-agent architectures to multi-agent systems with…

Artificial Intelligence · Computer Science 2026-02-17 Linlin Wang , Tianqing Zhu , Laiqiao Qin , Longxiang Gao , Wanlei Zhou

Addressing the challenge of effectively processing long contexts has become a critical issue for Large Language Models (LLMs). Two common strategies have emerged: 1) reducing the input length, such as retrieving relevant chunks by…

Computation and Language · Computer Science 2024-06-06 Yusen Zhang , Ruoxi Sun , Yanfei Chen , Tomas Pfister , Rui Zhang , Sercan Ö. Arik

Multi-agent large language model systems can tackle complex multi-step tasks by decomposing work and coordinating specialized behaviors. However, current coordination mechanisms typically rely on statically assigned roles and centralized…

Multiagent Systems · Computer Science 2026-02-03 Zhaoyang Guan , Huixi Cao , Ming Zhong , Eric Yang , Lynn Ai , Yongxin Ni , Bill Shi

Large Language Models (LLMs) have shown impressive capabilities in multi-step reasoning and problem-solving.Recent works introduce multi-agent reflection frameworks where multiple LLM agents critique and refine each other's outputs using…

Artificial Intelligence · Computer Science 2025-11-26 Yuanhao Li , Mingshan Liu , Hongbo Wang , Yiding Zhang , Yifei Ma , Wei Tan

Multi-agent reinforcement learning is a promising research area that extends established reinforcement learning approaches to problems formulated as multi-agent systems. Recently, a multitude of communication methods have been introduced to…

Multiagent Systems · Computer Science 2026-01-21 Christoph Wittner