English
Related papers

Related papers: Modular Task Decomposition and Dynamic Collaborati…

200 papers

Multi-agent large language models (MA-LLMs) are a rapidly growing research area that leverages multiple interacting language agents to tackle complex tasks, outperforming single-agent large language models. This literature review…

Multiagent Systems · Computer Science 2025-06-03 Arne Tillmann

While agentic AI has advanced in automating individual tasks, managing complex multi-agent workflows remains a challenging problem. This paper presents a research vision for autonomous agentic systems that orchestrate collaboration within…

Artificial Intelligence · Computer Science 2025-10-06 Charlie Masters , Advaith Vellanki , Jiangbo Shangguan , Bart Kultys , Jonathan Gilmore , Alastair Moore , Stefano V. Albrecht

While contemporary large language models (LLMs) are increasingly capable in isolation, there are still many difficult problems that lie beyond the abilities of a single LLM. For such tasks, there is still uncertainty about how best to take…

Artificial Intelligence · Computer Science 2026-02-27 Ryan Liu , Dilip Arumugam , Cedegao E. Zhang , Sean Escola , Xaq Pitkow , Thomas L. Griffiths

Multi-agent systems (MAS) demonstrate clear advantages in tackling complex problems by coordinating diverse agents and external tools. However, most existing orchestration methods rely on static workflows or serial agent scheduling, and are…

Artificial Intelligence · Computer Science 2026-04-21 Wenzhen Yuan , Wutao Xiong , Fanchen Yu , Shengji Tang , Ting Liu , Tao Chen , Peng Ye , Yuzhuo Fu , Wanli Ouyang , Lei Bai

We present a framework combining hierarchical and multi-agent deep reinforcement learning approaches to solve coordination problems among a multitude of agents using a semi-decentralized model. The framework extends the multi-agent learning…

Artificial Intelligence · Computer Science 2017-12-25 Saurabh Kumar , Pararth Shah , Dilek Hakkani-Tur , Larry Heck

Processing long contexts has become a critical capability for modern large language models (LLMs). Existing works leverage agent-based divide-and-conquer methods for processing long contexts. But these methods face crucial limitations,…

Computation and Language · Computer Science 2025-09-30 Sibo Xiao , Zixin Lin , Wenyang Gao , Hui Chen , Yue Zhang

In this paper, we propose a novel model-based multi-agent reinforcement learning approach named Value Decomposition Framework with Disentangled World Model to address the challenge of achieving a common goal of multiple agents interacting…

Machine Learning · Computer Science 2025-09-29 Zhizun Wang , David Meger

As single-task accuracy on individual language and image tasks has improved substantially in the last few years, the long-term goal of a generally skilled agent that can both see and talk becomes more feasible to explore. In this work, we…

Computation and Language · Computer Science 2020-01-17 Da Ju , Kurt Shuster , Y-Lan Boureau , Jason Weston

Nowadays, Large Language Models (LLMs) have been gradually employed to solve complex tasks. To face the challenge, task decomposition has become an effective way, which proposes to divide a complex task into multiple simpler subtasks and…

Computation and Language · Computer Science 2025-04-14 Yiliu Sun , Yanfang Zhang , Zicheng Zhao , Sheng Wan , Dacheng Tao , Chen Gong

The potential of automatic task-solving through Large Language Model (LLM)-based multi-agent collaboration has recently garnered widespread attention from both the research community and industry. While utilizing natural language to…

Human-Computer Interaction · Computer Science 2024-04-19 Bo Pan , Jiaying Lu , Ke Wang , Li Zheng , Zhen Wen , Yingchaojie Feng , Minfeng Zhu , Wei Chen

Large language models are increasingly deployed in multi-agent systems to overcome context limitations by distributing information across agents. Yet whether agents can reliably compute with distributed information, rather than merely…

Multiagent Systems · Computer Science 2026-04-15 Yuzhe Zhang , Feiran Liu , Yi Shan , Xinyi Huang , Xin Yang , Yueqi Zhu , Xuxin Cheng , Cao Liu , Ke Zeng , Terry Jingchen Zhang , Wenyuan Jiang

Large Language Models (LLMs) have shown remarkable capabilities in general natural language processing tasks but often fall short in complex reasoning tasks. Recent studies have explored human-like problem-solving strategies, such as…

Computation and Language · Computer Science 2023-12-19 Zhenran Xu , Senbao Shi , Baotian Hu , Jindi Yu , Dongfang Li , Min Zhang , Yuxiang Wu

Alignment of Large Language models (LLMs) is crucial for safe and trustworthy deployment in applications. Reinforcement learning from human feedback (RLHF) has emerged as an effective technique to align LLMs to human preferences and broader…

Large language model (LLM)-based multi-agent systems (MAS) have demonstrated exceptional capabilities in solving complex tasks, yet their effectiveness depends heavily on the underlying communication topology that coordinates agent…

Machine Learning · Computer Science 2026-03-23 Hongjiang Chen , Xin Zheng , Yixin Liu , Pengfei Jiao , Shiyuan Li , Huan Liu , Zhidong Zhao , Ziqi Xu , Ibrahim Khalil , Shirui Pan

Large language model (LLM)-based multi-agent systems have emerged as a powerful paradigm for enabling autonomous agents to solve complex tasks. As these systems scale in complexity, cost becomes an important consideration for practical…

Multiagent Systems · Computer Science 2025-11-27 Liming Yang , Junyu Luo , Xuanzhe Liu , Yiling Lou , Zhenpeng Chen

Modeling agent behavior is central to understanding the emergence of complex phenomena in multiagent systems. Prior work in agent modeling has largely been task-specific and driven by hand-engineering domain-specific prior knowledge. We…

Multiagent Systems · Computer Science 2018-08-02 Aditya Grover , Maruan Al-Shedivat , Jayesh K. Gupta , Yura Burda , Harrison Edwards

Collaborative multi-agent exploration of unknown environments is crucial for search and rescue operations. Effective real-world deployment must address challenges such as limited inter-agent communication and static and dynamic obstacles.…

Robotics · Computer Science 2024-12-31 Gabriele Calzolari , Vidya Sumathy , Christoforos Kanellakis , George Nikolakopoulos

Few-shot prompting is a surprisingly powerful way to use Large Language Models (LLMs) to solve various tasks. However, this approach struggles as the task complexity increases or when the individual reasoning steps of the task themselves…

Computation and Language · Computer Science 2023-04-13 Tushar Khot , Harsh Trivedi , Matthew Finlayson , Yao Fu , Kyle Richardson , Peter Clark , Ashish Sabharwal

Intelligent agents such as robots are increasingly deployed in real-world, safety-critical settings. It is vital that these agents are able to explain the reasoning behind their decisions to human counterparts; however, their behavior is…

Machine Learning · Computer Science 2023-12-01 Xijia Zhang , Yue Guo , Simon Stepputtis , Katia Sycara , Joseph Campbell

Advancing reinforcement learning (RL) requires tools that are flexible enough to easily prototype new methods while avoiding impractically slow experimental turnaround times. To match the first requirement, the most popular RL libraries…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Albert Bou , Sebastian Dittert , Gianni De Fabritiis