English
Related papers

Related papers: Provable Coordination for LLM Agents via Message S…

200 papers

Large language models (LLMs) have demonstrated remarkable capabilities in various domains, particularly in system 1 tasks, yet the intricacies of their problem-solving mechanisms in system 2 tasks are not sufficiently explored. Recent…

Artificial Intelligence · Computer Science 2025-02-19 Kounianhua Du , Hanjing Wang , Jianxing Liu , Jizheng Chen , Xinyi Dai , Yasheng Wang , Ruiming Tang , Yong Yu , Jun Wang , Weinan Zhang

Large language models (LLMs) excel at processing and generating both text and code. However, LLMs have had limited applicability in grounded task-oriented dialogue as they are difficult to steer toward task objectives and fail to handle…

Computation and Language · Computer Science 2023-10-27 Justin T. Chiu , Wenting Zhao , Derek Chen , Saujas Vaduguru , Alexander M. Rush , Daniel Fried

Large Language Models (LLMs) have demonstrated exceptional abilities in reasoning for task planning. However, challenges remain under-explored for parallel schedules. This paper introduces a novel paradigm, plan-over-graph, in which the…

Artificial Intelligence · Computer Science 2025-02-21 Shiqi Zhang , Xinbei Ma , Zouying Cao , Zhuosheng Zhang , Hai Zhao

Online coordination of multi-robot systems in open and unknown environments faces significant challenges, particularly when semantic features detected during operation dynamically trigger new tasks. Recent large language model (LLMs)-based…

Robotics · Computer Science 2025-08-21 Yuxiao Zhu , Junfeng Chen , Xintong Zhang , Meng Guo , Zhongkui Li

The language generation and reasoning capabilities of large language models (LLMs) have enabled conversational systems with impressive performance in a variety of tasks, from code generation, to composing essays, to passing STEM and legal…

Artificial Intelligence · Computer Science 2025-02-28 Konstantina Christakopoulou , Iris Qu , John Canny , Andrew Goodridge , Cj Adams , Minmin Chen , Maja Matarić

The partial observability and stochasticity in multi-agent settings can be mitigated by accessing more information about others via communication. However, the coordination problem still exists since agents cannot communicate actual actions…

Multiagent Systems · Computer Science 2024-11-06 Ziluo Ding , Zeyuan Liu , Zhirui Fang , Kefan Su , Liwen Zhu , Zongqing Lu

Traditional control system design, reliant on expert knowledge and precise models, struggles with complex, nonlinear, or uncertain dynamics. This paper introduces AgenticControl, a novel multi-agent framework that automates controller…

Systems and Control · Electrical Eng. & Systems 2025-06-25 Mohammad Narimani , Seyyed Ali Emami

Current research on large language model (LLM) agents is fragmented: discussions of conceptual frameworks and methodological principles are frequently intertwined with low-level implementation details, causing both readers and authors to…

Artificial Intelligence · Computer Science 2026-02-10 Haoyu Jia , Kento Kawaharazuka , Kei Okada

Producing high-quality code across multiple programming languages is increasingly important as today's software systems are built on heterogeneous stacks. Large language models (LLMs) have advanced the state of automated programming, yet…

Effective prompt design is essential for improving the planning capabilities of large language model (LLM)-driven agents. However, existing structured prompting strategies are typically limited to single-agent, plan-only settings, and often…

Artificial Intelligence · Computer Science 2025-07-08 Bruce Yang , Xinfeng He , Huan Gao , Yifan Cao , Xiaofan Li , David Hsu

Agentic systems are becoming more capable: agents define strategies, take actions, and interact with different environments. This autonomy poses serious challenges for overseeing and assessing agent behavior. Most current tools are limited,…

Computation and Language · Computer Science 2026-05-22 Asaf Yehudai , Lilach Eden , Michal Shmueli-Scheuer

Automatically generating formal ontologies from unstructured natural language remains a central challenge in knowledge engineering. While large language models (LLMs) show promise, it remains unclear which architectural design choices drive…

Artificial Intelligence · Computer Science 2026-04-28 Abid Talukder , Maruf Ahmed Mridul , Oshani Seneviratne

Large language models (LLMs) have become essential tools in software development, widely used for requirements engineering, code generation and review tasks. Software engineers often rely on LLMs to assess whether system code implementation…

Software Engineering · Computer Science 2025-08-19 Haolin Jin , Huaming Chen

We propose a method to teach multiple large language models (LLM) to collaborate by interleaving their generations at the token level. We model the decision of which LLM generates the next token as a latent variable. By optimizing the…

Computation and Language · Computer Science 2024-08-28 Shannon Zejiang Shen , Hunter Lang , Bailin Wang , Yoon Kim , David Sontag

Long-horizon task planning for heterogeneous multi-robot systems is essential for deploying collaborative teams in real-world environments; yet, it remains challenging due to the large volume of perceptual information, much of which is…

Robotics · Computer Science 2026-03-11 Piyush Gupta , Sangjae Bae , Jiachen Li , David Isele

Multi-Agent Reinforcement Learning (MARL) methods have shown promise in enabling agents to learn a shared communication protocol from scratch and accomplish challenging team tasks. However, the learned language is usually not interpretable…

Large language models (LLMs) are demonstrably capable of cross-lingual transfer, but can produce inconsistent output when prompted with the same queries written in different languages. To understand how language models are able to…

Computation and Language · Computer Science 2025-09-29 Zheng Wei Lim , Alham Fikri Aji , Trevor Cohn

Recent studies show that collaborating multiple large language model (LLM) powered agents is a promising way for task solving. However, current approaches are constrained by using a fixed number of agents and static communication…

Computation and Language · Computer Science 2024-11-18 Zijun Liu , Yanzhe Zhang , Peng Li , Yang Liu , Diyi Yang

Multi-agent Large Language Model (LLM) systems have been leading the way in applied LLM research across a number of fields. One notable area is software development, where researchers have advanced the automation of code implementation,…

Software Engineering · Computer Science 2025-11-25 Vali Tawosi , Keshav Ramani , Salwa Alamir , Xiaomo Liu

Multi-agent systems built on large language models (LLMs) require many coordination choices that are difficult to fix a priori: which skill protocol to invoke, which agent role should perform a subtask, which model to bind to each role, how…

Multiagent Systems · Computer Science 2026-05-28 Nicole Koenigstein