English
Related papers

Related papers: Chain of Agents: Large Language Models Collaborati…

200 papers

Large language models (LLMs) demonstrate strong reasoning abilities across mathematical, strategic, and linguistic tasks, yet little is known about how well they reason in dynamic, real-time, multi-agent scenarios, such as collaborative…

Multiagent Systems · Computer Science 2026-01-01 Shaurya Mallampati , Rashed Shelim , Walid Saad , Naren Ramakrishnan

Enhancing the reasoning capabilities of large language models (LLMs) is crucial for enabling them to tackle complex, multi-step problems. Multi-agent frameworks have shown great potential in enhancing LLMs' reasoning capabilities. However,…

Artificial Intelligence · Computer Science 2024-10-29 Danqing Wang , Zhuorui Ye , Fei Fang , Lei Li

Recent advancements in reasoning with large language models (RLLMs), such as OpenAI-O1 and DeepSeek-R1, have demonstrated their impressive capabilities in complex domains like mathematics and coding. A central factor in their success lies…

Artificial Intelligence · Computer Science 2025-07-21 Qiguang Chen , Libo Qin , Jinhao Liu , Dengyun Peng , Jiannan Guan , Peng Wang , Mengkang Hu , Yuhang Zhou , Te Gao , Wanxiang Che

Large models have achieved remarkable performance across a range of reasoning and understanding tasks. Prior work often utilizes model ensembles or multi-agent systems to collaboratively generate responses, effectively operating in a…

Machine Learning · Computer Science 2025-11-11 Siqi Huang , Sida Huang , Hongyuan Zhang

Extending context windows (i.e., Long Context, LC) and using retrievers to selectively access relevant information (i.e., Retrieval-Augmented Generation, RAG) are the two main strategies to enable LLMs to incorporate extremely long external…

Computation and Language · Computer Science 2025-01-06 Xinze Li , Yixin Cao , Yubo Ma , Aixin Sun

Current research on large language model (LLM) agents is fragmented: discussions of conceptual frameworks and methodological principles are frequently intertwined with low-level implementation details, causing both readers and authors to…

Artificial Intelligence · Computer Science 2026-02-10 Haoyu Jia , Kento Kawaharazuka , Kei Okada

While Chain-of-Thought prompting is popular in reasoning tasks, its application to Large Language Models (LLMs) in Natural Language Understanding (NLU) is under-explored. Motivated by multi-step reasoning of LLMs, we propose Coarse-to-Fine…

Computation and Language · Computer Science 2023-10-24 Hoang H. Nguyen , Ye Liu , Chenwei Zhang , Tao Zhang , Philip S. Yu

Large Language Models (LLMs) have demonstrated emergent common-sense reasoning and Theory of Mind (ToM) capabilities, making them promising candidates for developing coordination agents. This study introduces the LLM-Coordination Benchmark,…

Computation and Language · Computer Science 2025-04-30 Saaket Agashe , Yue Fan , Anthony Reyna , Xin Eric Wang

Long-horizon large language model (LLM) agents are fundamentally limited by context. As interactions become longer, tool descriptions, retrieved memories, and raw environmental feedback accumulate and push out the information needed for…

Long-context language models (LCLMs), characterized by their extensive context window, are becoming popular. However, despite the fact that they are nearly perfect at standard long-context retrieval tasks, our evaluations demonstrate they…

Computation and Language · Computer Science 2025-08-27 Yijiong Yu , Yongfeng Huang , Zhixiao Qi , Wei Wang , Weifeng Liu , Ran Chen , Ji Pei

Large Language Models (LLMs) have demonstrated remarkable capabilities in solving various tasks, yet they often struggle with comprehensively addressing complex and vague problems. Existing approaches, including multi-agent LLM systems,…

Multiagent Systems · Computer Science 2024-07-11 Sumedh Rasal , E. J. Hauer

Large language models (LLMs) have recently emerged as promising tools for solving challenging robotic tasks, even in the presence of action and observation uncertainties. Recent LLM-based decision-making methods (also referred to as…

Artificial Intelligence · Computer Science 2024-09-20 Abhinav Jain , Chris Jermaine , Vaibhav Unhelkar

Large Language Model (LLM) based multi-agent systems (MAS) show remarkable potential in collaborative problem-solving, yet they still face critical challenges: low communication efficiency, poor scalability, and a lack of effective…

Computation and Language · Computer Science 2025-02-19 Weize Chen , Jiarui Yuan , Chen Qian , Cheng Yang , Zhiyuan Liu , Maosong Sun

Large Language Models (LLMs) have achieved remarkable success across a wide array of tasks. Due to the impressive planning and reasoning abilities of LLMs, they have been used as autonomous agents to do many tasks automatically. Recently,…

Computation and Language · Computer Science 2024-04-22 Taicheng Guo , Xiuying Chen , Yaqi Wang , Ruidi Chang , Shichao Pei , Nitesh V. Chawla , Olaf Wiest , Xiangliang Zhang

We attempt to solve the Abstraction and Reasoning Corpus (ARC) Challenge using Large Language Models (LLMs) as a system of multiple expert agents. Using the flexibility of LLMs to be prompted to do various novel tasks using zero-shot,…

Artificial Intelligence · Computer Science 2023-10-10 John Chong Min Tan , Mehul Motani

Current Large Language Models (LLMs) are not only limited to some maximum context length, but also are not able to robustly consume long inputs. To address these limitations, we propose ReadAgent, an LLM agent system that increases…

Computation and Language · Computer Science 2024-07-23 Kuang-Huei Lee , Xinyun Chen , Hiroki Furuta , John Canny , Ian Fischer

Large Language Models (LLMs) suffer from significant performance degradation when processing long contexts due to proactive interference, where irrelevant information in earlier parts of the context disrupts reasoning and memory recall.…

Computation and Language · Computer Science 2025-09-30 Mo Li , L. H. Xu , Qitai Tan , Long Ma , Ting Cao , Yunxin Liu

Large language model (LLM)-based agents that reason, plan, and act through tools, memory, and structured interaction are emerging as a promising paradigm for automating complex workflows. Recent systems such as OpenClaw and Claude Code…

Information Retrieval · Computer Science 2026-05-27 Yingli Zhou , Wang Shu , Yaodong Su , Wenchuan Du , Yixiang Fang , Xuemin Lin

Research interest in autonomous agents is on the rise as an emerging topic. The notable achievements of Large Language Models (LLMs) have demonstrated the considerable potential to attain human-like intelligence in autonomous agents.…

Multiagent Systems · Computer Science 2025-01-30 Hung Du , Srikanth Thudumu , Rajesh Vasa , Kon Mouzakis

The emergence of Large Language Model (LLM) agents enables us to build agent-based intelligent systems that move beyond the role of a "tool" to become genuine collaborators with humans, thereby realizing a novel human-agent collaboration…

Human-Computer Interaction · Computer Science 2026-02-06 Bingsheng Yao , Chaoran Chen , April Yi Wang , Sherry Tongshuang Wu , Toby Jia-jun Li , Dakuo Wang