English
Related papers

Related papers: IMAGINE: Integrating Multi-Agent System into One M…

200 papers

Large Language Models (LLMs) have achieved remarkable reliability and advanced capabilities through extended test-time reasoning. However, extending these capabilities to Multi-modal Large Language Models (MLLMs) remains a significant…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yuhao Dong , Zuyan Liu , Shulin Tian , Yongming Rao , Ziwei Liu

Large Language Model (LLM)-powered Multi-agent systems (MAS) have achieved state-of-the-art results on various complex reasoning tasks. Recent works have proposed techniques to automate the design of MASes, eliminating the need for manual…

Artificial Intelligence · Computer Science 2026-05-20 Bohan Yao , Shiva Krishna Reddy Malay , Vikas Yadav

Enhancing the reasoning capabilities of large language models (LLMs) is crucial for enabling them to tackle complex, multi-step problems. Multi-agent frameworks have shown great potential in enhancing LLMs' reasoning capabilities. However,…

Artificial Intelligence · Computer Science 2024-10-29 Danqing Wang , Zhuorui Ye , Fei Fang , Lei Li

Inventory management remains a challenge for many small and medium-sized businesses that lack the expertise to deploy advanced optimization methods. This paper investigates whether Large Language Models (LLMs) can help bridge this gap. We…

Artificial Intelligence · Computer Science 2026-01-05 Yaqi Duan , Yichun Hu , Jiashuo Jiang

Open-source pre-trained Large Language Models (LLMs) exhibit strong language understanding and generation capabilities, making them highly successful in a variety of tasks. However, when used as agents for dealing with complex problems in…

Computation and Language · Computer Science 2024-04-01 Qinhao Zhou , Zihan Zhang , Xiang Xiang , Ke Wang , Yuchuan Wu , Yongbin Li

Algorithmic problem solving serves as a rigorous testbed for evaluating structured reasoning in AI coding systems, as it directly reflects a model's ability to perform structured reasoning in complex scenarios. Existing approaches…

Artificial Intelligence · Computer Science 2026-05-11 Yuliang Xu , Xiang Xu , Yao Wan , Hu Wei , Tong Jia

We introduce Agentic Reasoning, a framework that enhances large language model (LLM) reasoning by integrating external tool-using agents. Agentic Reasoning dynamically leverages web search, code execution, and structured memory to address…

Artificial Intelligence · Computer Science 2025-07-16 Junde Wu , Jiayuan Zhu , Yuyuan Liu , Min Xu , Yueming Jin

Despite the impressive capabilities of large language models (LLMs), they currently exhibit two primary limitations, \textbf{\uppercase\expandafter{\romannumeral 1}}: They struggle to \textbf{autonomously solve the real world engineering…

Artificial Intelligence · Computer Science 2024-11-05 Bin Lei , Yuchen Li , Yiming Zeng , Tao Ren , Yi Luo , Tianyu Shi , Zitian Gao , Zeyu Hu , Weitai Kang , Qiuwu Chen

Large Language Models (LLMs) like GPT-4 have revolutionized natural language processing, showing remarkable linguistic proficiency and reasoning capabilities. However, their application in strategic multi-agent decision-making environments…

Computation and Language · Computer Science 2024-05-29 Chuanhao Li , Runhan Yang , Tiankai Li , Milad Bafarassat , Kourosh Sharifi , Dirk Bergemann , Zhuoran Yang

Multi-agent systems built on large language models (LLMs) are expected to enhance decision-making by pooling distributed information, yet systematically evaluating this capability has remained challenging. We introduce HiddenBench, a…

Computation and Language · Computer Science 2026-05-14 Yuxuan Li , Aoi Naito , Hirokazu Shirado

Strategic planning is critical for multi-step reasoning, yet compact Large Language Models (LLMs) often lack the capacity to formulate global strategies, leading to error propagation in long-horizon tasks. Our analysis reveals that LLMs…

Computation and Language · Computer Science 2026-04-15 Haoyu Zheng , Yun Zhu , Yuqian Yuan , Bo Yuan , Wenqiao Zhang , Siliang Tang , Jun Xiao

Large Language Models (LLMs) have demonstrated impressive performance in executing complex reasoning tasks. Chain-of-thought effectively enhances reasoning capabilities by unlocking the potential of large models, while multi-agent systems…

Computation and Language · Computer Science 2026-02-11 Jiaxing Zhao , Hongbin Xie , Yuzhen Lei , Xuan Song , Zhuoran Shi , Lianxin Li , Shuangxue Liu , Linguo Xie , Haoran Zhang

Large language models (LLMs) are post-trained through reinforcement learning (RL) to evolve into Reasoning Language Models (RLMs), where the hallmark of this advanced reasoning is ``aha'' moments when they start to perform strategies, such…

Artificial Intelligence · Computer Science 2025-12-10 Sijia Chen , Baochun Li , Di Niu

We present an end-to-end, model-based deep reinforcement learning agent which dynamically attends to relevant parts of its state during planning. The agent uses a bottleneck mechanism over a set-based representation to force the number of…

Artificial Intelligence · Computer Science 2021-11-05 Mingde Zhao , Zhen Liu , Sitao Luan , Shuyuan Zhang , Doina Precup , Yoshua Bengio

Although large language models have enhanced automated travel planning abilities, current systems remain misaligned with real-world scenarios. First, they assume users provide explicit queries, while in reality requirements are often…

Artificial Intelligence · Computer Science 2025-08-22 Bin Deng , Yizhe Feng , Zeming Liu , Qing Wei , Xiangrong Zhu , Shuai Chen , Yuanfang Guo , Yunhong Wang

Recursive or looped language models have recently emerged as a new scaling axis by iteratively refining the same model computation over latent states to deepen reasoning. We extend such scaling principle from a single model to multi-agent…

Artificial Intelligence · Computer Science 2026-04-29 Xiyuan Yang , Jiaru Zou , Rui Pan , Ruizhong Qiu , Pan Lu , Shizhe Diao , Jindong Jiang , Hanghang Tong , Tong Zhang , Markus J. Buehler , Jingrui He , James Zou

The deployment of agent systems in an enterprise environment is often hindered by several challenges: common models lack domain-specific process knowledge, leading to disorganized plans, missing key tools, and poor execution stability. To…

A key challenge in transportation planning is that the collective preferences of heterogeneous travelers often diverge from the policies produced by model-driven decision tools. This misalignment frequently results in implementation delays…

Computers and Society · Computer Science 2025-10-29 Xiaoyu Yan , Tianxing Dai , Yu Marco Nie

Large Reasoning Models (LRMs) like o3 and DeepSeek-R1 have achieved remarkable progress in reasoning tasks with long cot. However, they remain computationally inefficient and struggle with accuracy when solving problems requiring complex…

Artificial Intelligence · Computer Science 2026-03-03 Haipeng Luo , Huawen Feng , Qingfeng Sun , Can Xu , Kai Zheng , Yufei Wang , Tao Yang , Han Hu , Yansong Tang

Large Language Models (LLMs) have demonstrated remarkable capabilities across a wide range of language tasks, yet complex multi-step reasoning remains a fundamental challenge. While Large Reasoning Models (LRMs) equipped with extended…

Artificial Intelligence · Computer Science 2026-03-17 Guangfu Hao , Yuming Dai , Xianzhe Qin , Shan Yu