English
Related papers

Related papers: Reasoning-Aware Prompt Orchestration: A Foundation…

200 papers

The rise of Large Reasoning Models (LRMs) promises a significant leap forward in language model capabilities, aiming to tackle increasingly sophisticated tasks with unprecedented efficiency and accuracy. However, despite their impressive…

Artificial Intelligence · Computer Science 2025-07-22 Humza Sami , Mubashir ul Islam , Pierre-Emmanuel Gaillardon , Valerio Tenace

Large language models (LLMs) have recently demonstrated impressive capabilities in reasoning tasks. Currently, mainstream LLM reasoning frameworks predominantly focus on scaling up inference-time sampling to enhance performance. In…

Computation and Language · Computer Science 2026-03-24 Hongduan Tian , Xiao Feng , Ziyuan Zhao , Xiangyu Zhu , Rolan Yan , Bo Han

Multi-agent systems (MAS) powered by large language models (LLMs) hold significant promise for solving complex decision-making tasks. However, the core process of collaborative decision-making (CDM) within these systems remains…

Artificial Intelligence · Computer Science 2025-08-19 Xuyang Zhao , Shiwan Zhao , Hualong Yu , Liting Zhang , Qicheng Li

Large Reasoning Models (LRMs) represent a breakthrough in AI problem-solving capabilities, but their effectiveness in interactive environments can be limited. This paper introduces and analyzes overthinking in LRMs. A phenomenon where…

Automating operations research (OR) with large language models (LLMs) remains limited by hand-crafted reasoning--execution workflows. Complex OR tasks require adaptive coordination among problem interpretation, mathematical formulation,…

Artificial Intelligence · Computer Science 2026-04-21 Jiahao Huang , Peilan Xu , Xiaoya Nan , Wenjian Luo

Large Language Models (LLMs) and multi-agent systems have shown impressive capabilities in natural language tasks but face challenges in clinical trial applications, primarily due to limited access to external knowledge. Recognizing the…

Computation and Language · Computer Science 2024-07-23 Ling Yue , Sixue Xing , Jintai Chen , Tianfan Fu

While modern recommender systems are instrumental in navigating information abundance, they remain fundamentally limited by static user modeling and reactive decision-making paradigms. Current large language model (LLM)-based agents inherit…

Artificial Intelligence · Computer Science 2025-08-27 Chenghao Wu , Ruiyang Ren , Junjie Zhang , Ruirui Wang , Zhongrui Ma , Qi Ye , Wayne Xin Zhao

While large language model-based multi-agent systems have shown strong potential for complex reasoning, how to effectively organize multiple agents remains an open question. In this paper, we introduce OrgAgent, a company-style hierarchical…

Multiagent Systems · Computer Science 2026-04-02 Yiru Wang , Xinyue Shen , Yaohui Han , Michael Backes , Pin-Yu Chen , Tsung-Yi Ho

Multi-agent systems built on large language models (LLMs) require many coordination choices that are difficult to fix a priori: which skill protocol to invoke, which agent role should perform a subtask, which model to bind to each role, how…

Multiagent Systems · Computer Science 2026-05-28 Nicole Koenigstein

Large Language Models (LLMs) have shown remarkable capabilities in manipulating natural language across multiple applications, but their ability to handle simple reasoning tasks is often questioned. In this work, we aim to provide a…

Computation and Language · Computer Science 2025-05-05 Alessandro Raganato , Rafael Peñaloza , Marco Viviani , Gabriella Pasi

For machine agents to successfully interact with humans in real-world settings, they will need to develop an understanding of human mental life. Intuitive psychology, the ability to reason about hidden mental variables that drive observable…

With the development of artificial intelligence (AI), large language models (LLM) are widely used in many fields. However, the reasoning ability of LLM is still very limited when it comes to mathematical reasoning. Mathematics plays an…

Computation and Language · Computer Science 2024-08-06 Wenbei Xie , Donglin Liu , Haoran Yan , Wenjie Wu , Zongyang Liu

Single-agent large language model (LLM) systems struggle to simultaneously support diverse conversational functions and maintain safety in behavioral health communication. We propose a safety-aware, role-orchestrated multi-agent LLM…

Artificial Intelligence · Computer Science 2026-04-02 Ha Na Cho

This paper addresses the limitations of a single agent in task decomposition and collaboration during complex task execution, and proposes a multi-agent architecture for modular task decomposition and dynamic collaboration based on large…

Artificial Intelligence · Computer Science 2025-11-04 Shuaidong Pan , Di Wu

Large language models (LLMs) with reasoning capabilities have fueled a compelling narrative that reasoning universally improves performance across language tasks. We test this claim through a comprehensive evaluation of 504 configurations…

Computation and Language · Computer Science 2026-03-02 Donghao Huang , Zhaoxia Wang

Negotiation is a fundamental challenge for AI agents, as it requires an ability to reason strategically, model opponents, and balance cooperation with competition. We present the first comprehensive study that systematically evaluates how…

Computation and Language · Computer Science 2026-01-12 Sherzod Hakimov , Roland Bernard , Tim Leiber , Karl Osswald , Kristina Richert , Ruilin Yang , Raffaella Bernardi , David Schlangen

Foundation models face growing compute and memory bottlenecks, hindering deployment on resource-limited platforms. While compression techniques such as pruning and quantization are widely used, most rely on uniform heuristics that ignore…

Machine Learning · Computer Science 2025-09-09 Sadegh Jafari , Aishwarya Sarkar , Mohiuddin Bilwal , Ali Jannesari

Automatic prompt generation plays a crucial role in enabling general-purpose multi-agent systems to perform diverse tasks autonomously. Existing methods typically evaluate prompts based on their immediate task performance, overlooking the…

Artificial Intelligence · Computer Science 2025-05-21 Ke Chen , Yufei Zhou , Xitong Zhang , Haohan Wang

Large language models (LLMs) have demonstrated remarkable capabilities in natural language understanding and task generalization. However, their application to structured data analysis remains fragile due to inconsistencies in schema…

Artificial Intelligence · Computer Science 2025-05-06 Amit Rath

As foundation models are increasingly deployed as interacting agents in multi-agent systems, their collective behavior raises new challenges for trustworthiness, transparency, and accountability. Traditional coordination mechanisms, such as…

Multiagent Systems · Computer Science 2026-02-24 Brendan Gho , Suman Muppavarapu , Afnan Shaik , Tyson Tsay , Atharva Mohan , James Begin , Kevin Zhu , Archana Vaidheeswaran , Vasu Sharma