English
Related papers

Related papers: COMPASS: Enhancing Agent Long-Horizon Reasoning wi…

200 papers

Large language model (LLM) agents rely on external tools to solve complex tasks, but real-world toolsets often contain redundant tools with overlapping names and descriptions, introducing ambiguity and reducing selection accuracy. LLMs also…

Computation and Language · Computer Science 2026-05-12 Marianne Menglin Liu , Daniel Garcia , Fjona Parllaku , Vikas Upadhyay , Syed Fahad Allam Shah , Dan Roth

Prompt optimization has become a practical way to improve the performance of Large Language Models (LLMs) without retraining. However, most existing frameworks treat evaluation as a black box, relying solely on outcome scores without…

Multiagent Systems · Computer Science 2026-04-01 Wonduk Seo , Juhyeon Lee , Junseo Koh , Wonseok Choi , Hyunjin An , Jian Park , Seunghyun lee , Haihua Chen , Yi Bu

While server-side Large Language Models (LLMs) demonstrate proficiency in function calling and complex reasoning, deploying Small Language Models (SLMs) directly on devices brings opportunities to improve latency and privacy but also…

Computation and Language · Computer Science 2024-10-15 Yicheng Fu , Raviteja Anantha , Jianpeng Cheng

As agent systems powered by large language models (LLMs) advance, improving performance in context understanding, tool usage, and long-horizon execution has become critical. However, existing agent frameworks and benchmarks provide limited…

Artificial Intelligence · Computer Science 2026-01-28 Defei Xia , Bingfeng Pi , Shenbin Zhang , Song Hua , Yunfei Wei , Lei Zuo

Large language model (LLM) agents have recently demonstrated strong capabilities in interactive decision-making, yet they remain fundamentally limited in long-horizon tasks that require structured planning and reliable execution. Existing…

Artificial Intelligence · Computer Science 2026-05-06 Hongbo Jin , Rongpeng Zhu , Jiayu Ding , Guibo Luo , Ge Li

Large language models (LLMs) demonstrate impressive performance on a wide variety of tasks, but they often struggle with tasks that require multi-step reasoning or goal-directed planning. Both cognitive neuroscience and reinforcement…

Artificial Intelligence · Computer Science 2025-10-16 Taylor Webb , Shanka Subhra Mondal , Ida Momennejad

We envision a continuous collaborative learning system where groups of LLM agents work together to solve reasoning problems, drawing on memory they collectively build to improve performance as they gain experience. This work establishes the…

Artificial Intelligence · Computer Science 2025-03-11 Julie Michelman , Nasrin Baratalipour , Matthew Abueg

Large language model (LLM)-based multi-agent systems have demonstrated remarkable promise for tackling complex tasks by breaking them down into subtasks that are iteratively planned, executed, observed, and refined. Despite their…

Multiagent Systems · Computer Science 2025-07-15 Enhao Zhang , Erkang Zhu , Gagan Bansal , Adam Fourney , Hussein Mozannar , Jack Gerrits

Embodied agents need to plan and act reliably in real and complex 3D environments. Classical planning (e.g., PDDL) offers structure and guarantees, but in practice it fails under noisy perception and incorrect predicate grounding. On the…

As a model-agnostic approach to long context modeling, multi-agent systems can process inputs longer than a large language model's context window without retraining or architectural modifications. However, their performance often heavily…

Machine Learning · Computer Science 2025-09-29 Taejong Joo , Shu Ishida , Ivan Sosnovik , Bryan Lim , Sahand Rezaei-Shoshtari , Adam Gaier , Robert Giaquinto

Current research on large language model (LLM) agents is fragmented: discussions of conceptual frameworks and methodological principles are frequently intertwined with low-level implementation details, causing both readers and authors to…

Artificial Intelligence · Computer Science 2026-02-10 Haoyu Jia , Kento Kawaharazuka , Kei Okada

Large Language Models (LLMs) have revolutionized Natural Language Processing but exhibit limitations, particularly in autonomously addressing novel challenges such as reasoning and problem-solving. Traditional techniques like…

Multiagent Systems · Computer Science 2024-01-03 Sumedh Rasal

Large Language Model (LLM)-empowered multi-agent systems extend the cognitive boundaries of individual agents through disciplined collaboration and interaction, while constructing these systems often requires labor-intensive manual designs.…

Machine Learning · Computer Science 2025-06-10 Guibin Zhang , Luyang Niu , Junfeng Fang , Kun Wang , Lei Bai , Xiang Wang

Multi-agent large language model frameworks are promising for complex multi step reasoning, yet existing systems remain weak for scientific and knowledge intensive domains due to static prompts and agent roles, rigid workflows, and…

Artificial Intelligence · Computer Science 2026-03-04 Yichao Feng , Haoran Luo , Zhenghong Lin , Yiqun Sun , Pengfei Wei , Lawrence B. Hsieh , Anh Tuan Luu

Multi-agent systems based on large language models, particularly centralized architectures, have recently shown strong potential for complex and knowledge-intensive tasks. However, central agents often suffer from unstable long-horizon…

Artificial Intelligence · Computer Science 2026-01-12 Ruizhe Zhang , Xinke Jiang , Zhibang Yang , Zhixin Zhang , Jiaran Gao , Yuzhen Xiao , Hongbin Lai , Xu Chu , Junfeng Zhao , Yasha Wang

Recent advances in the intrinsic reasoning capabilities of large language models (LLMs) have given rise to LLM-based agent systems that exhibit near-human performance on a variety of automated tasks. However, although these systems share…

Artificial Intelligence · Computer Science 2025-08-26 Bingxi Zhao , Lin Geng Foo , Ping Hu , Christian Theobalt , Hossein Rahmani , Jun Liu

The rise of AI-native Low-Code/No-Code (LCNC) platforms enables autonomous agents capable of executing complex, long-duration business processes. However, a fundamental challenge remains: memory management. As agents operate over extended…

Artificial Intelligence · Computer Science 2025-10-01 Jiexi Xu

Recent advances in deep-research agents have shown promise for autonomous knowledge construction through dynamic reasoning over external sources. However, existing approaches rely on a mono-contextual paradigm that accumulates all…

Large language models (LLMs) demonstrate strong reasoning abilities across mathematical, strategic, and linguistic tasks, yet little is known about how well they reason in dynamic, real-time, multi-agent scenarios, such as collaborative…

Multiagent Systems · Computer Science 2026-01-01 Shaurya Mallampati , Rashed Shelim , Walid Saad , Naren Ramakrishnan

Multi-agent systems (MAS) have recently emerged as promising socio-collaborative companions for emotional and cognitive support. However, these systems frequently suffer from persona collapse--where agents revert to generic, homogenized…

Computation and Language · Computer Science 2026-01-21 Yiyang Wang , Yiqiao Jin , Alex Cabral , Josiah Hester