English
Related papers

Related papers: COMPASS: Enhancing Agent Long-Horizon Reasoning wi…

200 papers

LLM-based agents show strong potential for long-horizon reasoning, yet their context size is limited by deployment factors (e.g., memory, latency, and cost), yielding a constrained context budget. As interaction histories grow, this induces…

Artificial Intelligence · Computer Science 2026-04-03 Yong Wu , YanZhao Zheng , TianZe Xu , ZhenTao Zhang , YuanQiang Yu , JiHuai Zhu , Chao Ma , BinBin Lin , BaoHua Dong , HangCheng Zhu , RuoHui Huang , Gang Yu

Recent advances in Large Language Models (LLMs) and Large Reasoning Models (LRMs) have enabled agentic search systems that interleave multi-step reasoning with external tool use. However, existing frameworks largely rely on unstructured…

Information Retrieval · Computer Science 2025-12-29 Shuting Wang , Qiaolin Xia , Vich Wang , Herberttli , Bobsimons , Zhicheng Dou

Long-horizon LLM agents accumulate growing conversation histories that eventually exceed the model's context window. Context compaction via LLM-based summarization keeps the conversation bounded, but summarization is inherently lossy and…

Artificial Intelligence · Computer Science 2026-05-25 Musa Cim , Burak Topcu , Chita Das , Mahmut Taylan Kandemir

Large language models (LLMs) often generate fluent but factually incorrect statements despite having access to relevant evidence, a failure mode rooted in how they allocate attention between contextual and parametric knowledge.…

Computation and Language · Computer Science 2025-12-02 Kenji Sahay , Snigdha Pandya , Rohan Nagale , Anna Lin , Shikhar Shiromani , Kevin Zhu , Dev Sunishchal

Large language models (LLMs) are increasingly deployed as intelligent agents that reason, plan, and interact with their environments. To effectively scale to long-horizon scenarios, a key capability for such agents is a memory mechanism…

Artificial Intelligence · Computer Science 2026-01-09 Yuyang Hu , Jiongnan Liu , Jiejun Tan , Yutao Zhu , Zhicheng Dou

Designing high-performance system heuristics is a creative, iterative process requiring experts to form hypotheses and execute multi-step conceptual shifts. While Large Language Models (LLMs) show promise in automating this loop, they…

Artificial Intelligence · Computer Science 2026-03-24 Pantea Karimi , Kimia Noorbakhsh , Mohammad Alizadeh , Hari Balakrishnan

Persistent monitoring of dynamic targets is essential in real-world applications such as disaster response, environmental sensing, and wildlife conservation, where mobile agents must continuously gather information under uncertainty. We…

Multiagent Systems · Computer Science 2025-10-21 Xingjian Zhang , Yizhuo Wang , Guillaume Sartoretti

Large language models (LLMs) often exhibit performance disparities across languages, with naive multilingual fine-tuning frequently degrading performance due to negative cross-lingual interference. To address this, we introduce COMPASS…

Machine Learning · Computer Science 2026-04-23 Noah Flynn

Multi-agent systems (MAS) extend large language models (LLMs) from independent single-model reasoning to coordinative system-level intelligence. While existing LLM agents depend on text-based mediation for reasoning and communication, we…

Computation and Language · Computer Science 2025-12-09 Jiaru Zou , Xiyuan Yang , Ruizhong Qiu , Gaotang Li , Katherine Tieu , Pan Lu , Ke Shen , Hanghang Tong , Yejin Choi , Jingrui He , James Zou , Mengdi Wang , Ling Yang

Addressing the challenge of effectively processing long contexts has become a critical issue for Large Language Models (LLMs). Two common strategies have emerged: 1) reducing the input length, such as retrieving relevant chunks by…

Computation and Language · Computer Science 2024-06-06 Yusen Zhang , Ruoxi Sun , Yanfei Chen , Tomas Pfister , Rui Zhang , Sercan Ö. Arik

Although large language models (LLMs) have advanced rapidly, robust automation of complex software workflows remains an open problem. In long-horizon settings, agents frequently suffer from cascading errors and environmental stochasticity;…

Artificial Intelligence · Computer Science 2026-03-30 Yenchia Feng , Chirag Sharma , Karime Maamari

Autonomous agent frameworks still struggle to reconcile long-term experiential learning with real-time, context-sensitive decision-making. In practice, this gap appears as static cognition, rigid workflow dependence, and inefficient context…

Artificial Intelligence · Computer Science 2026-03-11 Xiaoxing Wang , Ning Liao , Shikun Wei , Chen Tang , Feiyu Xiong

While Large Language Models (LLMs) have shown remarkable advancements in reasoning and tool use, they often fail to generate optimal, grounded solutions under complex constraints. Real-world travel planning exemplifies these challenges,…

Artificial Intelligence · Computer Science 2025-10-01 Jihye Choi , Jinsung Yoon , Jiefeng Chen , Somesh Jha , Tomas Pfister

Integrating Large Language Models (LLMs) into complex software systems enables the generation of human-understandable explanations of opaque AI processes, such as automated task planning. However, the quality and reliability of these…

Artificial Intelligence · Computer Science 2026-04-24 Gricel Vázquez , Alexandros Evangelidis , Sepeedeh Shahbeigi , Radu Calinescu , Simos Gerasimou

Recently, large language models (LLMs) have demonstrated remarkable problem-solving capabilities by autonomously integrating with external tools for collaborative reasoning. However, due to the inherently complex and diverse nature of…

Artificial Intelligence · Computer Science 2025-11-03 Mengjie Deng , Guanting Dong , Zhicheng Dou

The rapid increase in textual information means we need more efficient methods to sift through, organize, and understand it all. While retrieval-augmented generation (RAG) models excel in accessing information from large document…

Computation and Language · Computer Science 2025-03-14 Seiji Maekawa , Hayate Iso , Nikita Bhutani

Recent advanced LLM-powered agent systems have exhibited their remarkable capabilities in tackling complex, long-horizon tasks. Nevertheless, they still suffer from inherent limitations in resource efficiency, context management, and…

Multi-agent systems (MAS) built on large language models (LLMs) offer a promising path toward solving complex, real-world tasks that single-agent systems often struggle to manage. While recent advancements in test-time scaling (TTS) have…

Artificial Intelligence · Computer Science 2025-08-20 Can Jin , Hongwu Peng , Qixin Zhang , Yujin Tang , Dimitris N. Metaxas , Tong Che

Recent deep research agents primarily improve performance by scaling reasoning depth, but this leads to high inference cost and latency in search-intensive scenarios. Moreover, generalization across heterogeneous research settings remains…

Large Language Model (LLM) agents are increasingly deployed in complex, multi-step workflows involving planning, tool use, reflection, and interaction with external knowledge systems. These workflows generate rapidly expanding contexts that…

Artificial Intelligence · Computer Science 2025-12-22 Kamer Ali Yuksel