English
Related papers

Related papers: Beyond the Context Window: A Cost-Performance Anal…

200 papers

Modern large language models (LLMs) increasingly rely on inference-time planning and external tools to improve reasoning. We benchmark this behavior on two real-world settings: event-centric question answering over graph-structured…

Computation and Language · Computer Science 2026-03-06 Subha Ghoshal , Ali Al-Bustami

Large language model (LLM) agents are fundamentally bottlenecked by finite context windows on long-horizon tasks. As trajectories grow, retaining tool outputs and intermediate reasoning in-context quickly becomes infeasible: the working…

Computation and Language · Computer Science 2026-03-05 Zhenting Wang , Huancheng Chen , Jiayun Wang , Wei Wei

LLM-based conversational agents still struggle to maintain coherent, personalized interaction over many sessions: fixed context windows limit how much history can be kept in view, and most external memory approaches trade off between coarse…

Computation and Language · Computer Science 2025-12-12 Sizhe Zhou , Jiawei Han

Large language models (LLMs) excel at many NLP tasks but struggle to sustain long-term interactions due to limited attention over extended dialogue histories. Retrieval-augmented generation (RAG) mitigates this issue but lacks reliable…

Computation and Language · Computer Science 2026-01-23 Chunliang Chen , Ming Guan , Xiao Lin , Jiaxu Li , Luxi Lin , Qiyi Wang , Xiangyu Chen , Jixiang Luo , Changzhi Sun , Dell Zhang , Xuelong Li

Long-term memory is crucial for agents in specialized web environments, where success depends on recalling interface affordances, state dynamics, workflows, and recurring failure modes. However, existing memory benchmarks for agents mostly…

Computation and Language · Computer Science 2026-05-13 Di Wu , Zixiang Ji , Asmi Kawatkar , Bryan Kwan , Jia-Chen Gu , Nanyun Peng , Kai-Wei Chang

In recent years, large language models (LLMs) have advanced rapidly, substantially enhancing their code understanding and generation capabilities and giving rise to powerful code assistants. However, in practical repository development,…

Software Engineering · Computer Science 2026-03-09 Yang Liu , Li Zhang , Fang Liu , Ping Lin , Xinyi Li

Long-context Large Language Model (LLM) inference faces increasing compute bottlenecks as attention calculations scale with context length, primarily due to the growing KV-cache transfer overhead that saturates High Bandwidth Memory (HBM).…

Hardware Architecture · Computer Science 2025-08-13 Ming-Yen Lee , Faaiq Waqar , Hanchen Yang , Muhammed Ahosan Ul Karim , Harsono Simka , Shimeng Yu

To support long-term interaction in complex environments, LLM agents require memory systems that manage historical experiences. Existing approaches either retain full interaction histories via passive context extension, leading to…

Artificial Intelligence · Computer Science 2026-01-30 Jiaqi Liu , Yaofeng Su , Peng Xia , Siwei Han , Zeyu Zheng , Cihang Xie , Mingyu Ding , Huaxiu Yao

Large language models (LLMs) have revolutionized AI, but are constrained by limited context windows, hindering their utility in tasks like extended conversations and document analysis. To enable using context beyond limited context windows,…

Artificial Intelligence · Computer Science 2024-02-13 Charles Packer , Sarah Wooders , Kevin Lin , Vivian Fang , Shishir G. Patil , Ion Stoica , Joseph E. Gonzalez

The long-context capabilities of large language models (LLMs) have been a hot topic in recent years. To evaluate the performance of LLMs in different scenarios, various assessment benchmarks have emerged. However, as most of these…

Computation and Language · Computer Science 2025-08-14 Shawn Gavin , Tuney Zheng , Jiaheng Liu , Quehry Que , Noah Wang , Jian Yang , Chenchen Zhang , Wenhao Huang , Ge Zhang

Large language models (LLMs) excel across diverse natural language processing tasks but face resource demands and limited context windows. Although techniques like pruning, quantization, and token dropping can mitigate these issues, their…

Computation and Language · Computer Science 2025-08-04 Ammar Ahmed , Sheng Di , Franck Cappello , Zirui Liu , Jingoo Han , Ali Anwar

Large Language Models (LLMs) have demonstrated impressive capabilities in reasoning and prediction across different domains. Yet, their ability to infer temporal regularities from structured behavioral data remains underexplored. This paper…

Long-context models(LCMs) have shown great potential in processing long input sequences(even more than 100M tokens) conveniently and effectively. With significant progress, recent research has pointed out that LCMs can accurately locate…

Computation and Language · Computer Science 2024-10-25 Zecheng Tang , Zechen Sun , Juntao Li , Qiaoming Zhu , Min Zhang

Training and serving long-context large language models (LLMs) incurs substantial overhead. To address this, two critical steps are often required: a pretrained LLM typically undergoes a separate stage for context length extension by…

Computation and Language · Computer Science 2024-12-06 Suyu Ge , Xihui Lin , Yunan Zhang , Jiawei Han , Hao Peng

While reasoning over long context is crucial for various real-world applications, it remains challenging for large language models (LLMs) as they suffer from performance degradation as the context length grows. Recent work MemAgent has…

Computation and Language · Computer Science 2026-02-12 Leheng Sheng , Yongtao Zhang , Wenchang Ma , Yaorui Shi , Ting Huang , Xiang Wang , An Zhang , Ke Shen , Tat-Seng Chua

AI applications increasingly depend on long-context inference, where LLMs consume substantial context to support stronger reasoning. Common examples include retrieval-augmented generation, agent memory layers, and multi-agent orchestration.…

Machine Learning · Computer Science 2026-05-07 Yinsicheng Jiang , Yeqi Huang , Liang Cheng , Cheng Deng , Xuan Sun , Luo Mai

Memory systems often organize user-agent interactions as retrievable external memory and are crucial for long-running agents by overcoming the limited context windows of LLMs. However, existing memory systems invoke LLMs to process every…

Computation and Language · Computer Science 2026-05-18 Zijie Dai , Shiyuan Deng , Sheng Guan , Yizhou Tian , Xin Yao , Xiao Yan , James Cheng

Multiple recent studies have documented large language models' (LLMs) performance on calling external tools/functions. Others focused on LLMs' abilities to handle longer context lengths. At the intersection of these areas lies another…

Large Language Model (LLM) agents exhibit remarkable conversational and reasoning capabilities but remain constrained by limited context windows and the lack of persistent memory. Recent efforts address these limitations via external memory…

Information Retrieval · Computer Science 2026-01-07 Zhengjun Huang , Zhoujin Tian , Qintian Guo , Fangyuan Zhang , Yingli Zhou , Di Jiang , Zeying Xie , Xiaofang Zhou

Long-horizon LLM agents rely on persistent memory to support interactions across sessions, yet existing memory systems often retrieve context using semantic similarity or broad history inclusion, treating retrieved memories as uniformly…

Artificial Intelligence · Computer Science 2026-05-19 Saksham Sahai Srivastava