English

Context Discipline and Performance Correlation: Analyzing LLM Performance and Quality Degradation Under Varying Context Lengths

Computation and Language 2026-01-21 v1 Artificial Intelligence

Abstract

The scaling trend in Large Language Models (LLMs) has prioritized increasing the maximum context window to facilitate complex, long-form reasoning and document analysis. However, managing this expanded context introduces severe computational overhead. This paper investigates the critical trade-off between system performance and model quality when dense transformer architectures--specifically Llama-3.1-70B and Qwen1.5-14B--are exposed to large volumes of irrelevant and distracting context. The research identifies a non-linear performance degradation tied to the growth of the Key-Value (KV) cache. Furthermore, an extended analysis of the Mixture-of-Experts (MoE) architecture reveals unique behavioral anomalies at varying context scales, suggesting that architectural benefits may be masked by infrastructure bottlenecks at high token volumes.

Keywords

Cite

@article{arxiv.2601.11564,
  title  = {Context Discipline and Performance Correlation: Analyzing LLM Performance and Quality Degradation Under Varying Context Lengths},
  author = {Ahilan Ayyachamy Nadar Ponnusamy and Karthic Chandran and M Maruf Hossain},
  journal= {arXiv preprint arXiv:2601.11564},
  year   = {2026}
}

Comments

22 pages, 6 figures

R2 v1 2026-07-01T09:08:04.932Z