English

LEAD: Breaking the No-Recovery Bottleneck in Long-Horizon Reasoning

Artificial Intelligence 2026-04-23 v2

Abstract

Long-horizon execution in Large Language Models (LLMs) remains unstable even when high-level strategies are provided. Evaluating on controlled algorithmic puzzles, we demonstrate that while decomposition is essential for stability, extreme decomposition creates a "no-recovery bottleneck". We show that this bottleneck becomes critical due to highly non-uniform error distribution, where consistent errors on a few "hard" steps become irreversible. To address this, we propose Lookahead-Enhanced Atomic Decomposition (LEAD). By incorporating short-horizon future validation and aggregating overlapping rollouts, LEAD provides enough isolation to maintain stability while retaining enough local context to correct errors. This enables the o4-mini model to solve Checkers Jumping up to complexity n=13n=13, whereas extreme decomposition fails beyond n=11n=11.

Keywords

Cite

@article{arxiv.2603.06870,
  title  = {LEAD: Breaking the No-Recovery Bottleneck in Long-Horizon Reasoning},
  author = {Denys Pushkin and Emmanuel Abbe},
  journal= {arXiv preprint arXiv:2603.06870},
  year   = {2026}
}

Comments

28 pages, 5 figures, 2 tables. Updated version to reflect the manuscript under review at COLM 2026