English

ATLAS-RTC: Closing the Loop on LLM Agent Output with Token-Level Runtime Control

Machine Learning 2026-04-07 v2

Abstract

We present ATLAS-RTC, a runtime control system for autoregressive language models that enforces structured output during decoding. ATLAS-RTC monitors generation at each step, detects drift from output contracts using lightweight signals, and applies targeted interventions such as biasing, masking, and rollback. Unlike post-hoc validation or static constrained decoding, it operates in a closed loop, enabling correction before errors materialize. Across structured generation and tool-calling tasks, ATLAS-RTC improves first-attempt success rates by 20 to 37.8 percentage points, with up to 88% latency reduction in failure-dominated settings. Results show that many failures arise from decoding artifacts rather than task misunderstanding, motivating runtime control as a distinct layer in LLM systems.

Keywords

Cite

@article{arxiv.2603.27905,
  title  = {ATLAS-RTC: Closing the Loop on LLM Agent Output with Token-Level Runtime Control},
  author = {Christopher Cruz},
  journal= {arXiv preprint arXiv:2603.27905},
  year   = {2026}
}
R2 v1 2026-07-01T11:43:13.465Z