English

FBS: Modeling Native Parallel Reading inside a Transformer

Artificial Intelligence 2026-04-09 v2 Computation and Language

Abstract

Large language models (LLMs) excel across many tasks, yet inference is still dominated by strictly token-by-token autoregression. Existing acceleration methods largely patch this pipeline and miss core human-reading ingredients: content-adaptive foresight, chunk-structure-aware compute allocation, and train-test consistency for preview/skimming. We propose the Fovea-Block-Skip Transformer (FBS), which injects a causal, trainable loop into Transformers via Parafovea-Attention Window (PAW), Chunk-Head (CH), and Skip-Gate (SG). Across diverse benchmarks, FBS improves the quality-efficiency trade-off without increasing parameters, and ablations show the three modules are complementary.

Keywords

Cite

@article{arxiv.2601.21708,
  title  = {FBS: Modeling Native Parallel Reading inside a Transformer},
  author = {Tongxi Wang},
  journal= {arXiv preprint arXiv:2601.21708},
  year   = {2026}
}

Comments

Accept to ACL2026 as findings

R2 v1 2026-07-01T09:25:42.160Z