English

T$^\star$: Progressive Block Scaling for Masked Diffusion Language Models Through Trajectory Aware Reinforcement Learning

Computation and Language 2026-03-30 v4

Abstract

We present T^\star, a simple TraceRL-based training curriculum for progressive block-size scaling in masked diffusion language models (MDMs). Starting from an AR-initialized small-block MDM, T^\star transitions smoothly to larger blocks, enabling higher-parallelism decoding with minimal performance degradation on math reasoning benchmarks. Moreover, further analysis suggests that T^\star may actually converge to an alternative decoding schedule that achieves comparable performance.

Cite

@article{arxiv.2601.11214,
  title  = {T$^\star$: Progressive Block Scaling for Masked Diffusion Language Models Through Trajectory Aware Reinforcement Learning},
  author = {Hanchen Xia and Baoyou Chen and Yutang Ge and Guojiang Zhao and Siyu Zhu},
  journal= {arXiv preprint arXiv:2601.11214},
  year   = {2026}
}
R2 v1 2026-07-01T09:07:26.354Z