English

Next-Scale Autoregressive Models for Text-to-Motion Generation

Computer Vision and Pattern Recognition 2026-05-28 v2

Abstract

Autoregressive (AR) models offer stable and efficient training, but standard next-token prediction is not well aligned with the temporal structure required for text-conditioned motion generation. We introduce MoScale, a next-scale AR framework that generates motion hierarchically from coarse to fine temporal resolutions. By providing global semantics at the coarsest scale and refining them progressively, MoScale establishes a causal hierarchy better suited for long-range motion structure. To improve robustness under limited text-motion data, we further incorporate cross-scale hierarchical refinement for improving per-scale initial predictions and in-scale temporal refinement for selective bidirectional re-prediction. MoScale achieves SOTA text-to-motion performance with high training efficiency, scales effectively with model size, and generalizes zero-shot to diverse motion generation and editing tasks.

Keywords

Cite

@article{arxiv.2604.03799,
  title  = {Next-Scale Autoregressive Models for Text-to-Motion Generation},
  author = {Zhiwei Zheng and Shibo Jin and Lingjie Liu and Mingmin Zhao},
  journal= {arXiv preprint arXiv:2604.03799},
  year   = {2026}
}

Comments

Accepted to CVPR 2026

R2 v1 2026-07-01T11:53:59.340Z