English

RDM: Recurrent Diffusion Model for Human Motion Generation

Computer Vision and Pattern Recognition 2026-03-10 v2

Abstract

Human motion generation is a challenging task due to its high dimensionality and the difficulty of generating fine-grained motions. Diffusion methods have been proposed due to their high sample quality and expressiveness. Early approaches treat the entire sequence as a whole, which is computationally expensive and restricts sequence length. In contrast, autoregressive diffusion models generate longer sequences. However, their reliance on fully denoising previous frames complicates training and inference. Consequently, we propose \textit{RDM}, a new recurrent diffusion formulation similar to Recurrent Neural Networks (RNNs).RDMs explicitly condition diffusion processes on preceding noisy frames, avoiding the cost of full denoising. Nonetheless, maintaining its probabilistic nature is non-trivial. Therefore, we employ Normalizing Flows to model recurrent connections. Our evaluations demonstrate RDM's effectiveness: it achieves comparable performance to autoregressive baselines and generates long sequences that remain aligned with the text. RDM also skips diffusion steps during inference, significantly reducing computational cost.

Keywords

Cite

@article{arxiv.2406.07169,
  title  = {RDM: Recurrent Diffusion Model for Human Motion Generation},
  author = {Mirgahney Mohamed and Harry Jake Cunningham and Marc P. Deisenroth and Lourdes Agapito},
  journal= {arXiv preprint arXiv:2406.07169},
  year   = {2026}
}

Comments

v2: Major revision with extensive text polishing and structural updates. Added new experiments on the rollout effect, specifically analyzing the trade-offs between compute time and sequence length. Includes several new visualizations (Figures 6, 9, 10) and an expanded discussion in Section 4

R2 v1 2026-06-28T17:01:17.678Z