English

mmPred: Radar-based Human Motion Prediction in the Dark

Computer Vision and Pattern Recognition 2025-12-02 v1

Abstract

Existing Human Motion Prediction (HMP) methods based on RGB-D cameras are sensitive to lighting conditions and raise privacy concerns, limiting their real-world applications such as firefighting and healthcare. Motivated by the robustness and privacy-preserving nature of millimeter-wave (mmWave) radar, this work introduces radar as a novel sensing modality for HMP, for the first time. Nevertheless, radar signals often suffer from specular reflections and multipath effects, resulting in noisy and temporally inconsistent measurements, such as body-part miss-detection. To address these radar-specific artifacts, we propose mmPred, the first diffusion-based framework tailored for radar-based HMP. mmPred introduces a dual-domain historical motion representation to guide the generation process, combining a Time-domain Pose Refinement (TPR) branch for learning fine-grained details and a Frequency-domain Dominant Motion (FDM) branch for capturing global motion trends and suppressing frame-level inconsistency. Furthermore, we design a Global Skeleton-relational Transformer (GST) as the diffusion backbone to model global inter-joint cooperation, enabling corrupted joints to dynamically aggregate information from others. Extensive experiments show that mmPred achieves state-of-the-art performance, outperforming existing methods by 8.6% on mmBody and 22% on mm-Fi.

Keywords

Cite

@article{arxiv.2512.00345,
  title  = {mmPred: Radar-based Human Motion Prediction in the Dark},
  author = {Junqiao Fan and Haocong Rao and Jiarui Zhang and Jianfei Yang and Lihua Xie},
  journal= {arXiv preprint arXiv:2512.00345},
  year   = {2025}
}

Comments

This paper is accepted by AAAI-2026

R2 v1 2026-07-01T08:00:34.838Z