English

EMO-X: Efficient Multi-Person Pose and Shape Estimation in One-Stage

Computer Vision and Pattern Recognition 2025-12-01 v2

Abstract

Expressive Human Pose and Shape Estimation (EHPS) aims to jointly estimate human pose, hand gesture, and facial expression from monocular images. Existing methods predominantly rely on Transformer-based architectures, which suffer from quadratic complexity in self-attention, leading to substantial computational overhead, especially in multi-person scenarios. Recently, Mamba has emerged as a promising alternative to Transformers due to its efficient global modeling capability. However, it remains limited in capturing fine-grained local dependencies, which are essential for precise EHPS. To address these issues, we propose EMO-X, the Efficient Multi-person One-stage model for multi-person EHPS. Specifically, we explore a Scan-based Global-Local Decoder (SGLD) that integrates global context with skeleton-aware local features to iteratively enhance human tokens. Our EMO-X leverages the superior global modeling capability of Mamba and designs a local bidirectional scan mechanism for skeleton-aware local refinement. Comprehensive experiments demonstrate that EMO-X strikes an excellent balance between efficiency and accuracy. Notably, it achieves a significant reduction in computational complexity, requiring 69.8% less inference time compared to state-of-the-art (SOTA) methods, while outperforming most of them in accuracy.

Keywords

Cite

@article{arxiv.2504.08718,
  title  = {EMO-X: Efficient Multi-Person Pose and Shape Estimation in One-Stage},
  author = {Haohang Jian and Jinlu Zhang and Junyi Wu and Zhigang Tu},
  journal= {arXiv preprint arXiv:2504.08718},
  year   = {2025}
}

Comments

The manuscript is being revised to include new experimental results and an improved model architecture

R2 v1 2026-06-28T22:55:08.874Z