English

Transfer Learning for Pose Estimation of Illustrated Characters

Computer Vision and Pattern Recognition 2021-12-02 v3

Abstract

Human pose information is a critical component in many downstream image processing tasks, such as activity recognition and motion tracking. Likewise, a pose estimator for the illustrated character domain would provide a valuable prior for assistive content creation tasks, such as reference pose retrieval and automatic character animation. But while modern data-driven techniques have substantially improved pose estimation performance on natural images, little work has been done for illustrations. In our work, we bridge this domain gap by efficiently transfer-learning from both domain-specific and task-specific source models. Additionally, we upgrade and expand an existing illustrated pose estimation dataset, and introduce two new datasets for classification and segmentation subtasks. We then apply the resultant state-of-the-art character pose estimator to solve the novel task of pose-guided illustration retrieval. All data, models, and code will be made publicly available.

Keywords

Cite

@article{arxiv.2108.01819,
  title  = {Transfer Learning for Pose Estimation of Illustrated Characters},
  author = {Shuhong Chen and Matthias Zwicker},
  journal= {arXiv preprint arXiv:2108.01819},
  year   = {2021}
}

Comments

published at WACV2022

R2 v1 2026-06-24T04:48:40.417Z