English

Can Everybody Sign Now? Exploring Sign Language Video Generation from 2D Poses

Computer Vision and Pattern Recognition 2021-01-05 v2 Artificial Intelligence

Abstract

Recent work have addressed the generation of human poses represented by 2D/3D coordinates of human joints for sign language. We use the state of the art in Deep Learning for motion transfer and evaluate them on How2Sign, an American Sign Language dataset, to generate videos of signers performing sign language given a 2D pose skeleton. We evaluate the generated videos quantitatively and qualitatively showing that the current models are not enough to generated adequate videos for Sign Language due to lack of detail in hands.

Keywords

Cite

@article{arxiv.2012.10941,
  title  = {Can Everybody Sign Now? Exploring Sign Language Video Generation from 2D Poses},
  author = {Lucas Ventura and Amanda Duarte and Xavier Giro-i-Nieto},
  journal= {arXiv preprint arXiv:2012.10941},
  year   = {2021}
}

Comments

Video here: https://youtu.be/4ve1sGzWl2g

R2 v1 2026-06-23T21:06:32.991Z