中文

动态手势检索:通过人体姿态序列搜索视频

计算机视觉与模式识别 2021-04-28 v2 人机交互

摘要

静态人体姿态的数量有限,仅使用单一姿态作为线索很难检索到精确的视频。然而,使用姿态序列或动态手势作为关键词,检索特定视频变得更加可行。我们提出了一种新颖的方法,用于查询包含指定人体姿态序列的视频,而以往的工作仅指定单一静态姿态。所提出的方法从关键词手势视频和候选视频中获取连续的三维人体姿态,然后将每一帧中的每个姿态转换为骨骼方向描述符,该描述符描述了关节化姿态中每个自然连接的方向。然后应用时间金字塔滑动窗口来查找指定手势与候选视频之间的匹配,这确保了持续时间不同的相同手势可以被匹配。

关键词

引用

@article{arxiv.2006.07604,
  title  = {Dynamic gesture retrieval: searching videos by human pose sequence},
  author = {Cheng Zhang},
  journal= {arXiv preprint arXiv:2006.07604},
  year   = {2021}
}

备注

The problem proposed in this article should be classified as "gesture retrieval" or "gesture detection", and there are already better algorithms to deal with the proposed problem, for example Dynamic Time Warping (DTW) based methods. The solution in this work gives little contribution to the field, so I decided to withdraw it