English

A Survey on Backbones for Deep Video Action Recognition

Computer Vision and Pattern Recognition 2024-05-10 v1 Artificial Intelligence

Abstract

Action recognition is a key technology in building interactive metaverses. With the rapid development of deep learning, methods in action recognition have also achieved great advancement. Researchers design and implement the backbones referring to multiple standpoints, which leads to the diversity of methods and encountering new challenges. This paper reviews several action recognition methods based on deep neural networks. We introduce these methods in three parts: 1) Two-Streams networks and their variants, which, specifically in this paper, use RGB video frame and optical flow modality as input; 2) 3D convolutional networks, which make efforts in taking advantage of RGB modality directly while extracting different motion information is no longer necessary; 3) Transformer-based methods, which introduce the model from natural language processing into computer vision and video understanding. We offer objective sights in this review and hopefully provide a reference for future research.

Keywords

Cite

@article{arxiv.2405.05584,
  title  = {A Survey on Backbones for Deep Video Action Recognition},
  author = {Zixuan Tang and Youjun Zhao and Yuhang Wen and Mengyuan Liu},
  journal= {arXiv preprint arXiv:2405.05584},
  year   = {2024}
}

Comments

This paper has been accepted by ICME workshop

R2 v1 2026-06-28T16:21:45.606Z