English

Facial Expression Classification using Fusion of Deep Neural Network in Video for the 3rd ABAW3 Competition

Computer Vision and Pattern Recognition 2022-04-11 v3 Image and Video Processing

Abstract

For computers to recognize human emotions, expression classification is an equally important problem in the human-computer interaction area. In the 3rd Affective Behavior Analysis In-The-Wild competition, the task of expression classification includes eight classes with six basic expressions of human faces from videos. In this paper, we employ a transformer mechanism to encode the robust representation from the backbone. Fusion of the robust representations plays an important role in the expression classification task. Our approach achieves 30.35\% and 28.60\% for the F1F_1 score on the validation set and the test set, respectively. This result shows the effectiveness of the proposed architecture based on the Aff-Wild2 dataset.

Keywords

Cite

@article{arxiv.2203.12899,
  title  = {Facial Expression Classification using Fusion of Deep Neural Network in Video for the 3rd ABAW3 Competition},
  author = {Kim Ngan Phan and Hong-Hai Nguyen and Van-Thong Huynh and Soo-Hyung Kim},
  journal= {arXiv preprint arXiv:2203.12899},
  year   = {2022}
}