English

Quantified Facial Expressiveness for Affective Behavior Analytics

Computer Vision and Pattern Recognition 2021-10-08 v2

Abstract

The quantified measurement of facial expressiveness is crucial to analyze human affective behavior at scale. Unfortunately, methods for expressiveness quantification at the video frame-level are largely unexplored, unlike the study of discrete expression. In this work, we propose an algorithm that quantifies facial expressiveness using a bounded, continuous expressiveness score using multimodal facial features, such as action units (AUs), landmarks, head pose, and gaze. The proposed algorithm more heavily weights AUs with high intensities and large temporal changes. The proposed algorithm can compute the expressiveness in terms of discrete expression, and can be used to perform tasks including facial behavior tracking and subjectivity quantification in context. Our results on benchmark datasets show the proposed algorithm is effective in terms of capturing temporal changes and expressiveness, measuring subjective differences in context, and extracting useful insight.

Keywords

Cite

@article{arxiv.2110.01758,
  title  = {Quantified Facial Expressiveness for Affective Behavior Analytics},
  author = {Md Taufeeq Uddin and Shaun Canavan},
  journal= {arXiv preprint arXiv:2110.01758},
  year   = {2021}
}

Comments

IEEE/CVF Winter Conference on Applications of Computer Vision (WACV). 2022

R2 v1 2026-06-24T06:37:20.389Z