English

Multiple Emotion Descriptors Estimation at the ABAW3 Challenge

Computer Vision and Pattern Recognition 2022-03-30 v2

Abstract

To describe complex emotional states, psychologists have proposed multiple emotion descriptors: sparse descriptors like facial action units; continuous descriptors like valence and arousal; and discrete class descriptors like happiness and anger. According to Ekman and Friesen, 1969, facial action units are sign vehicles that convey the emotion message, while discrete or continuous emotion descriptors are the messages perceived and expressed by human. In this paper, we designed an architecture for multiple emotion descriptors estimation in participating the ABAW3 Challenge. Based on the theory of Ekman and Friesen, 1969, we designed distinct architectures to measure the sign vehicles (i.e., facial action units) and the message (i.e., discrete emotions, valence and arousal) given their different properties. The quantitative experiments on the ABAW3 challenge dataset has shown the superior performance of our approach over two baseline models.

Keywords

Cite

@article{arxiv.2203.12845,
  title  = {Multiple Emotion Descriptors Estimation at the ABAW3 Challenge},
  author = {Didan Deng},
  journal= {arXiv preprint arXiv:2203.12845},
  year   = {2022}
}

Comments

The technical report for our multi-task approach in the ABAW3 Challenge

R2 v1 2026-06-24T10:24:13.934Z