English

A Personalized Affective Memory Neural Model for Improving Emotion Recognition

Computer Vision and Pattern Recognition 2020-06-02 v2 Artificial Intelligence

Abstract

Recent models of emotion recognition strongly rely on supervised deep learning solutions for the distinction of general emotion expressions. However, they are not reliable when recognizing online and personalized facial expressions, e.g., for person-specific affective understanding. In this paper, we present a neural model based on a conditional adversarial autoencoder to learn how to represent and edit general emotion expressions. We then propose Grow-When-Required networks as personalized affective memories to learn individualized aspects of emotion expressions. Our model achieves state-of-the-art performance on emotion recognition when evaluated on \textit{in-the-wild} datasets. Furthermore, our experiments include ablation studies and neural visualizations in order to explain the behavior of our model.

Keywords

Cite

@article{arxiv.1904.12632,
  title  = {A Personalized Affective Memory Neural Model for Improving Emotion Recognition},
  author = {Pablo Barros and German I. Parisi and Stefan Wermter},
  journal= {arXiv preprint arXiv:1904.12632},
  year   = {2020}
}

Comments

Accepted by the International Conference on Machine Learning 2019 (ICML2019)

R2 v1 2026-06-23T08:52:11.224Z