English

Facial Emotion Recognition on FER-2013 using an EfficientNetB2-Based Approach

Computer Vision and Pattern Recognition 2026-01-27 v1 Machine Learning

Abstract

Detection of human emotions based on facial images in real-world scenarios is a difficult task due to low image quality, variations in lighting, pose changes, background distractions, small inter-class variations, noisy crowd-sourced labels, and severe class imbalance, as observed in the FER-2013 dataset of 48x48 grayscale images. Although recent approaches using large CNNs such as VGG and ResNet achieve reasonable accuracy, they are computationally expensive and memory-intensive, limiting their practicality for real-time applications. We address these challenges using a lightweight and efficient facial emotion recognition pipeline based on EfficientNetB2, trained using a two-stage warm-up and fine-tuning strategy. The model is enhanced with AdamW optimization, decoupled weight decay, label smoothing (epsilon = 0.06) to reduce annotation noise, and clipped class weights to mitigate class imbalance, along with dropout, mixed-precision training, and extensive real-time data augmentation. The model is trained using a stratified 87.5%/12.5% train-validation split while keeping the official test set intact, achieving a test accuracy of 68.78% with nearly ten times fewer parameters than VGG16-based baselines. Experimental results, including per-class metrics and learning dynamics, demonstrate stable training and strong generalization, making the proposed approach suitable for real-time and edge-based applications.

Keywords

Cite

@article{arxiv.2601.18228,
  title  = {Facial Emotion Recognition on FER-2013 using an EfficientNetB2-Based Approach},
  author = {Sahil Naik and Soham Bagayatkar and Pavankumar Singh},
  journal= {arXiv preprint arXiv:2601.18228},
  year   = {2026}
}

Comments

6 pages, 4 figures

R2 v1 2026-07-01T09:19:49.321Z