English

Lights, Camera, Matching: The Role of Image Illumination in Fair Face Recognition

Computer Vision and Pattern Recognition 2025-01-16 v1

Abstract

Facial brightness is a key image quality factor impacting face recognition accuracy differentials across demographic groups. In this work, we aim to decrease the accuracy gap between the similarity score distributions for Caucasian and African American female mated image pairs, as measured by d' between distributions. To balance brightness across demographic groups, we conduct three experiments, interpreting brightness in the face skin region either as median pixel value or as the distribution of pixel values. Balancing based on median brightness alone yields up to a 46.8% decrease in d', while balancing based on brightness distribution yields up to a 57.6% decrease. In all three cases, the similarity scores of the individual distributions improve, with mean scores maximally improving 5.9% for Caucasian females and 3.7% for African American females.

Keywords

Cite

@article{arxiv.2501.08910,
  title  = {Lights, Camera, Matching: The Role of Image Illumination in Fair Face Recognition},
  author = {Gabriella Pangelinan and Grace Bezold and Haiyu Wu and Michael C. King and Kevin W. Bowyer},
  journal= {arXiv preprint arXiv:2501.08910},
  year   = {2025}
}

Comments

14 pages, 11 figures, Conference submission