English

Shared Multi-modal Embedding Space for Face-Voice Association

Sound 2025-12-05 v1 Computer Vision and Pattern Recognition

Abstract

The FAME 2026 challenge comprises two demanding tasks: training face-voice associations combined with a multilingual setting that includes testing on languages on which the model was not trained. Our approach consists of separate uni-modal processing pipelines with general face and voice feature extraction, complemented by additional age-gender feature extraction to support prediction. The resulting single-modal features are projected into a shared embedding space and trained with an Adaptive Angular Margin (AAM) loss. Our approach achieved first place in the FAME 2026 challenge, with an average Equal-Error Rate (EER) of 23.99%.

Keywords

Cite

@article{arxiv.2512.04814,
  title  = {Shared Multi-modal Embedding Space for Face-Voice Association},
  author = {Christopher Simic and Korbinian Riedhammer and Tobias Bocklet},
  journal= {arXiv preprint arXiv:2512.04814},
  year   = {2025}
}

Comments

Ranked 1st in Fame 2026 Challenge, ICASSP

R2 v1 2026-07-01T08:09:33.409Z