English

Layer-Wise Analysis of Self-Supervised Representations for Age and Gender Classification in Children's Speech

Audio and Speech Processing 2025-08-15 v1 Artificial Intelligence Human-Computer Interaction Machine Learning Sound

Abstract

Children's speech presents challenges for age and gender classification due to high variability in pitch, articulation, and developmental traits. While self-supervised learning (SSL) models perform well on adult speech tasks, their ability to encode speaker traits in children remains underexplored. This paper presents a detailed layer-wise analysis of four Wav2Vec2 variants using the PFSTAR and CMU Kids datasets. Results show that early layers (1-7) capture speaker-specific cues more effectively than deeper layers, which increasingly focus on linguistic information. Applying PCA further improves classification, reducing redundancy and highlighting the most informative components. The Wav2Vec2-large-lv60 model achieves 97.14% (age) and 98.20% (gender) on CMU Kids; base-100h and large-lv60 models reach 86.05% and 95.00% on PFSTAR. These results reveal how speaker traits are structured across SSL model depth and support more targeted, adaptive strategies for child-aware speech interfaces.

Keywords

Cite

@article{arxiv.2508.10332,
  title  = {Layer-Wise Analysis of Self-Supervised Representations for Age and Gender Classification in Children's Speech},
  author = {Abhijit Sinha and Harishankar Kumar and Mohit Joshi and Hemant Kumar Kathania and Shrikanth Narayanan and Sudarsana Reddy Kadiri},
  journal= {arXiv preprint arXiv:2508.10332},
  year   = {2025}
}

Comments

Accepted at Workshop on Child Computer Interaction (WOCCI 2025)