English

Interpretable Few-Shot Image Classification via Prototypical Concept-Guided Mixture of LoRA Experts

Computer Vision and Pattern Recognition 2025-06-06 v1

Abstract

Self-Explainable Models (SEMs) rely on Prototypical Concept Learning (PCL) to enable their visual recognition processes more interpretable, but they often struggle in data-scarce settings where insufficient training samples lead to suboptimal performance.To address this limitation, we propose a Few-Shot Prototypical Concept Classification (FSPCC) framework that systematically mitigates two key challenges under low-data regimes: parametric imbalance and representation misalignment. Specifically, our approach leverages a Mixture of LoRA Experts (MoLE) for parameter-efficient adaptation, ensuring a balanced allocation of trainable parameters between the backbone and the PCL module.Meanwhile, cross-module concept guidance enforces tight alignment between the backbone's feature representations and the prototypical concept activation patterns.In addition, we incorporate a multi-level feature preservation strategy that fuses spatial and semantic cues across various layers, thereby enriching the learned representations and mitigating the challenges posed by limited data availability.Finally, to enhance interpretability and minimize concept overlap, we introduce a geometry-aware concept discrimination loss that enforces orthogonality among concepts, encouraging more disentangled and transparent decision boundaries.Experimental results on six popular benchmarks (CUB-200-2011, mini-ImageNet, CIFAR-FS, Stanford Cars, FGVC-Aircraft, and DTD) demonstrate that our approach consistently outperforms existing SEMs by a notable margin, with 4.2%-8.7% relative gains in 5-way 5-shot classification.These findings highlight the efficacy of coupling concept learning with few-shot adaptation to achieve both higher accuracy and clearer model interpretability, paving the way for more transparent visual recognition systems.

Keywords

Cite

@article{arxiv.2506.04673,
  title  = {Interpretable Few-Shot Image Classification via Prototypical Concept-Guided Mixture of LoRA Experts},
  author = {Zhong Ji and Rongshuai Wei and Jingren Liu and Yanwei Pang and Jungong Han},
  journal= {arXiv preprint arXiv:2506.04673},
  year   = {2025}
}

Comments

13 pages,5 figures

R2 v1 2026-07-01T03:00:43.480Z