English

Data Distribution Distilled Generative Model for Generalized Zero-Shot Recognition

Computer Vision and Pattern Recognition 2024-02-20 v1 Artificial Intelligence

Abstract

In the realm of Zero-Shot Learning (ZSL), we address biases in Generalized Zero-Shot Learning (GZSL) models, which favor seen data. To counter this, we introduce an end-to-end generative GZSL framework called D3^3GZSL. This framework respects seen and synthesized unseen data as in-distribution and out-of-distribution data, respectively, for a more balanced model. D3^3GZSL comprises two core modules: in-distribution dual space distillation (ID2^2SD) and out-of-distribution batch distillation (O2^2DBD). ID2^2SD aligns teacher-student outcomes in embedding and label spaces, enhancing learning coherence. O2^2DBD introduces low-dimensional out-of-distribution representations per batch sample, capturing shared structures between seen and unseen categories. Our approach demonstrates its effectiveness across established GZSL benchmarks, seamlessly integrating into mainstream generative frameworks. Extensive experiments consistently showcase that D3^3GZSL elevates the performance of existing generative GZSL methods, underscoring its potential to refine zero-shot learning practices.The code is available at: https://github.com/PJBQ/D3GZSL.git

Keywords

Cite

@article{arxiv.2402.11424,
  title  = {Data Distribution Distilled Generative Model for Generalized Zero-Shot Recognition},
  author = {Yijie Wang and Mingjian Hong and Luwen Huangfu and Sheng Huang},
  journal= {arXiv preprint arXiv:2402.11424},
  year   = {2024}
}

Comments

accepted as AAAI 2024 oral paper

R2 v1 2026-06-28T14:52:02.935Z