Multi-label image classification is a critical task in machine learning that aims to accurately assign multiple labels to a single image. While existing methods often utilize attention mechanisms or graph convolutional networks to model visual representations, their performance is still constrained by two critical limitations: the inability to learn discriminative semantic-aware features, and the lack of fine-grained alignment between visual representations and label embeddings. To tackle these issues in a unified framework, this paper proposes a novel approach named Semantic-aware representation learning via Conditional Transport for Multi-Label Image Classification (SCT). The proposed method introduces a semantic-related feature learning module that extracts discriminative label-specific features by emphasizing semantic relevance and interaction, along with a conditional transport-based alignment mechanism that enables precise visual-semantic alignment. Extensive experiments on two widely-used benchmark datasets, VOC2007 and MS-COCO, validate the effectiveness of SCT and demonstrate its superior performance compared to existing state-of-the-art methods.
@article{arxiv.2507.14918,
title = {Semantic-Aware Representation Learning via Conditional Transport for Multi-Label Image Classification},
author = {Ren-Dong Xie and Zhi-Fen He and Bo Li and Bin Liu and Jin-Yan Hu},
journal= {arXiv preprint arXiv:2507.14918},
year = {2025}
}
Comments
The paper is under consideration at Pattern Recognition Letters