English

LH-Mix: Local Hierarchy Correlation Guided Mixup over Hierarchical Prompt Tuning

Computation and Language 2025-02-25 v2

Abstract

Hierarchical text classification (HTC) aims to assign one or more labels in the hierarchy for each text. Many methods represent this structure as a global hierarchy, leading to redundant graph structures. To address this, incorporating a text-specific local hierarchy is essential. However, existing approaches often model this local hierarchy as a sequence, focusing on explicit parent-child relationships while ignoring implicit correlations among sibling/peer relationships. In this paper, we first integrate local hierarchies into a manual depth-level prompt to capture parent-child relationships. We then apply Mixup to this hierarchical prompt tuning scheme to improve the latent correlation within sibling/peer relationships. Notably, we propose a novel Mixup ratio guided by local hierarchy correlation to effectively capture intrinsic correlations. This Local Hierarchy Mixup (LH-Mix) model demonstrates remarkable performance across three widely-used datasets.

Keywords

Cite

@article{arxiv.2412.16963,
  title  = {LH-Mix: Local Hierarchy Correlation Guided Mixup over Hierarchical Prompt Tuning},
  author = {Fanshuang Kong and Richong Zhang and Ziqiao Wang},
  journal= {arXiv preprint arXiv:2412.16963},
  year   = {2025}
}

Comments

Accepted by KDD 2025