English

Distilling Hypernymy Relations from Language Models: On the Effectiveness of Zero-Shot Taxonomy Induction

Computation and Language 2022-02-11 v1 Artificial Intelligence

Abstract

In this paper, we analyze zero-shot taxonomy learning methods which are based on distilling knowledge from language models via prompting and sentence scoring. We show that, despite their simplicity, these methods outperform some supervised strategies and are competitive with the current state-of-the-art under adequate conditions. We also show that statistical and linguistic properties of prompts dictate downstream performance.

Keywords

Cite

@article{arxiv.2202.04876,
  title  = {Distilling Hypernymy Relations from Language Models: On the Effectiveness of Zero-Shot Taxonomy Induction},
  author = {Devansh Jain and Luis Espinosa Anke},
  journal= {arXiv preprint arXiv:2202.04876},
  year   = {2022}
}