Mutual Information based labelling and comparing clusters
Abstract
After a clustering solution is generated automatically, labelling these clusters becomes important to help understanding the results. In this paper, we propose to use a Mutual Information based method to label clusters of journal articles. Topical terms which have the highest Normalised Mutual Information (NMI) with a certain cluster are selected to be the labels of the cluster. Discussion of the labelling technique with a domain expert was used as a check that the labels are discriminating not only lexical-wise but also semantically. Based on a common set of topical terms, we also propose to generate lexical fingerprints as a representation of individual clusters. Eventually, we visualise and compare these fingerprints of different clusters from either one clustering solution or different ones.
Cite
@article{arxiv.1702.08199,
title = {Mutual Information based labelling and comparing clusters},
author = {Rob Koopman and Shenghui Wang},
journal= {arXiv preprint arXiv:1702.08199},
year = {2017}
}
Comments
Special Issue of Scientometrics: Same data - different results? Towards a comparative approach to the identification of thematic structures in science