Efficient and Optimal Algorithms for Tree Summarization with Weighted Terminologies
Abstract
Data summarization that presents a small subset of a dataset to users has been widely applied in numerous applications and systems. Many datasets are coded with hierarchical terminologies, e.g., the international classification of Diseases-9, Medical Subject Heading, and Gene Ontology, to name a few. In this paper, we study the problem of selecting a diverse set of k elements to summarize an input dataset with hierarchical terminologies, and visualize the summary in an ontology structure. We propose an efficient greedy algorithm to solve the problem with (1-1/e) = 62% -approximation guarantee. Although this greedy solution achieves quality-guaranteed answers approximately but it is still not optimal. To tackle the problem optimally, we further develop a dynamic programming algorithm to obtain optimal answers for graph visualization of log-data using ontology terminologies called OVDO . The complexity and correctness of OVDO are theoretically analyzed. In addition, we propose a useful optimization technique of tree reduction to remove useless nodes with zero weights and shrink the tree into a smaller one, which ensures the efficiency acceleration of OVDO in many real-world applications. Extensive experimental results on real-world datasets show the effectiveness and efficiency of our proposed approximate and exact algorithms for tree data summarization.
Cite
@article{arxiv.2008.03053,
title = {Efficient and Optimal Algorithms for Tree Summarization with Weighted Terminologies},
author = {Xuliang Zhu and Xin Huang and Byron Choi and Jianliang Xu and William K. Cheung and Yanchun Zhang and Jiming Liu},
journal= {arXiv preprint arXiv:2008.03053},
year = {2021}
}