English

SENSE: Semantically Enhanced Node Sequence Embedding

Machine Learning 2019-11-11 v1 Computation and Language Machine Learning

Abstract

Effectively capturing graph node sequences in the form of vector embeddings is critical to many applications. We achieve this by (i) first learning vector embeddings of single graph nodes and (ii) then composing them to compactly represent node sequences. Specifically, we propose SENSE-S (Semantically Enhanced Node Sequence Embedding - for Single nodes), a skip-gram based novel embedding mechanism, for single graph nodes that co-learns graph structure as well as their textual descriptions. We demonstrate that SENSE-S vectors increase the accuracy of multi-label classification tasks by up to 50% and link-prediction tasks by up to 78% under a variety of scenarios using real datasets. Based on SENSE-S, we next propose generic SENSE to compute composite vectors that represent a sequence of nodes, where preserving the node order is important. We prove that this approach is efficient in embedding node sequences, and our experiments on real data confirm its high accuracy in node order decoding.

Keywords

Cite

@article{arxiv.1911.02970,
  title  = {SENSE: Semantically Enhanced Node Sequence Embedding},
  author = {Swati Rallapalli and Liang Ma and Mudhakar Srivatsa and Ananthram Swami and Heesung Kwon and Graham Bent and Christopher Simpkin},
  journal= {arXiv preprint arXiv:1911.02970},
  year   = {2019}
}
R2 v1 2026-06-23T12:08:40.891Z