English

Conversational Question Answering over Knowledge Graphs with Transformer and Graph Attention Networks

Computation and Language 2021-06-25 v2

Abstract

This paper addresses the task of (complex) conversational question answering over a knowledge graph. For this task, we propose LASAGNE (muLti-task semAntic parSing with trAnsformer and Graph atteNtion nEtworks). It is the first approach, which employs a transformer architecture extended with Graph Attention Networks for multi-task neural semantic parsing. LASAGNE uses a transformer model for generating the base logical forms, while the Graph Attention model is used to exploit correlations between (entity) types and predicates to produce node representations. LASAGNE also includes a novel entity recognition module which detects, links, and ranks all relevant entities in the question context. We evaluate LASAGNE on a standard dataset for complex sequential question answering, on which it outperforms existing baseline averages on all question types. Specifically, we show that LASAGNE improves the F1-score on eight out of ten question types; in some cases, the increase in F1-score is more than 20% compared to the state of the art.

Keywords

Cite

@article{arxiv.2104.01569,
  title  = {Conversational Question Answering over Knowledge Graphs with Transformer and Graph Attention Networks},
  author = {Endri Kacupaj and Joan Plepi and Kuldeep Singh and Harsh Thakkar and Jens Lehmann and Maria Maleshkova},
  journal= {arXiv preprint arXiv:2104.01569},
  year   = {2021}
}

Comments

16th conference of the European Chapter of the Association for Computational Linguistics (EACL 2021)

R2 v1 2026-06-24T00:50:10.682Z