English

REM-Net: Recursive Erasure Memory Network for Commonsense Evidence Refinement

Computation and Language 2021-03-26 v3 Artificial Intelligence

Abstract

When answering a question, people often draw upon their rich world knowledge in addition to the particular context. While recent works retrieve supporting facts/evidence from commonsense knowledge bases to supply additional information to each question, there is still ample opportunity to advance it on the quality of the evidence. It is crucial since the quality of the evidence is the key to answering commonsense questions, and even determines the upper bound on the QA systems performance. In this paper, we propose a recursive erasure memory network (REM-Net) to cope with the quality improvement of evidence. To address this, REM-Net is equipped with a module to refine the evidence by recursively erasing the low-quality evidence that does not explain the question answering. Besides, instead of retrieving evidence from existing knowledge bases, REM-Net leverages a pre-trained generative model to generate candidate evidence customized for the question. We conduct experiments on two commonsense question answering datasets, WIQA and CosmosQA. The results demonstrate the performance of REM-Net and show that the refined evidence is explainable.

Keywords

Cite

@article{arxiv.2012.13185,
  title  = {REM-Net: Recursive Erasure Memory Network for Commonsense Evidence Refinement},
  author = {Yinya Huang and Meng Fang and Xunlin Zhan and Qingxing Cao and Xiaodan Liang and Liang Lin},
  journal= {arXiv preprint arXiv:2012.13185},
  year   = {2021}
}

Comments

Accepted by AAAI 2021

R2 v1 2026-06-23T21:22:05.726Z