English

Experiments with LVT and FRE for Transformer model

Computation and Language 2020-04-28 v1

Abstract

In this paper, we experiment with Large Vocabulary Trick and Feature-rich encoding applied to the Transformer model for Text Summarization. We could not achieve better results, than the analogous RNN-based sequence-to-sequence model, so we tried more models to find out, what improves the results and what deteriorates them.

Keywords

Cite

@article{arxiv.2004.12495,
  title  = {Experiments with LVT and FRE for Transformer model},
  author = {Ilshat Gibadullin and Aidar Valeev},
  journal= {arXiv preprint arXiv:2004.12495},
  year   = {2020}
}
R2 v1 2026-06-23T15:06:34.499Z