English

Emu: Enhancing Multilingual Sentence Embeddings with Semantic Specialization

Computation and Language 2019-11-26 v2 Machine Learning

Abstract

We present Emu, a system that semantically enhances multilingual sentence embeddings. Our framework fine-tunes pre-trained multilingual sentence embeddings using two main components: a semantic classifier and a language discriminator. The semantic classifier improves the semantic similarity of related sentences, whereas the language discriminator enhances the multilinguality of the embeddings via multilingual adversarial training. Our experimental results based on several language pairs show that our specialized embeddings outperform the state-of-the-art multilingual sentence embedding model on the task of cross-lingual intent classification using only monolingual labeled data.

Keywords

Cite

@article{arxiv.1909.06731,
  title  = {Emu: Enhancing Multilingual Sentence Embeddings with Semantic Specialization},
  author = {Wataru Hirota and Yoshihiko Suhara and Behzad Golshan and Wang-Chiew Tan},
  journal= {arXiv preprint arXiv:1909.06731},
  year   = {2019}
}

Comments

AAAI 2020

R2 v1 2026-06-23T11:15:34.090Z