English

Approaching Neural Chinese Word Segmentation as a Low-Resource Machine Translation Task

Computation and Language 2022-10-12 v3

Abstract

Chinese word segmentation has entered the deep learning era which greatly reduces the hassle of feature engineering. Recently, some researchers attempted to treat it as character-level translation, which further simplified model designing, but there is a performance gap between the translation-based approach and other methods. This motivates our work, in which we apply the best practices from low-resource neural machine translation to supervised Chinese segmentation. We examine a series of techniques including regularization, data augmentation, objective weighting, transfer learning, and ensembling. Compared to previous works, our low-resource translation-based method maintains the effortless model design, yet achieves the same result as state of the art in the constrained evaluation without using additional data.

Keywords

Cite

@article{arxiv.2008.05348,
  title  = {Approaching Neural Chinese Word Segmentation as a Low-Resource Machine Translation Task},
  author = {Pinzhen Chen and Kenneth Heafield},
  journal= {arXiv preprint arXiv:2008.05348},
  year   = {2022}
}

Comments

PACLIC 2022

R2 v1 2026-06-23T17:48:31.632Z