English

End-to-end Training and Decoding for Pivot-based Cascaded Translation Model

Computation and Language 2023-05-04 v1 Artificial Intelligence

Abstract

Utilizing pivot language effectively can significantly improve low-resource machine translation. Usually, the two translation models, source-pivot and pivot-target, are trained individually and do not utilize the limited (source, target) parallel data. This work proposes an end-to-end training method for the cascaded translation model and configures an improved decoding algorithm. The input of the pivot-target model is modified to weighted pivot embedding based on the probability distribution output by the source-pivot model. This allows the model to be trained end-to-end. In addition, we mitigate the inconsistency between tokens and probability distributions while using beam search in pivot decoding. Experiments demonstrate that our method enhances the quality of translation.

Keywords

Cite

@article{arxiv.2305.02261,
  title  = {End-to-end Training and Decoding for Pivot-based Cascaded Translation Model},
  author = {Hao Cheng and Meng Zhang and Liangyou Li and Qun Liu and Zhihua Zhang},
  journal= {arXiv preprint arXiv:2305.02261},
  year   = {2023}
}
R2 v1 2026-06-28T10:24:47.510Z