English

Sockeye 3: Fast Neural Machine Translation with PyTorch

Computation and Language 2022-08-03 v4

Abstract

Sockeye 3 is the latest version of the Sockeye toolkit for Neural Machine Translation (NMT). Now based on PyTorch, Sockeye 3 provides faster model implementations and more advanced features with a further streamlined codebase. This enables broader experimentation with faster iteration, efficient training of stronger and faster models, and the flexibility to move new ideas quickly from research to production. When running comparable models, Sockeye 3 is up to 126% faster than other PyTorch implementations on GPUs and up to 292% faster on CPUs. Sockeye 3 is open source software released under the Apache 2.0 license.

Keywords

Cite

@article{arxiv.2207.05851,
  title  = {Sockeye 3: Fast Neural Machine Translation with PyTorch},
  author = {Felix Hieber and Michael Denkowski and Tobias Domhan and Barbara Darques Barros and Celina Dong Ye and Xing Niu and Cuong Hoang and Ke Tran and Benjamin Hsu and Maria Nadejde and Surafel Lakew and Prashant Mathur and Anna Currey and Marcello Federico},
  journal= {arXiv preprint arXiv:2207.05851},
  year   = {2022}
}