English

PyText: A Seamless Path from NLP research to production

Computation and Language 2018-12-21 v1

Abstract

We introduce PyText - a deep learning based NLP modeling framework built on PyTorch. PyText addresses the often-conflicting requirements of enabling rapid experimentation and of serving models at scale. It achieves this by providing simple and extensible interfaces for model components, and by using PyTorch's capabilities of exporting models for inference via the optimized Caffe2 execution engine. We report our own experience of migrating experimentation and production workflows to PyText, which enabled us to iterate faster on novel modeling ideas and then seamlessly ship them at industrial scale.

Keywords

Cite

@article{arxiv.1812.08729,
  title  = {PyText: A Seamless Path from NLP research to production},
  author = {Ahmed Aly and Kushal Lakhotia and Shicong Zhao and Mrinal Mohit and Barlas Oguz and Abhinav Arora and Sonal Gupta and Christopher Dewan and Stef Nelson-Lindall and Rushin Shah},
  journal= {arXiv preprint arXiv:1812.08729},
  year   = {2018}
}
R2 v1 2026-06-23T06:51:41.850Z