English

PARAGEN : A Parallel Generation Toolkit

Computation and Language 2022-10-10 v1
Authors: Jiangtao Feng , Yi Zhou , Jun Zhang , Xian Qian , Liwei Wu , Zhexi Zhang , Yanming Liu , Mingxuan Wang , Lei Li , Hao Zhou
View on arXiv ↗ PDF ↗

Abstract

PARAGEN is a PyTorch-based NLP toolkit for further development on parallel generation. PARAGEN provides thirteen types of customizable plugins, helping users to experiment quickly with novel ideas across model architectures, optimization, and learning strategies. We implement various features, such as unlimited data loading and automatic model selection, to enhance its industrial usage. ParaGen is now deployed to support various research and industry applications at ByteDance. PARAGEN is available at https://github.com/bytedance/ParaGen.

Keywords

software library

Cite

@article{arxiv.2210.03405,
  title  = {PARAGEN : A Parallel Generation Toolkit},
  author = {Jiangtao Feng and Yi Zhou and Jun Zhang and Xian Qian and Liwei Wu and Zhexi Zhang and Yanming Liu and Mingxuan Wang and Lei Li and Hao Zhou},
  journal= {arXiv preprint arXiv:2210.03405},
  year   = {2022}
}

Comments

9 pages, 1 figure, 6 tables

Related papers

View all related →
Machine Learning · Computer Science
PARTIME: Scalable and Parallel Processing Over Time with Deep Neural Networks
Enrico Meloni, Lapo Faggi, Simone Marullo, Alessandro Betti +3
2022-12-05
Distributed, Parallel, and Cluster Computing · Computer Science
PyTorch Distributed: Experiences on Accelerating Data Parallel Training
Shen Li, Yanli Zhao, Rohan Varma, Omkar Salpekar +7
2020-06-30
Computation and Language · Computer Science
TorchTitan: One-stop PyTorch native solution for production ready LLM pre-training
Wanchao Liang, Tianyu Liu, Less Wright, Will Constable +9
2025-06-10
Computation and Language · Computer Science
ParallelPARC: A Scalable Pipeline for Generating Natural-Language Analogies
Oren Sultan, Yonatan Bitton, Ron Yosef, Dafna Shahaf
2024-05-15
Computation and Language · Computer Science
ToolGen: Unified Tool Retrieval and Calling via Generation
Renxi Wang, Xudong Han, Lei Ji, Shu Wang +2
2025-04-01
Computation and Language · Computer Science
Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language Processing
Minh Van Nguyen, Viet Dac Lai, Amir Pouran Ben Veyseh, Thien Huu Nguyen
2021-10-18
Computation and Language · Computer Science
PyText: A Seamless Path from NLP research to production
Ahmed Aly, Kushal Lakhotia, Shicong Zhao, Mrinal Mohit +6
2018-12-21
Computation and Language · Computer Science
NLP Workbench: Efficient and Extensible Integration of State-of-the-art Text Mining Tools
Peiran Yao, Matej Kosmajac, Abeer Waheed, Kostyantyn Guzhva +2
2024-03-06
Distributed, Parallel, and Cluster Computing · Computer Science
ParaPlan: A Tool for Parallel Reachability Analysis of Planar Polygonal Differential Inclusion Systems
Andrei Sandler, Olga Tveretina
2017-09-08
Machine Learning · Computer Science
PluGeN: Multi-Label Conditional Generation From Pre-Trained Models
Maciej Wołczyk, Magdalena Proszewska, Łukasz Maziarka, Maciej Zięba +3
2022-01-05
Information Retrieval · Computer Science
Paragon: Parameter Generation for Controllable Multi-Task Recommendation
Chenglei Shen, Jiahao Zhao, Xiao Zhang, Weijie Yu +2
2025-08-07
Methodology · Statistics
Sparklen: A Statistical Learning Toolkit for High-Dimensional Hawkes Processes in Python
Romain Edmond Lacoste
2025-03-31
Distributed, Parallel, and Cluster Computing · Computer Science
ParaGAN: A Scalable Distributed Training Framework for Generative Adversarial Networks
Ziji Shi, Jialin Li, Yang You
2024-11-07
Hardware Architecture · Computer Science
PyHGL: A Python-based Hardware Generation Language Framework
Jintao Sun, Zeke Wang, Tao Lu, Wenzhi Chen
2023-09-12
Software Engineering · Computer Science
TPGen: A Self-Stabilizing GPU-Based Method for Prime and Test Paths Generation
Ebrahim Fazli, Ali Ebnenasir
2022-11-01
Machine Learning · Computer Science
CNNLab: a Novel Parallel Framework for Neural Networks using GPU and FPGA-a Practical Study with Trade-off Analysis
Maohua Zhu, Liu Liu, Chao Wang, Yuan Xie
2016-06-21
Computation and Language · Computer Science
PyPLN: a Distributed Platform for Natural Language Processing
Flávio Codeço Coelho, Renato Rocha Souza, Álvaro Justen, Flávio Amieiro +1
2013-02-20
Machine Learning · Computer Science
HYPPO: A Surrogate-Based Multi-Level Parallelism Tool for Hyperparameter Optimization
Vincent Dumont, Casey Garner, Anuradha Trivedi, Chelsea Jones +5
2022-01-03
Computational Physics · Physics
PRAND: GPU accelerated parallel random number generation library: Using most reliable algorithms and applying parallelism of modern GPUs and CPUs
L. Yu. Barash, L. N. Shchur
2014-02-18
Machine Learning · Computer Science
Communication-Efficient Diffusion Denoising Parallelization via Reuse-then-Predict Mechanism
Kunyun Wang, Bohan Li, Kai Yu, Minyi Guo +1
2025-10-14
Machine Learning · Computer Science
Generating Multidimensional Clusters With Support Lines
Nuno Fachada, Diogo de Andrade
2024-03-06
Information Retrieval · Computer Science
PushGen: Push Notifications Generation with LLM
Shifu Bie, Jiangxia Cao, Zixiao Luo, Yichuan Zou +8
2025-12-17
Computation and Language · Computer Science
TabGenie: A Toolkit for Table-to-Text Generation
Zdeněk Kasner, Ekaterina Garanina, Ondřej Plátek, Ondřej Dušek
2023-10-27
Computer Vision and Pattern Recognition · Computer Science
PolyGen: Fully Synthetic Vision-Language Training via Multi-Generator Ensembles
Leonardo Brusini, Cristian Sbrolli, Eugenio Lomurno, Toshihiko Yamasaki +1
2026-02-03
Computation · Statistics
clrng: A tool set for parallel random numbergeneration on GPUs in R
Ruoyong Xu, Patrick Brown, Pierre L'Ecuyer
2024-04-16
R2 v1 2026-06-28T02:59:14.661Z