Distributed, Parallel, and Cluster Computing · Computer Science
PipeMare: Asynchronous Pipeline Parallel DNN Training
Bowen Yang, Jian Zhang, Jonathan Li, Christopher Ré +2
2020-02-11
Machine Learning · Computer Science
PipeOffload: Improving Scalability of Pipeline Parallelism with Memory Optimization
Xinyi Wan, Penghui Qi, Guangxing Huang, Min Lin +1
2025-07-01
Distributed, Parallel, and Cluster Computing · Computer Science
DawnPiper: A Memory-scablable Pipeline Parallel Training Framework
Xuan Peng, Xuanhua Shi, Haolin Zhang, Yunfei Zhao +1
2025-05-12
Distributed, Parallel, and Cluster Computing · Computer Science
OptPipe: Memory- and Scheduling-Optimized Pipeline Parallelism for LLM Training
Hongpei Li, Han Zhang, Huikang Liu, Dongdong Ge +1
2025-10-08
Distributed, Parallel, and Cluster Computing · Computer Science
PiPar: Pipeline Parallelism for Collaborative Machine Learning
Zihan Zhang, Philip Rodgers, Peter Kilpatrick, Ivor Spence +1
2024-06-26
Machine Learning · Computer Science
Pipeline Parallelism with Controllable Memory
Penghui Qi, Xinyi Wan, Nyamdavaa Amar, Min Lin
2024-11-05
Distributed, Parallel, and Cluster Computing · Computer Science
Accelerating Microswimmer Simulations via a Heterogeneous Pipelined Parallel-in-Time Framework
Ruixiang Huang, Weifan Liu
2026-04-15
Distributed, Parallel, and Cluster Computing · Computer Science
A Decentralized Parallelization-in-Time Approach with Parareal
Martin Schreiber, Adam Peddle, Terry Haut, Beth Wingate
2016-03-01
Distributed, Parallel, and Cluster Computing · Computer Science
Balancing Pipeline Parallelism with Vocabulary Parallelism
Man Tsung Yeung, Penghui Qi, Min Lin, Xinyi Wan
2025-05-06
Computational Physics · Physics
A hybrid MPI-OpenMP scheme for scalable parallel pseudospectral computations for fluid turbulence
Pablo D. Mininni, Duane L. Rosenberg, Raghu Reddy, Annick Pouquet
2010-03-24
Distributed, Parallel, and Cluster Computing · Computer Science
SiPipe: Bridging the CPU-GPU Utilization Gap for Efficient Pipeline-Parallel LLM Inference
Yongchao He, Bohan Zhao, Zheng Cao
2025-06-30
Distributed, Parallel, and Cluster Computing · Computer Science
A stencil-based implementation of Parareal in the C++ domain specific embedded language STELLA
Andrea Arteaga, Daniel Ruprecht, Rolf Krause
2015-09-22
Distributed, Parallel, and Cluster Computing · Computer Science
DAPPLE: A Pipelined Data Parallel Approach for Training Large Models
Shiqing Fan, Yi Rong, Chen Meng, Zongyan Cao +9
2020-07-03
Distributed, Parallel, and Cluster Computing · Computer Science
Improving strong scaling of the Conjugate Gradient method for solving large linear systems using global reduction pipelining
Siegfried Cools, Jeffrey Cornelis, Pieter Ghysels, Wim Vanroose
2019-05-17
Computational Engineering, Finance, and Science · Computer Science
Parallel performance of shared memory parallel spectral deferred corrections
Philip Freese, Sebastian Götschel, Thibaut Lunet, Daniel Ruprecht +1
2026-03-04
Machine Learning · Computer Science
SlimPipe: Memory-Thrifty and Efficient Pipeline Parallelism for Long-Context LLM Training
Zhouyang Li, Yuliang Liu, Wei Zhang, Tailing Yuan +3
2025-04-22
Distributed, Parallel, and Cluster Computing · Computer Science
UPIR: Toward the Design of Unified Parallel Intermediate Representation for Parallel Programming Models
Anjia Wang, Xinyao Yi, Yonghong Yan
2022-10-31
Distributed, Parallel, and Cluster Computing · Computer Science
Zero Bubble Pipeline Parallelism
Penghui Qi, Xinyi Wan, Guangxing Huang, Min Lin
2024-01-22
Numerical Analysis · Mathematics
Symmetric parareal algorithms for Hamiltonian systems
X. Dai, C. Le Bris, F. Legoll, Y. Maday
2010-11-30
Computational Engineering, Finance, and Science · Computer Science
Explicit Parallel-in-time Integration of a Linear Acoustic-Advection System
Daniel Ruprecht, Rolf Krause
2015-10-09
Computational Engineering, Finance, and Science · Computer Science
On Distributed Parallelization Strategies for Particle-in-Fourier Schemes
Sriramkrishnan Muralikrishnan, Paul Fischill, Andreas Adelmann, Robert Speck
2026-05-12