In this article, we present JUWELS Booster, a recently commissioned high-performance computing system at the J\"ulich Supercomputing Center. With its system architecture, most importantly its large number of powerful Graphics Processing Units (GPUs) and its fast interconnect via InfiniBand, it is an ideal machine for large-scale Artificial Intelligence (AI) research and applications. We detail its system architecture, parallel, distributed model training, and benchmarks indicating its outstanding performance. We exemplify its potential for research application by presenting large-scale AI research highlights from various scientific fields that require such a facility.
Cite
@article{arxiv.2108.11976,
title = {JUWELS Booster -- A Supercomputer for Large-Scale AI Research},
author = {Stefan Kesselheim and Andreas Herten and Kai Krajsek and Jan Ebert and Jenia Jitsev and Mehdi Cherti and Michael Langguth and Bing Gong and Scarlet Stadtler and Amirpasha Mozaffari and Gabriele Cavallaro and Rocco Sedona and Alexander Schug and Alexandre Strube and Roshni Kamath and Martin G. Schultz and Morris Riedel and Thomas Lippert},
journal= {arXiv preprint arXiv:2108.11976},
year = {2021}
}
Comments
12 pages, 5 figures. Accepted at ISC 2021, Workshop Deep Learning on Supercomputers. This is a duplicate submission as my previous submission is on hold for several weeks now and my attempts to contact the moderators failed