English
Related papers

Related papers: HPC AI500: A Benchmark Suite for HPC AI Systems

200 papers

Recent trends in deep learning (DL) have made hardware accelerators essential for various high-performance computing (HPC) applications, including image classification, computer vision, and speech recognition. This survey summarizes and…

The field of High-Performance Computing (HPC) is defined by providing computing devices with highest performance for a variety of demanding scientific users. The tight co-design relationship between HPC providers and users propels the field…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-17 Andreas Herten , Olga Pearce , Filipe S. M. Guimarães

Cyber-physical systems (CPS) have been broadly deployed in safety-critical domains, such as automotive systems, avionics, medical devices, etc. In recent years, Artificial Intelligence (AI) has been increasingly adopted to control CPS.…

Software Engineering · Computer Science 2022-04-20 Jiayang Song , Deyun Lyu , Zhenya Zhang , Zhijie Wang , Tianyi Zhang , Lei Ma

During the last two years, the goal of many researchers has been to squeeze the last bit of performance out of HPC system for AI tasks. Often this discussion is held in the context of how fast ResNet50 can be trained. Unfortunately,…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-12 Dhiraj Kalamkar , Evangelos Georganas , Sudarshan Srinivasan , Jianping Chen , Mikhail Shiryaev , Alexander Heinecke

Compound AI applications, composed from interactions between Large Language Models (LLMs), Machine Learning (ML) models, external tools and data sources are quickly becoming an integral workload in datacenters. Their diverse sub-components…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-14 Paramuth Samuthrsindh , Angel Cervantes , Varun Gohil , Gohar Irfan Chaudhry , Christina Delimitrou , Adam Belay

Scientific applications often contain large, computationally-intensive, and irregular parallel loops or tasks that exhibit stochastic characteristics. Applications may suffer from load imbalance during their execution on high-performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-16 Ali Mohammed , Ahmed Eleliemy , Florina M. Ciorba , Franziska Kasielke , Ioana Banicescu

The current Deep Learning (DL) landscape is fast-paced and is rife with non-uniform models, hardware/software (HW/SW) stacks, but lacks a DL benchmarking platform to facilitate evaluation and comparison of DL innovations, be it models,…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-23 Cheng Li , Abdul Dakkak , Jinjun Xiong , Wen-mei Hwu

Scientific applications are often complex, irregular, and computationally-intensive. To accommodate the ever-increasing computational demands of scientific applications, high-performance computing (HPC) systems have become larger and more…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-20 Ali Mohammed , Aurelien Cavelan , Florina M. Ciorba , Ruben M. Cabezon , Ioana Banicesu

Scientific research communities are embracing AI-based solutions to target tractable scientific tasks and improve research workflows. However, the development and evaluation of such solutions are scattered across multiple disciplines. We…

Artificial Intelligence · Computer Science 2022-06-14 Yatao Li , Jianfeng Zhan

Deep learning (DL) has become a driving force and has been widely adopted in many domains and applications with competitive performance. In practice, to solve the nontrivial and complicated tasks in real-world applications, DL is often not…

Machine Learning · Computer Science 2022-12-16 Zhijie Wang , Yuheng Huang , Lei Ma , Haruki Yokoyama , Susumu Tokumoto , Kazuki Munakata

Several fundamental changes in technology indicate domain-specific hardware and software co-design is the only path left. In this context, architecture, system, data management, and machine learning communities pay greater attention to…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-11-26 Wanling Gao , Jianfeng Zhan , Lei Wang , Chunjie Luo , Daoyi Zheng , Xu Wen , Rui Ren , Chen Zheng , Xiwen He , Hainan Ye , Haoning Tang , Zheng Cao , Shujie Zhang , Jiahui Dai

Workload characterization is an integral part of performance analysis of high performance computing (HPC) systems. An understanding of workload properties sheds light on resource utilization and can be used to inform performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-16 Nikolay A. Simakov , Joseph P. White , Robert L. DeLeon , Steven M. Gallo , Matthew D. Jones , Jeffrey T. Palmer , Benjamin Plessinger , Thomas R. Furlani

The scale of scientific High Performance Computing (HPC) and High Throughput Computing (HTC) has increased significantly in recent years, and is becoming sensitive to total energy use and cost. Energy-efficiency has thus become an important…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-10-14 David Abdurachmanov , Peter Elmer , Giulio Eulisse , Robert Knight , Tapio Niemi , Jukka K. Nurminen , Filip Nyback , Goncalo Pestana , Zhonghong Ou , Kashif Khan

With the development of deep learning (DL) techniques, rotating machinery intelligent diagnosis has gone through tremendous progress with verified success and the classification accuracies of many DL-based intelligent diagnosis algorithms…

Signal Processing · Electrical Eng. & Systems 2020-08-20 Zhibin Zhao , Tianfu Li , Jingyao Wu , Chuang Sun , Shibin Wang , Ruqiang Yan , Xuefeng Chen

For reasons of both performance and energy efficiency, high-performance computing (HPC) hardware is becoming increasingly heterogeneous. The OpenCL framework supports portable programming across a wide range of computing devices and is…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-11-01 Beau Johnston , Josh Milthorpe

High Performance Research Desktops are used by HPC centers and research computing organizations to lower the barrier of entry to HPC systems. These Linux desktops are deployed alongside HPC systems, leveraging the investments in HPC compute…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-05 Robert Henschel , Jonas Lindemann , Anders Follin , Bernd Dammann , Cicada Dennis , Abhinav Thota

Current trends point to a future where large-scale scientific applications are tightly-coupled HPC/AI hybrids. Hence, we urgently need to invest in creating a seamless, scalable framework where HPC and AI/ML can efficiently work together…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-06 Jens Domke , Mohamed Wahib , Anshu Dubey , Tal Ben-Nun , Erik W. Draeger

We introduce Deep500: the first customizable benchmarking infrastructure that enables fair comparison of the plethora of deep learning frameworks, algorithms, libraries, and techniques. The key idea behind Deep500 is its modular design,…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-14 Tal Ben-Nun , Maciej Besta , Simon Huber , Alexandros Nikolaos Ziogas , Daniel Peter , Torsten Hoefler

While Large Language Models (LLMs) show significant potential in hardware engineering, current benchmarks suffer from saturation and limited task diversity, failing to reflect LLMs' performance in real industrial workflows. To address this…

Artificial Intelligence · Computer Science 2026-02-03 Zhongkai Yu , Chenyang Zhou , Yichen Lin , Hejia Zhang , Haotian Ye , Junxia Cui , Zaifeng Pan , Jishen Zhao , Yufei Ding