English
Related papers

Related papers: Scaling to 32 GPUs on a Novel Composable System Ar…

200 papers

Programmability, performance portability, and resource efficiency have emerged as critical challenges in harnessing complex and diverse architectures today to obtain high performance and energy efficiency. While there is abundant research,…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-14 Nandita Vijaykumar

Machine intelligence, especially using convolutional neural networks (CNNs), has become a large area of research over the past years. Increasingly sophisticated hardware accelerators are proposed that exploit e.g. the sparsity in…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-23 Andreas Bytyn , René Ahlsdorf , Rainer Leupers , Gerd Ascheid

To match the blooming demand of generative AI workloads, GPU designers have so far been trying to pack more and more compute and memory into single complex and expensive packages. However, there is growing uncertainty about the scalability…

Hardware Architecture · Computer Science 2025-04-30 Burcu Canakci , Junyi Liu , Xingbo Wu , Nathanaël Cheriere , Paolo Costa , Sergey Legtchenko , Dushyanth Narayanan , Ant Rowstron

Sequential computation is well understood but does not scale well with current technology. Within the next decade, systems will contain large numbers of processors with potentially thousands of processors per chip. Despite this, many…

Hardware Architecture · Computer Science 2015-11-17 James Hanlon

Real-time generative game engines represent a paradigm shift in interactive simulation, promising to replace traditional graphics pipelines with neural world models. However, existing approaches are fundamentally constrained by the ``Memory…

Artificial Intelligence · Computer Science 2026-02-03 Wei Zeng , Xuchen Li , Ruili Feng , Zhen Liu , Fengwei An , Jian Zhao

Complex, interconnected cyber-physical systems (CPS) are increasingly prevalent in domains such as power systems. Cyber-resilient architectures have been proposed to recover compromised cyber components of CPS. Recent works have studied…

Systems and Control · Electrical Eng. & Systems 2026-03-17 Eman Badr , Abdullah Al Maruf

The assumption of maximum parallelism support for the successful realization of scalable quantum computers has led to homogeneous, ``sea-of-qubits'' architectures. The resulting architectures overcome the primary challenges of reliability…

GPUs are playing an increasingly important role in general-purpose computing. Many algorithms require synchronizations at different levels of granularity in a single GPU. Additionally, the emergence of dense GPU nodes also calls for…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-14 Lingqi Zhang , Mohamed Wahib , Haoyu Zhang , Satoshi Matsuoka

Massively multicore processors, such as Graphics Processing Units (GPUs), provide, at a comparable price, a one order of magnitude higher peak performance than traditional CPUs. This drop in the cost of computation, as any…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-18 Samer Al-Kiswany , Abdullah Gharaibeh , Matei Ripeanu

A pronounced imbalance in GPU resources exists on campus, where some laboratories own underutilized servers while others lack the compute needed for AI research. GPU sharing can alleviate this disparity, while existing platforms typically…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-07 Yufang Li , Yuanbo Zhang , Hanlong Liao , Deke Guo , Guoming Tang

Integrating GPUs into serverless computing platforms is crucial for improving efficiency. However, existing solutions for GPU-enabled serverless computing platforms face two significant problems due to coarse-grained GPU management: long…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-24 Han Zhao , Weihao Cui , Quan Chen , Shulai Zhang , Zijun Li , Jingwen Leng , Chao Li , Deze Zeng , Minyi Guo

High level programming languages and GPU accelerators are powerful enablers for a wide range of applications. Achieving scalable vertical (within a compute node), horizontal (across compute nodes), and temporal (over different generations…

This paper addresses the limitations of current satellite payload architectures, which are predominantly hardware-driven and lack the flexibility to adapt to increasing data demands and uneven traffic. To overcome these challenges, we…

Phasor Measurement Units (PMUs) generate high-frequency, time-synchronized data essential for real-time power grid monitoring, yet the growing scale of PMU deployments creates significant challenges in latency, scalability, and reliability.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-30 Nachiappan Chockalingam , Akshay Deshpande , Lokesh Butra , Ram Sekhar Bodala , Nitin Saksena , Adithya Parthasarathy , Balakrishna Pothineni , Akash Kumar Agarwal

The rise of Large Language Models (LLM) has increased the need for scalable, high-performance inference systems, yet most existing frameworks assume homogeneous, resource-rich hardware, often unrealistic in academic, or resource-constrained…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-18 Pedro Antunes , Ana Rita Ortigoso , Gabriel Vieira , Daniel Fuentes , Luís Frazão , Nuno Costa , António Pereira

We present a framework to interactively volume-render three-dimensional data cubes using distributed ray-casting and volume bricking over a cluster of workstations powered by one or more graphics processing units (GPUs) and a multi-core…

Instrumentation and Methods for Astrophysics · Physics 2015-06-05 A. H. Hassan , C. J. Fluke , D. G. Barnes

Parallel data processing has become indispensable for processing applications involving huge data sets. This brings into focus the Graphics Processing Units (GPUs) which emphasize on many-core computing. With the advent of General Purpose…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-05-22 Poorna Banerjee , Amit Dave

The ability to express a program as a hierarchical composition of parts is an essential tool in managing the complexity of software and a key abstraction this provides is to separate the representation of data from the computation. Many…

Programming Languages · Computer Science 2012-10-04 James Hanlon , Simon J. Hollis , David May

The rapid growth of GPU-heavy data centers has significantly increased electricity demand and creating challenges for grid stability. Our paper investigates the extent to which an energy-aware job scheduling algorithm can provide…

Systems and Control · Electrical Eng. & Systems 2026-03-31 Yiru Ji , Constance Crozier , Matthew Liska

The future of computing systems is inevitably embracing a disaggregated and composable pattern: from clusters of computers to pools of resources that can be dynamically combined together and tailored around applications requirements.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-02 Christian Pinto , Dong Li , Thaleia Dimitra Doudali , Christina Giannoula , Jie Ren