English
Related papers

Related papers: A Multi-Objective Framework for Optimizing GPU-Ena…

200 papers

Characterizing and predicting the training performance of modern machine learning (ML) workloads on compute systems with compute and communication spread between CPUs, GPUs, and network devices is not only the key to optimization and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-27 Zhongyi Lin , Ning Sun , Pallab Bhattacharya , Xizhou Feng , Louis Feng , John D. Owens

Matrix Factorization (MF) on large scale data takes substantial time on a Central Processing Unit (CPU). While Graphical Processing Unit (GPU)s could expedite the computation of MF, the available memory on a GPU is finite. Leveraging GPUs…

Machine Learning · Computer Science 2023-04-28 Prasad Bhavana , Vineet Padmanabhan

As deep learning continues to advance and is applied to increasingly complex scenarios, the demand for concurrent deployment of multiple neural network models has arisen. This demand, commonly referred to as multi-tenant computing, is…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-25 Yongbo Yu , Fuxun Yu , Mingjia Zhang , Di Wang , Tolga Soyata , Chenchen Liu , Xiang Chen

With the strong computation capability, NUMA-based multi-GPU system is a promising candidate to provide sustainable and scalable performance for Virtual Reality. However, the entire multi-GPU system is viewed as a single GPU which ignores…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-13 Chenhao Xie , Xin Fu , Mingsong Chen , Shuaiwen Leon Song

State of art DL models are growing in size and complexity, with many modern models also increasing in heterogeneity of behavior. GPUs are still the dominant platform for DL applications, relying on a bulk-synchronous execution model which…

Hardware Architecture · Computer Science 2025-02-26 Michael Davies , Neal Crago , Karthikeyan Sankaralingam , Stephen W. Keckler

Computer vision applications, especially those using augmented reality technology, are becoming quite popular in mobile devices. However, this type of application is known as presenting significant demands regarding resources. In order to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Fabio Diniz Rossi

In VLSI physical design, many algorithms require the solution of difficult combinatorial optimization problems such as max/min-cut, max-flow problems etc. Due to the vast number of elements typically found in this problem domain, these…

Computational Physics · Physics 2019-03-18 Chase Cook , Hengyang Zhao , Takashi Sato , Masayuki Hiromoto , Sheldon X. -D. Tan

LLM inference powers latency-critical production services nowadays. The bursty nature of inference traffic results in over-provisioning, which in turn leads to resource underutilization. While online-offline colocation promises to utilize…

Operating Systems · Computer Science 2026-04-10 Fangyue Liu , Hua Liu , Xinyuan Lyu , Shuo Ai , Hao Liang , Lingpeng Chen , Ziqian Hu , Chong Zha , Xin Jin , Hanmei Luo , Peng Chen

To effectively control large-scale distributed systems online, model predictive control (MPC) has to swiftly solve the underlying high-dimensional optimization. There are multiple techniques applied to accelerate the solving process in the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-30 Carmen Amo Alonso , Shih-Hao Tseng

Choosing an appropriate programming paradigm for high-performance computing on low-power devices can be useful to speed up calculations. Many Android devices have an integrated GPU and - although not officially supported - the OpenCL…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-10 Robert Fritze , Claudia Plant

Multi-accelerator servers are increasingly being deployed in shared multi-tenant environments (such as in cloud data centers) in order to meet the demands of large-scale compute-intensive workloads. In addition, these accelerators are…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-08 Kiran Ranganath , Joshua D. Suetterlein , Joseph B. Manzano , Shuaiwen Leon Song , Daniel Wong

Hash tables are used in a plethora of applications, including database operations, DNA sequencing, string searching, and many more. As such, there are many parallelized hash tables targeting multicore, distributed, and accelerator-based…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-05 Alok Tripathy , Oded Green

There is a continuous growth in demand for time sensitive applications which has shifted the cloud paradigm from a centralized computing architecture towards distributed heterogeneous computing platforms where resources located at the edge…

Networking and Internet Architecture · Computer Science 2021-10-29 Abdullah M. Alqahtani , Barzan Yosuf , Sanaa H. Mohamed , Taisir E. H. El-Gorashi , Jaafar M. H. Elmirghani

The increasing size of input graphs for graph neural networks (GNNs) highlights the demand for using multi-GPU platforms. However, existing multi-GPU GNN systems optimize the computation and communication individually based on the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-28 Yuke Wang , Boyuan Feng , Zheng Wang , Tong Geng , Kevin Barker , Ang Li , Yufei Ding

General Matrix Multiplication (GEMM) is a critical operation underpinning a wide range of applications in high-performance computing (HPC) and artificial intelligence (AI). The emergence of hardware optimized for low-precision arithmetic…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-21 Qiao Zhang , Rabab Alomairy , Dali Wang , Zhuowei Gu , Qinglei Cao

In this paper, a re-evaluation undertaken for dynamic VM consolidation problem and optimal online deterministic algorithms for the single VM migration in an experimental environment. We proceeded to focus on energy and performance trade-off…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-18 Nasrin Akhter , Mohamed Othman , Ranesh Kumar Naha

An essential consideration in urban transit facility planning is service efficiency and accessibility. Previous research has shown that reducing the number of facilities along a route may increase efficiency but decrease accessibility.…

Optimization and Control · Mathematics 2022-10-25 Einar Gabbassov

Graphics Processing Units (GPUs) have become the standard in accelerating scientific applications on heterogeneous systems. However, as GPUs are getting faster, one potential performance bottleneck with GPU-accelerated applications is the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-01 Jonah Ekelund , Stefano Markidis , Ivy Peng

Heterogeneity has grown in popularity both at the core and server level as a way to improve both performance and energy efficiency. However, despite these benefits, scheduling applications in heterogeneous machines remains challenging.…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-19 Francisco Romero , Christina Delimitrou

Due to privacy concerns of users and law enforcement in data security and privacy, it becomes more and more difficult to share data among organizations. Data federation brings new opportunities to the data-related cooperation among…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-16 Ji Liu , Lei Mo , Sijia Yang , Jingbo Zhou , Shilei Ji , Haoyi Xiong , Dejing Dou