English
Related papers

Related papers: Pipelined Workflow in Hybrid MPI/Pthread runtime f…

200 papers

PipeDream is a Deep Neural Network(DNN) training system for GPUs that parallelizes computation by pipelining execution across multiple machines. Its pipeline parallel computing model avoids the slowdowns faced by data-parallel training when…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-12 Aaron Harlap , Deepak Narayanan , Amar Phanishayee , Vivek Seshadri , Nikhil Devanur , Greg Ganger , Phil Gibbons

Motion planning is an important and well-studied field of robotics. A typical approach to finding a route is to construct a {\em cell graph} representing a scene and then to find a path in such a graph. In this paper we present and analyze…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-03-23 Krzysztof Kaczmarski , Paweł Rzążewski , Albert Wolant

Betweenness centrality is one of the most popular vertex centrality measures in network analysis. Hence, many (sequential and parallel) algorithms to compute or approximate betweenness have been devised. Recent algorithmic advances have…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-25 Alexander van der Grinten , Henning Meyerhenke

Continuous Integration and Continuous Deployment (CI/CD) pipelines are central to modern software development. In large organizations, the high volume of builds and tests creates bottlenecks, especially under shared infrastructure. This…

Software Engineering · Computer Science 2025-04-29 Grégory Bournassenko

We study graph realization problems from a distributed perspective and we study it in the node capacitated clique (NCC) model of distributed computing, recently introduced for representing peer-to-peer networks. We focus on two central…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-19 John Augustine , Keerti Choudhary , Avi Cohen , David Peleg , Sumathi Sivasubramaniam , Suman Sourav

Core decomposition is a fundamental graph problem with a large number of applications. Most existing approaches for core decomposition assume that the graph is kept in memory of a machine. Nevertheless, many real-world graphs are big and…

Databases · Computer Science 2015-11-03 Dong Wen , Lu Qin , Ying Zhang , Xuemin Lin , Jeffrey Xu Yu

When MPI-parallel simulations run on shared Kubernetes clusters, conventional CPU scheduling leaves the vast majority of provisioned cycles idle at synchronization barriers. This paper presents a multiplexing framework that reclaims this…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-02 Tianfang Xie

This paper presents an octree construction method, called Cornerstone, that facilitates global domain decomposition and interactions between particles in mesh-free numerical simulations. Our method is based on algorithms developed for 3D…

Instrumentation and Methods for Astrophysics · Physics 2023-07-14 Sebastian Keller , Aurélien Cavelan , Rubén Cabezon , Lucio Mayer , Florina M. Ciorba

Brain MRI segmentation results should always undergo a quality control (QC) process, since automatic segmentation tools can be prone to errors. In this work, we propose two deep learning-based architectures for performing QC automatically.…

Image and Video Processing · Electrical Eng. & Systems 2020-05-29 Irene Brusini , Daniel Ferreira Padilla , José Barroso , Ingmar Skoog , Örjan Smedby , Eric Westman , Chunliang Wang

A theoretical memory with limited processing power and internal connectivity at each element is proposed. This memory carries out parallel processing within itself to solve generic array problems. The applicability of this in-memory…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-09-28 Chengpu Wang

Representing graphs as sets of node embeddings in certain curved Riemannian manifolds has recently gained momentum in machine learning due to their desirable geometric inductive biases, e.g., hierarchical structures benefit from hyperbolic…

Machine Learning · Computer Science 2020-06-09 Calin Cruceru , Gary Bécigneul , Octavian-Eugen Ganea

We present a single-node, multi-GPU programmable graph processing library that allows programmers to easily extend single-GPU graph algorithms to achieve scalable performance on large graphs with billions of edges. Directly using the…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-03-02 Yuechao Pan , Yangzihao Wang , Yuduo Wu , Carl Yang , John D. Owens

We introduce BriskStream, an in-memory data stream processing system (DSPSs) specifically designed for modern shared-memory multicore architectures. BriskStream's key contribution is an execution plan optimization paradigm, namely RLAS,…

Databases · Computer Science 2019-04-10 Shuhao Zhang , Jiong He , Amelie Chi Zhou , Bingsheng He

We present a new open-source cosmological code, called SWIFT, designed to solve the equations of hydrodynamics using a particle-based approach (Smooth Particle Hydrodynamics) on hybrid shared/distributed-memory architectures. SWIFT was…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-03 Matthieu Schaller , Pedro Gonnet , Aidan B. G. Chalk , Peter W. Draper

Partitioning graphs into blocks of roughly equal size such that few edges run between blocks is a frequently needed operation in processing graphs. Recently, size, variety, and structural complexity of these networks has grown dramatically.…

Data Structures and Algorithms · Computer Science 2018-10-16 Yaroslav Akhremtsev , Peter Sanders , Christian Schulz

Deep neural networks (DNNs) have substantial computational and memory requirements, and the compilation of its computational graphs has a great impact on the performance of resource-constrained (e.g., computation, I/O, and memory-bound)…

Hardware Architecture · Computer Science 2023-04-11 Jiaqi Yin , Yingjie Li , Daniel Robinson , Cunxi Yu

Classic image scaling (e.g. bicubic) can be seen as one convolutional layer and a single upscaling filter. Its implementation is ubiquitous in all display devices and image processing software. In the last decade deep learning systems have…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Pablo Navarrete Michelini , Yunhua Lu , Xingqun Jiang

Data processing pipelines need to be executed at scales ranging from small runs up through large production data release runs resulting in millions of data products. As part of the Rubin Observatory's pipeline execution system, BPS is the…

Instrumentation and Methods for Astrophysics · Physics 2022-11-30 Michelle Gower , Mikolaj Kowalik , Nate B. Lust , James F. Bosch , Tim Jenness

Fine-tuning Large Language Models (LLMs) on consumer-grade GPUs is highly cost-effective, yet constrained by limited GPU memory and slow PCIe interconnects. Pipeline parallelism combined with CPU offloading mitigates these hardware…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-01 Yibin Luo , Shiwei Gao , Huichuan Zheng , Youyou Lu , Jiwu Shu

Big graphs (networks) arising in numerous application areas pose significant challenges for graph analysts as these graphs grow to billions of nodes and edges and are prohibitively large to fit in the main memory. Finding the number of…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-06-19 Shaikh Arifuzzaman , Maleq Khan , Madhav Marathe