English
Related papers

Related papers: A Simple Communication Scheme for Distributed Fast…

200 papers

The advent of multi-/many-core processors in clusters advocates hybrid parallel programming, which combines Message Passing Interface (MPI) for inter-node parallelism with a shared memory model for on-node parallelism. Compared to the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-15 Huan Zhou , Jose Gracia , Ralf Schneider

We present a new hybrid paradigm for parallel adaptive mesh refinement (AMR) that combines the scalability and lightweight architecture of tree-based AMR with the computational efficiency of patch-based solvers for hyperbolic conservation…

Mathematical Software · Computer Science 2014-06-06 Carsten Burstedde , Donna Calhoun , Kyle Mandli , Andy R. Terrel

This paper seeks to address the question of designing distributed algorithms for the setting of compact memory i.e. sublinear bits working memory for arbitrary connected networks. The nodes in our networks may have much lower internal…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-22 Armando Castañeda , Jonas Lefèvre , Amitabh Trehan

Affine frequency division multiplexing (AFDM) is a new multicarrier technique based on chirp signals tailored for high-mobility communications, which can achieve full diversity. In this paper, we propose an index modulation (IM) scheme…

Signal Processing · Electrical Eng. & Systems 2023-10-20 Yiwei Tao , Miaowen Wen , Yao Ge , Jun Li

Recent advancements in large language models have significantly improved their context windows, yet challenges in effective long-term memory management remain. We introduce MemTree, an algorithm that leverages a dynamic, tree-structured…

Computation and Language · Computer Science 2025-03-21 Alireza Rezazadeh , Zichao Li , Wei Wei , Yujia Bao

The operation of large-scale infrastructure networks requires scalable optimization schemes. To guarantee safe system operation, a high degree of feasibility in a small number of iterations is important. Decomposition schemes can help to…

Systems and Control · Electrical Eng. & Systems 2024-12-02 Alexander Engelmann , Sungho Shin , François Pacaud , Victor M. Zavala

Isomorphic (sparse) collective communication is a form of collective communication in which all involved processes communicate in small, identically structured neighborhoods of other processes. Isomorphic neighborhoods are defined via an…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-27 Jesper Larsson Träff , Alexandra Carpen-Amarie , Sascha Hunold , Antoine Rougier

In many distributed learning problems, the heterogeneous loading of computing machines may harm the overall performance of synchronous strategies. In this paper, we propose an effective asynchronous distributed framework for the…

Machine Learning · Statistics 2017-05-23 Bikash Joshi , Franck Iutzeler , Massih-Reza Amini

Efficiently solving large-scale optimal power flow (OPF) problems is challenging due to the high dimensionality and interconnectivity of modern power systems. Decomposition methods offer a promising solution via partitioning large problems…

Optimization and Control · Mathematics 2025-12-30 Mohannad Alkhraijah , Devon Sigler , Daniel K. Molzahn

A Federated Learning (FL) system collaboratively trains neural networks across devices and a server but is limited by significant on-device computation costs. Split Federated Learning (SFL) systems mitigate this by offloading a block of…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-11 Zihan Zhang , Leon Wong , Blesson Varghese

Modern large-scale deep learning workloads highlight the need for parallel execution across many devices in order to fit model data into hardware accelerator memories. In these settings, array redistribution may be required during a…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-29 Norman A. Rink , Adam Paszke , Dimitrios Vytiniotis , Georg Stefan Schmid

Energy system optimization models are increasing in scope and resolution, yielding large and challenging linear programs. For a long time, the standard way to address such problems has relied on shared-memory interior-point methods (IPM),…

Optimization and Control · Mathematics 2026-05-07 Janina Zittel , Annika Buchholz , Michael Bussieck , Frederik Fiand , Thorsten Koch , Lukas Mehl , Niels Lindner , Manuel Wetzel

The parameter size of modern large language models (LLMs) can be scaled up via the sparsely-activated Mixture-of-Experts (MoE) technique to avoid excessive increase of the computational costs. To further improve training efficiency,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-08 Yunqi Gao , Bing Hu , Mahdi Boloursaz Mashhadi , A-Long Jin , Yanfeng Zhang , Pei Xiao , Rahim Tafazolli , Merouane Debbah

Massive MIMO systems are well-suited for mm-Wave communications, as large arrays can be built with reasonable form factors, and the high array gains enable reasonable coverage even for outdoor communications. One of the main obstacles for…

In regression tasks the distribution of the data is often too complex to be fitted by a single model. In contrast, partition-based models are developed where data is divided and fitted by local models. These models partition the input space…

Machine Learning · Computer Science 2019-03-20 Wenbo Zhao , Yang Gao , Shahan Ali Memon , Bhiksha Raj , Rita Singh

Distributed synchronous stochastic gradient descent has been widely used to train deep neural networks on computer clusters. With the increase of computational power, network communications have become one limiting factor on system…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-04 Shaohuai Shi , Xiaowen Chu , Bo Li

Processing massive application graphs on distributed memory systems requires to map the graphs onto the system's processing elements (PEs). This task becomes all the more important when PEs have non-uniform communication costs or the input…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-07 Maria Predari , Charilaos Tzovas , Christian Schulz , Henning Meyerhenke

The Fast Multipole Method (FMM) reduces the computation of pairwise two-body interactions among $N$-particles to order $N$, whose computation cost should be of order $N^2$ by brute force. However, its implementation is somewhat complicated…

Computational Physics · Physics 2020-09-03 Yasuhiro Kajima

The use of hybrid scheme combining the message passing programming models for inter-node parallelism and the shared memory programming models for node-level parallelism is widely spread. Existing extensive practices on hybrid Message…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-23 Huan Zhou , Jose Gracia , Naweiluo Zhou , Ralf Schneider

The persistence diagram, which describes the topological features of a dataset, is a key descriptor in Topological Data Analysis. The "Discrete Morse Sandwich" (DMS) method has been reported to be the most efficient algorithm for computing…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-27 Eve Le Guillou , Pierre Fortin , Julien Tierny