English
Related papers

Related papers: Communication-optimal Parallel and Sequential Chol…

200 papers

We study cost-effective communication strategies that can be used to improve the performance of distributed learning systems in resource-constrained environments. For distributed learning in sequential decision making, we propose a new…

Machine Learning · Computer Science 2020-04-15 Udari Madhushani , Naomi Ehrich Leonard

The Cholesky decomposition is a fundamental tool for solving linear systems with symmetric and positive definite matrices which are ubiquitous in linear algebra, optimization, and machine learning. Its numerical stability can be improved by…

Machine Learning · Computer Science 2025-07-29 Filip de Roos , Fabio Muratore

The future of main memory appears to lie in the direction of new technologies that provide strong capacity-to-performance ratios, but have write operations that are much more expensive than reads in terms of latency, bandwidth, and energy.…

Data Structures and Algorithms · Computer Science 2017-10-10 Naama Ben-David , Guy E. Blelloch , Jeremy T. Fineman , Phillip B. Gibbons , Yan Gu , Charles McGuffey , Julian Shun

We propose two distributed iterative algorithms that can be used to solve, in finite time, the distributed optimization problem over quadratic local cost functions in large-scale networks. The first algorithm exhibits synchronous operation…

This thesis is concerned with the design of distributed algorithms for solving optimization problems. We consider networks where each node has exclusive access to a cost function, and design algorithms that make all nodes cooperate to find…

Optimization and Control · Mathematics 2013-12-03 João F. C. Mota

We examine fundamental tradeoffs in iterative distributed zeroth and first order stochastic optimization in multi-agent networks in terms of \emph{communication cost} (number of per-node transmissions) and \emph{computational cost},…

Optimization and Control · Mathematics 2018-09-11 Anit Kumar Sahu , Dusan Jakovetic , Dragana Bajovic , Soummya Kar

As electronic structure simulations continue to grow in size, the system-size scaling of computational costs increases in importance relative to cost prefactors. Presently, linear-scaling costs for three-dimensional systems are only…

Computational Physics · Physics 2019-07-04 Jonathan E. Moussa , Andrew D. Baczewski

As multicore systems continue to gain ground in the High Performance Computing world, linear algebra algorithms have to be reformulated or new algorithms have to be developed in order to take advantage of the architectural features on these…

Mathematical Software · Computer Science 2008-06-12 Alfredo Buttari , Julien Langou , Jakub Kurzak , Jack Dongarra

This study focuses on the performance of two classical dense linear algebra algorithms, the LU and the QR factorizations, on multilevel hierarchical platforms. We first introduce a new model called Hierarchical Cluster Platform (HCP),…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-03-26 Laura Grigori , Mathias Jacquelin , Amal Khabou

Federated Learning (FL) offers a promising framework for collaborative and privacy-preserving machine learning across distributed data sources. However, the substantial communication costs associated with FL significantly challenge its…

Machine Learning · Computer Science 2025-06-04 Zhe Li , Bicheng Ying , Zidong Liu , Chaosheng Dong , Haibo Yang

We present a new parallel algorithm for solving triangular systems with multiple right hand sides (TRSM). TRSM is used extensively in numerical linear algebra computations, both to solve triangular linear systems of equations as well as to…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-03-23 Tobias Wicky , Edgar Solomonik , Torsten Hoefler

This paper considers distributed nonconvex optimization with the cost functions being distributed over agents. Noting that information compression is a key tool to reduce the heavy communication load for distributed algorithms as agents…

Optimization and Control · Mathematics 2022-10-10 Xinlei Yi , Shengjun Zhang , Tao Yang , Tianyou Chai , Karl H. Johansson

We present a novel, highly efficient algorithm to parallelize O(N^2) direct summation method for N-body problems with individual timesteps on distributed-memory parallel machines such as Beowulf clusters. Previously known algorithms, in…

Astrophysics · Physics 2009-11-07 Junichiro Makino

Sparse linear algebra routines are fundamental building blocks of a large variety of scientific applications. Direct solvers, which are methods for solving linear systems via the factorization of matrices into products of triangular…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-21 Valentin Le Fèvre , Tetsuzo Usui , Marc Casas

We explore the connection between dimensionality and communication cost in distributed learning problems. Specifically we study the problem of estimating the mean $\vec{\theta}$ of an unknown $d$ dimensional gaussian distribution in the…

Machine Learning · Computer Science 2014-11-11 Ankit Garg , Tengyu Ma , Huy L. Nguyen

Due to the advent of multicore architectures and massive parallelism, the tiled Cholesky factorization algorithm has recently received plenty of attention and is often referenced by practitioners as a case study. It is also implemented in…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-10-20 Willy Quach , Julien Langou

Algebraic multigrid (AMG) is an $\mathcal{O}(n)$ solution process for many large sparse linear systems. A hierarchy of progressively coarser grids is constructed that utilize complementary relaxation and interpolation operators. High-energy…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-12-16 Amanda Bienz , Robert D. Falgout William Gropp , Luke N. Olson , Jacob B. Schroder

Parallel matrix multiplication is one of the most studied fundamental problems in distributed and high performance computing. We obtain a new parallel algorithm that is based on Strassen's fast matrix multiplication and minimizes…

Data Structures and Algorithms · Computer Science 2012-02-16 Grey Ballard , James Demmel , Olga Holtz , Benjamin Lipshitz , Oded Schwartz

Efficiently executing convolutional neural nets (CNNs) is important in many machine-learning tasks. Since the cost of moving a word of data, either between levels of a memory hierarchy or between processors over a network, is much higher…

Data Structures and Algorithms · Computer Science 2018-04-25 James Demmel , Grace Dinh

Graph partitioning schedules parallel calculations like sparse matrix-vector multiply (SpMV). We consider contiguous partitions, where the $m$ rows (or columns) of a sparse matrix with $N$ nonzeros are split into $K$ parts without…

Data Structures and Algorithms · Computer Science 2024-10-30 Willow Ahrens