English
Related papers

Related papers: Communication-avoiding Cholesky-QR2 for rectangula…

200 papers

CholeskyQR is a simple and fast QR decomposition via Cholesky decomposition, while it has been considered highly sensitive to the condition number. In this paper, we provide a randomized preconditioner framework for CholeskyQR algorithm.…

Numerical Analysis · Mathematics 2021-11-25 Yuwei Fan , Yixiao Guo , Ting Lin

We propose a solution strategy for linear systems arising in interior method optimization, which is suitable for implementation on hardware accelerators such as graphical processing units (GPUs). The current gold standard for solving these…

Optimization and Control · Mathematics 2026-03-09 Shaked Regev , Nai-Yuan Chiang , Eric Darve , Cosmin G. Petra , Michael A. Saunders , Kasia Świrydowicz , Slaven Peleš

Matrix-matrix multiplication is a basic operation in linear algebra and an essential building block for a wide range of algorithms in various scientific fields. Theory and implementation for the dense, square matrix case are well-developed.…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-06-01 Alfio Lazzaro , Joost VandeVondele , Juerg Hutter , Ole Schuett

Rank-revealing matrix decompositions provide an essential tool in spectral analysis of matrices, including the Singular Value Decomposition (SVD) and related low-rank approximation techniques. QR with Column Pivoting (QRCP) is usually…

Mathematical Software · Computer Science 2020-08-12 Jed A. Duersch , Ming Gu

Nonnegative matrix factorization (NMF) is a powerful technique for dimension reduction, extracting latent factors and learning part-based representation. For large datasets, NMF performance depends on some major issues: fast algorithms,…

Optimization and Control · Mathematics 2015-07-01 Duy-Khuong Nguyen , Tu-Bao Ho

We present a parallel algorithm for the fast Fourier transform (FFT) in higher dimensions. This algorithm generalizes the cyclic-to-cyclic one-dimensional parallel algorithm to a cyclic-to-cyclic multidimensional parallel algorithm while…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-12 Thomas Koopman , Rob H. Bisseling

A distributed-memory parallelization strategy for the density matrix renormalization group is proposed for cases where correlation functions are required. This new strategy has substantial improvements with respect to previous works. A…

Strongly Correlated Electrons · Physics 2010-04-20 Julian Rincon , D. J. Garcia , K. Hallberg

Graph Convolutional Networks (GCNs) are extensively utilized for deep learning on graphs. The large data sizes of graphs and their vertex features make scalable training algorithms and distributed memory systems necessary. Since the…

Machine Learning · Computer Science 2022-12-14 Gunduz Vehbi Demirci , Aparajita Haldar , Hakan Ferhatosmanoglu

On modern parallel architectures, the cost of synchronization among processors can often dominate the cost of floating-point computation. Several modifications of the existing methods have been proposed in order to keep the communication…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-10 Qinmeng Zou , Frederic Magoules

Of the many potential hardware platforms, superconducting quantum circuits have become the leading contender for constructing a scalable quantum computing system. All current architecture designs necessitate a 2D arrangement of…

Quantum Physics · Physics 2020-06-24 H. Mukai , K. Sakata , S. J. Devitt , R. Wang , Y. Zhou , Y. Nakajima , J. S. Tsai

Chebyshev filter diagonalization is well established in quantum chemistry and quantum physics to compute bulks of eigenvalues of large sparse matrices. Choosing a block vector implementation, we investigate optimization opportunities on the…

Mathematical Software · Computer Science 2020-06-25 Moritz Kreutzer , Georg Hager , Dominik Ernst , Holger Fehske , Alan R. Bishop , Gerhard Wellein

The factorization of skew-symmetric matrices is a critically understudied area of dense linear algebra, particularly in comparison to that of general and symmetric matrices. While some algorithms can be adapted from the symmetric case, the…

Mathematical Software · Computer Science 2026-05-06 Ishna Satyarth , Chao Yin , Devin A. Matthews , Maggie Myers , Robert van de Geijn , RuQing G. Xu

Partitioning graphs into blocks of roughly equal size such that few edges run between blocks is a frequently needed operation when processing graphs on a parallel computer. When a topology of a distributed system is known an important task…

Data Structures and Algorithms · Computer Science 2020-01-23 Marcelo Fonseca Faraj , Alexander van der Grinten , Henning Meyerhenke , Jesper Larsson Träff , Christian Schulz

The extension of persistent homology to multi-parameter setups is an algorithmic challenge. Since most computation tasks scale badly with the size of the input complex, an important pre-processing step consists of simplifying the input…

Algebraic Topology · Mathematics 2019-03-19 Ulderico Fugacci , Michael Kerber

An efficient hardware implementation for Simultaneous Localization and Mapping (SLAM) methods is of necessity for mobile autonomous robots with limited computational resources. In this paper, we propose a resource-efficient FPGA…

Signal Processing · Electrical Eng. & Systems 2023-05-31 Keisuke Sugiura , Hiroki Matsutani

We propose a novel approach to iterated sparse matrix dense matrix multiplication, a fundamental computational kernel in scientific computing and graph neural network training. In cases where matrix sizes exceed the memory of a single…

Nowadays computational complexity of fast walsh hadamard transform and nonlinearity for Boolean functions and large substitution boxes is a major challenge of modern cryptography research on strengthening encryption schemes against linear…

Cryptography and Security · Computer Science 2020-04-27 Behrooz Khadem , Reza Ghasemi

Communication and topology aware process mapping is a powerful approach to reduce communication time in parallel applications with known communication patterns on large, distributed memory systems. We address the problem as a quadratic…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-23 Christian Schulz , Jesper Larsson Träff , Konrad von Kirchbach

Stencil computations lie at the heart of many scientific and industrial applications. Unfortunately, stencil algorithms perform poorly on machines with cache based memory hierarchy, due to low re-use of memory accesses. This work shows that…

Mathematical Software · Computer Science 2022-04-11 Mathias Jacquelin , Mauricio Araya-Polo , Jie Meng

Particle-in-Cell (PIC) simulations are fundamental to plasma physics but often suffer from limited scalability due to particle-grid interaction bottlenecks and particle redistribution costs. Specifically, the particle-grid interaction…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-22 Yizhuo Rao , Xingjian Cui , Shangzhi Pang , Jiabin Xie , Guangnan Feng , Jinhui Wei , Ziyan Zhang , Languang Gao , Zhenyu Wang , Zhiguang Chen , Yutong Lu