English
Related papers

Related papers: Communication-Avoiding Parallel Algorithms for Sol…

200 papers

We present new algorithms to detect and correct errors in the lower-upper factorization of a matrix, or the triangular linear system solution, over an arbitrary field. Our main algorithms do not require any additional information or…

Symbolic Computation · Computer Science 2019-01-31 Jean-Guillaume Dumas , Joris Van Der Hoeven , Clément Pernet , Daniel Roche

A cumbersome operation in numerical analysis and linear algebra, optimization, machine learning and engineering algorithms; is inverting large full-rank matrices which appears in various processes and applications. This has both numerical…

Numerical Analysis · Mathematics 2022-06-24 Neophytos Charalambides , Mert Pilanci , Alfred O. Hero

We introduce a family of numerical algorithms for the solution of linear system in higher dimensions with the matrix and right hand side given and the solution sought in the tensor train format. The proposed methods are rank--adaptive and…

Numerical Analysis · Mathematics 2014-10-07 Sergey V. Dolgov , Dmitry V. Savostyanov

Numerical solution of partial differential equations on parallel computers using domain decomposition usually requires synchronization and communication among the processors. These operations often have a significant overhead in terms of…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-11 Soumyadip Ghosh , Jiacai Lu , Vijay Gupta , Gretar Tryggvason

We derive a parallel sampling algorithm for computational inverse problems that present an unknown linear forcing term and a vector of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of…

Numerical Analysis · Mathematics 2022-03-24 Darko Volkov

Network alignment has extensive applications in comparative interactomics. Traditional approaches aim to simultaneously maximize the number of conserved edges and the underlying similarity of aligned entities. We propose a novel formulation…

Computational Engineering, Finance, and Science · Computer Science 2018-08-23 Shahin Mohammadi , David Gleich , Tamara Kolda , Ananth Grama

Triangular factorizations are an important tool for solving integral equations and partial differential equations with hierarchical matrices ($\mathcal{H}$-matrices). Experiments show that using an $\mathcal{H}$-matrix LR factorization to…

Numerical Analysis · Mathematics 2019-05-28 Steffen Börm

Basing on a modification of the "Dichotomy Algorithm" (Terekhov, 2010), we propose a parallel procedure for solving tridiagonal systems of equations with Toeplitz matrices. Taking the structure of the Toeplitz matrices, we may substantially…

Numerical Analysis · Mathematics 2015-12-15 Andrew V. Terekhov

In this paper, we consider an approach to the parallelizing of the algorithms realizing the modified probability changigng method with adaptation and partial rollback procedure for constrained pseudo-Boolean optimization problems. Existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-09-03 Lev Kazakovtsev

We present three methods for distributed memory parallel inverse factorization of block-sparse Hermitian positive definite matrices. The three methods are a recursive variant of the AINV inverse Cholesky algorithm, iterative refinement, and…

Numerical Analysis · Mathematics 2024-12-20 Anton G. Artemov , Elias Rudberg , Emanuel H. Rubensson

A new approach is discussed for solving large nonsymmetric systems of linear equations with multiple right-hand sides. The first system is solved with a deflated GMRES method that generates eigenvector information at the same time that the…

Mathematical Physics · Physics 2007-05-23 Ronald B. Morgan , Walter Wilcox

We present the first parallel algorithm for solving systems of linear equations in symmetric, diagonally dominant (SDD) matrices that runs in polylogarithmic time and nearly-linear work. The heart of our algorithm is a construction of a…

Numerical Analysis · Computer Science 2013-11-14 Richard Peng , Daniel A. Spielman

This paper proposes Inverse Gram Matrix (IGM) methods to prioritize the Pairwise Reciprocal Matrix (PRM) in the Analytic Hierarchy Process. The IGM methods include Pseudo-IGM, Normalized-IGM, and Lagrange-IGM. Interestingly, the proposed…

Optimization and Control · Mathematics 2024-01-03 Kevin Kam Fung Yuen

In this paper, we introduce novel fast matrix inversion algorithms that leverage triangular decomposition and recurrent formalism, incorporating Strassen's fast matrix multiplication. Our research places particular emphasis on triangular…

Numerical Analysis · Mathematics 2026-02-05 Mohamed Kamel Riahi

A new class of parallel algorithms is introduced that can achieve a complexity of O(n^3/2) with respect to the interprocessor communication, in the exact computation of systems with pairwise mutual interactions of all elements. Hitherto,…

High Energy Physics - Lattice · Physics 2008-02-03 Th. Lippert , A. Seyfried , A. Bode , K. Schilling

The low multilinear rank approximation, also known as the truncated Tucker decomposition, has been extensively utilized in many applications that involve higher-order tensors. Popular methods for low multilinear rank approximation usually…

Numerical Analysis · Mathematics 2021-04-05 Chuanfu Xiao , Chao Yang , Min Li

An algorithm is discussed for converting a class of recursive processes to a parallel system. It is argued that this algorithm can be superior to certain methods currently found in the literature for an important subset of problems. The…

Computational Physics · Physics 2009-11-10 W. R. Gibbs

In this study, we develop a new parallel algorithm for solving systems of linear algebraic equations with the same block-tridiagonal matrix but with different right-hand sides. The method is a generalization of the parallel dichotomy…

Numerical Analysis · Mathematics 2013-04-22 Andrew V. Terekhov

Based on the tensor-based large margin distribution and the nonparallel support tensor machine, we establish a novel classifier for binary classification problem in this paper, termed the Large Margin Distribution based NonParallel Support…

Optimization and Control · Mathematics 2025-07-18 Zhuolin Du , Yisheng Song

In this paper we study the tradeoff between parallelism and communication cost in a map-reduce computation. For any problem that is not "embarrassingly parallel," the finer we partition the work of the reducers so that more parallelism can…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-06-21 Foto N. Afrati , Anish Das Sarma , Semih Salihoglu , Jeffrey D. Ullman