English
Related papers

Related papers: An Asynchronous Parallel Randomized Kaczmarz Algor…

200 papers

Developing large-scale distributed methods that are robust to the presence of adversarial or corrupted workers is an important part of making such methods practical for real-world problems. Here, we propose an iterative approach that is…

Machine Learning · Computer Science 2022-03-02 Xia Li , Longxiu Huang , Deanna Needell

The Extended Randomized Kaczmarz method is a well known iterative scheme which can find the Moore-Penrose inverse solution of a possibly inconsistent linear system and requires only one additional column of the system matrix in each…

Numerical Analysis · Mathematics 2022-07-21 Frank Schöpfer , Dirk A Lorenz , Lionel Tondji , Maximilian Winkler

In [Steinerberger, Q. Appl. Math., 79:3, 419-429, 2021] and [Shao, SIAM J. Matrix Anal. Appl. 44(1), 212-239, 2023], two new types of Kaczmarz algorithms, which share some similarities, for consistent linear systems were proposed. These two…

Numerical Analysis · Mathematics 2024-07-30 Changpeng Shao

In this paper, we discuss the acceleration of the regularized alternating least square (RALS) algorithm for tensor approximation. We propose a fast iterative method using a Aitken-Stefensen like updates for the regularized algorithm.…

Numerical Analysis · Mathematics 2017-07-25 Xiaofei Wang , Carmeliza Navasca , Stefan Kindermann

In this paper we present Kvik: an implementation of a task-based "middleware" for shared memory parallel programming in the Rust language built on top of the Rayon library. We devise a system allowing several task-splitting schedulers to be…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-14 Saurabh Raje , Frédéric Wagner

A class of averaging block nonlinear Kaczmarz methods is developed for the solution of the nonlinear system of equations. The convergence theory of the proposed method is established under suitable assumptions and the upper bounds of the…

Numerical Analysis · Mathematics 2023-07-31 Aqin Xiao , Junfeng Yin

We present a family of automata networks that solve the k-parity problem when run in parallel. These solutions are constructed by connecting cliques in a non-cyclical fashion. The size of the local neighbourhood is linear in the size of the…

Discrete Mathematics · Computer Science 2024-02-06 Pacôme Perrotin , Eurico Ruivo , Pedro Paulo Balbi

In the field of quantum linear system algorithms, quantum computing has realized exponential computational advantages over classical computing. However, the focus has been on square coefficient matrices, with few quantum algorithms…

Quantum Physics · Physics 2024-09-10 Weitao Lin , Guojing Tian , Xiaoming Sun

This paper investigates the convergence of the randomized Kaczmarz algorithm for the problem of phase retrieval of complex-valued objects. While this algorithm has been studied for the real-valued case}, its generalization to the…

Information Theory · Computer Science 2020-10-14 Teng Zhang , Feng Yu

In the area of Pattern Recognition and Matching, finding a Longest Common Subsequence plays an important role. In this paper, we have proposed one algorithm based on parallel computation. We have used OpenMP API package as middleware to…

Data Structures and Algorithms · Computer Science 2013-06-20 Tirtharaj Dash , Tanistha Nayak

In this paper, based on an optimization problem, a sketch-and-project method for solving the linear matrix equation AXB = C is proposed. We provide a thorough convergence analysis for the new method and derive a lower bound on the…

Numerical Analysis · Mathematics 2023-06-07 Wendi Bao , Zhiwei Guo , Weiguo Li , Ying Lv , Jichao Wang

We describe ASAGA, an asynchronous parallel version of the incremental gradient algorithm SAGA that enjoys fast linear convergence rates. Through a novel perspective, we revisit and clarify a subtle but important technical issue present in…

Optimization and Control · Mathematics 2017-11-09 Rémi Leblond , Fabian Pedregosa , Simon Lacoste-Julien

Basing on a modification of the "Dichotomy Algorithm" (Terekhov, 2010), we propose a parallel procedure for solving tridiagonal systems of equations with Toeplitz matrices. Taking the structure of the Toeplitz matrices, we may substantially…

Numerical Analysis · Mathematics 2015-12-15 Andrew V. Terekhov

This work presents a comparison for the performance of sequential sorting algorithms under four different modes of execution, the sequential processing mode, a conventional multi-threading implementation, multi-threading with OpenMP Library…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-07 Mohammad Fasha

This paper first proposes an N-block PCPM algorithm to solve N-block convex optimization problems with both linear and nonlinear constraints, with global convergence established. A linear convergence rate under the strong second-order…

Optimization and Control · Mathematics 2021-03-26 Run Chen , Andrew L. Liu

This paper proposes a general formulation for temporal parallelisation of dynamic programming for optimal control problems. We derive the elements and associative operators to be able to use parallel scans to solve these problems with…

Optimization and Control · Mathematics 2022-01-25 Simo Särkkä , Ángel F. García-Fernández

In this paper, we consider the problem of solving linear algebraic equations of the form $Ax=b$ among multi agents which seek a solution by using local information in presence of random communication topologies. The equation is solved by…

Systems and Control · Computer Science 2018-09-24 S. Sh. Alaviani , N. Elia

To find the least squares solution of a very large and inconsistent system of equations, one can employ the extended Kaczmarz algorithm. This method simultaneously removes the error term, such that a consistent system is asymptotically…

Numerical Analysis · Mathematics 2015-04-02 Stefania Petra , Constantin Popa

The method of alternation projections (MAP) is an iterative procedure for finding the projection of a point on the intersection of closed subspaces of an Hilbert space. The convergence of this method is usually slow, and several methods for…

Numerical Analysis · Mathematics 2013-02-04 Claude Brezinski , Michela Redivo-Zaglia

A distributed algorithm is described for solving a linear algebraic equation of the form $Ax=b$ assuming the equation has at least one solution. The equation is simultaneously solved by $m$ agents assuming each agent knows only a subset of…

Systems and Control · Computer Science 2015-03-04 Shaoshuai Mou , Ji Liu , A. Stephen Morse