English
Related papers

Related papers: A doubly stochastic block Gauss-Seidel algorithm f…

200 papers

For solving large consistent linear systems by iteration methods, inspired by the maximum residual Kaczmarz method and the randomized block Kaczmarz method, we propose the maximum residual block Kaczmarz method, which is designed to…

Numerical Analysis · Mathematics 2024-04-16 Wen-Ning Sun , Mei Qin

In this paper, by regarding the two-subspace Kaczmarz method [20] as an alternated inertial randomized Kaczmarz algorithm we present a new convergence rate estimate which is shown to be better than that in [20] under a mild condition.…

Numerical Analysis · Mathematics 2023-06-16 Songnian He , Ziting Wang , Qiao-Li Dong

This paper deals with linear algebraic equations where the global coefficient matrix and constant vector are given respectively, by the summation of the coefficient matrices and constant vectors of the individual agents. Our approach is…

Optimization and Control · Mathematics 2021-05-28 Priyank Srivastava , Jorge Cortes

A numerical method optimizing the coefficients of the semi empirical mass formula or those of similar mass formulas is presented. The optimization is based on the least-squares adjustments method and leads to the resolution of a linear…

Nuclear Theory · Physics 2022-02-02 Benyoucef Mohammed-Azizi , Hadj Mouloudj

For a symmetric positive semidefinite linear system of equations $\mathcal{Q} {\bf x} = {\bf b}$, where ${\bf x} = (x_1,\ldots,x_s)$ is partitioned into $s$ blocks, with $s \geq 2$, we show that each cycle of the classical block symmetric…

Numerical Analysis · Mathematics 2017-05-24 Xudong Li , Defeng Sun , Kim-Chuan Toh

This paper concerns models and convergence principles for dealing with stochasticity in a wide range of algorithms arising in nonlinear analysis and optimization in Hilbert spaces. It proposes a flexible geometric framework within which…

Optimization and Control · Mathematics 2026-02-17 Patrick L. Combettes , Javier I. Madariaga

Solving linear systems of equations is a fundamental problem in mathematics. When the linear system is so large that it cannot be loaded into memory at once, iterative methods such as the randomized Kaczmarz method excel. Here, we extend…

Numerical Analysis · Mathematics 2020-06-03 Anna Ma , Denali Molitor

In this paper, we propose a stochastic method for solving equality constrained optimization problems that utilizes predictive variance reduction. Specifically, we develop a method based on the sequential quadratic programming paradigm that…

Optimization and Control · Mathematics 2023-03-28 Albert S. Berahas , Jiahao Shi , Zihong Yi , Baoyu Zhou

This paper investigates numerical methods for solving coupled system of nonlinear elliptic problems. We utilize block monotone iterative methods based on Jacobi and Gauss--Seidel methods to solve difference schemes which approximate the…

Numerical Analysis · Mathematics 2018-05-09 Mohamed Al-Sultani

This paper deals with investigating numerical methods for solving coupled system of nonlinear parabolic problems. We utilize block monotone iterative methods based on Jacobi and Gauss--Seidel methods to solve difference schemes which…

Numerical Analysis · Mathematics 2019-05-10 Mohamed Al-Sultani

We propose a doubly stochastic primal-dual coordinate optimization algorithm for empirical risk minimization, which can be formulated as a bilinear saddle-point problem. In each iteration, our method randomly samples a block of coordinates…

Machine Learning · Computer Science 2017-04-13 Adams Wei Yu , Qihang Lin , Tianbao Yang

The construction of the general solution sequence of row-finite linear systems is accomplished by implementing -ad infinitum- the Gauss-Jordan algorithm under a rightmost pivot elimination strategy. The algorithm generates a basis (finite…

Functional Analysis · Mathematics 2014-03-12 Alexandros G. Paraskevopoulos

Recent advancements in quantum computing and quantum-inspired algorithms have sparked renewed interest in binary optimization. These hardware and software innovations promise to revolutionize solution times for complex problems. In this…

The Kaczmarz and Gauss-Seidel methods aim to solve a linear $m \times n$ system $\boldsymbol{X} \boldsymbol{\beta} = \boldsymbol{y}$ by iteratively refining the solution estimate; the former uses random rows of $\boldsymbol{X}$ {to update…

Numerical Analysis · Mathematics 2017-05-15 Ahmed Hefny , Deanna Needell , Aaditya Ramdas

We deal with interval linear systems of equations. We present a new operator, which generalizes the interval Gauss-Seidel method. Also, based on the new operator and properties of the well-known methods, we propose a new algorithm, called…

Numerical Analysis · Mathematics 2019-05-27 Milan Hladík

The Kaczmarz method is an iterative method for solving overcomplete linear systems of equations Ax=b. The randomized version of the Kaczmarz method put forth by Strohmer and Vershynin iteratively projects onto a randomly chosen solution…

Numerical Analysis · Mathematics 2015-06-24 Deanna Needell , Ran Zhao , Anastasios Zouzias

Solving a set of simultaneous linear equations is probably the most important topic in numerical methods. For solving linear equations, iterative methods are preferred over the direct methods especially when the coefficient matrix is…

Neural and Evolutionary Computing · Computer Science 2013-04-09 R. M. Jalal Uddin Jamali , M. M. A. Hashem , M. Mahfuz Hasan , Md. Bazlar Rahman

The randomized version of the Kaczmarz method for the solution of linear systems is known to converge linearly in expectation. In this work we extend this result and show that the recently proposed Randomized Sparse Kaczmarz method for…

Optimization and Control · Mathematics 2016-10-11 Frank Schöpfer , Dirk A. Lorenz

Randomized regularized Kaczmarz algorithms have recently been proposed to solve tensor recovery models with {\it consistent} linear measurements. In this work, we propose a novel algorithm based on the randomized extended Kaczmarz algorithm…

Numerical Analysis · Mathematics 2021-12-17 Kui Du , Xiao-Hui Sun

The randomized Kaczmarz algorithm has received considerable attention recently because of its simplicity, speed, and the ability to approximately solve large-scale linear systems of equations. In this paper we propose randomized double and…

Numerical Analysis · Mathematics 2020-10-28 Kui Du , Xiao-Hui Sun