English
Related papers

Related papers: Greedy Block Gauss-Seidel Methods for Solving Larg…

200 papers

A parameter-free method, namely the generalization of the Gauss-Seidel (GGS) method, is developed to solve generalized absolute value equations. Convergence of the proposed method is analyzed. Numerical results are given to demonstrate the…

Numerical Analysis · Mathematics 2025-05-05 Tingting Luo , Jiayu Liu , Cairong Chen , Linjie Chen , Changfeng Ma

This paper studies the effective convergence of iterative methods for solving convex minimization problems using block Gauss--Seidel algorithms. It investigates whether it is always possible to algorithmically terminate the iteration in…

Optimization and Control · Mathematics 2025-01-23 Holger Boche , Volker Pohl , H. Vincent Poor

For solving the large-scale linear system by iteration methods, we utilize the Petrov-Galerkin conditions and relaxed greedy index selection technique and provide two relaxed greedy deterministic row (RGDR) and column (RGDC) iterative…

Numerical Analysis · Mathematics 2022-08-12 Nian-Ci Wu , Ling-Xia Cui , Qian Zuo

We extend results known for the randomized Gauss-Seidel and the Gauss-Southwell methods for the case of a Hermitian and positive definite matrix to certain classes of non-Hermitian matrices. We obtain convergence results for a whole range…

Numerical Analysis · Mathematics 2023-01-02 Andreas Frommer , Daniel B. Szyld

Combining kernel-based collocation methods with time-stepping methods to solve parabolic partial differential equations can potentially introduce challenges in balancing temporal and spatial discretization errors. Typically, using kernels…

Numerical Analysis · Mathematics 2024-10-25 Yichen Su , Leevan Ling

Given a set ${\cal R}=\{R_1,R_2,..., R_n\}$ of $n$ randomly positioned axis parallel rectangles in 2D, the problem of computing the minimum clique cover (MCC) and maximum independent set (MIS) for the intersection graph $G({\cal R})$ of the…

Computational Geometry · Computer Science 2012-12-05 Ritankar Mandal , Anirban Ghosh , Sasanka Roy , Subhas C. Nandy

Consider solving large sparse range symmetric singular linear systems $ A {\bf x}= {\bf b} $ which arise, for instance, in the discretization of convection diffusion equations with periodic boundary conditions, and partial differential…

Numerical Analysis · Mathematics 2022-11-02 Kota Sugihara , Ken Hayami , Liao Zeyu

The GMRES algorithm of Saad and Schultz (1986) is an iterative method for approximately solving linear systems $A{\bf x}={\bf b}$, with initial guess ${\bf x}_0$ and residual ${\bf r}_0 = {\bf b} - A{\bf x}_0$. The algorithm employs the…

Numerical Analysis · Mathematics 2023-03-22 Stephen Thomas , Erin Carson , Miro Rozložník , Arielle Carr , Kasia Świrydowicz

We develop a novel randomized conjugate gradient least squares (RCGLS) method for solving least-squares problems, in which iterative sketching is employed at each step to reduce the dimension and hence the computational cost. In particular,…

Numerical Analysis · Mathematics 2026-05-26 Yun Zeng , Jian-Feng Cai , Deren Han , Jiaxin Xie

We study the iterative methods for large moment systems derived from the linearized Boltzmann equation. By Fourier analysis, it is shown that the direct application of the block symmetric Gauss-Seidel (BSGS) method has slower convergence…

Numerical Analysis · Mathematics 2024-07-11 Xiaoyu Dong , Zhenning Cai

A second-order block coordinate descent method is proposed for the unconstrained minimization of an objective function with a Lipschitz continuous Hessian. At each iteration, a block of variables is selected by means of a greedy…

Optimization and Control · Mathematics 2025-10-14 Andrea Cristofari

In this paper we consider the task of estimating the non-zero pattern of the sparse inverse covariance matrix of a zero-mean Gaussian random vector from a set of iid samples. Note that this is also equivalent to recovering the underlying…

Machine Learning · Computer Science 2012-02-28 Christopher C. Johnson , Ali Jalali , Pradeep Ravikumar

We propose a simple doubly stochastic block Gauss--Seidel algorithm for solving linear systems of equations. By varying the row partition parameter and the column partition parameter of the coefficient matrix, we recover the Landweber…

Numerical Analysis · Mathematics 2020-07-09 Kui Du , Xiaohui Sun

Block coordinate descent (BCD) methods are widely used for large-scale numerical optimization because of their cheap iteration costs, low memory requirements, amenability to parallelization, and ability to exploit problem structure. Three…

Optimization and Control · Mathematics 2022-08-02 Julie Nutini , Issam Laradji , Mark Schmidt

It is well known that as a famous type of iterative methods in numerical linear algebra, Gauss-Seidel iterative methods are convergent for linear systems with strictly or irreducibly diagonally dominant matrices, invertible $H-$matrices…

Numerical Analysis · Mathematics 2014-10-14 Cheng-yi Zhang , Dan Ye , Cong-lei Zhong , Shuanghua Luo

Recently, Krukier et al. [Generalized skew-Hermitian triangular splitting iteration methods for saddle-point linear systems, Numer. Linear Algebra Appl. 21 (2014) 152-170] proposed an efficient generalized skew-Hermitian triangular…

Numerical Analysis · Mathematics 2014-02-25 Yan Dou , Ai-Li Yang , Yu-Jiang Wu

Inverse imaging problems rely on limited and indirect measurements, making reconstruction highly dependent on both regularization and sample locations. We introduce a novel greedy framework for the optimal selection of indirect measurements…

Numerical Analysis · Mathematics 2025-12-04 L. Bruni Bruno , P. Massa , E. Perracchione , M. Trombini

For a symmetric positive semidefinite linear system of equations $\mathcal{Q} {\bf x} = {\bf b}$, where ${\bf x} = (x_1,\ldots,x_s)$ is partitioned into $s$ blocks, with $s \geq 2$, we show that each cycle of the classical block symmetric…

Numerical Analysis · Mathematics 2017-05-24 Xudong Li , Defeng Sun , Kim-Chuan Toh

Cost-efficient compressive sensing is challenging when facing large-scale data, {\em i.e.}, data with large sizes. Conventional compressive sensing methods for large-scale data will suffer from low computational efficiency and massive…

Data Structures and Algorithms · Computer Science 2016-03-18 Sung-Hsien Hsieh , Chun-Shien Lu , Soo-Chang Pei

This paper defines a generalized column subset selection problem which is concerned with the selection of a few columns from a source matrix A that best approximate the span of a target matrix B. The paper then proposes a fast greedy…

Data Structures and Algorithms · Computer Science 2013-12-25 Ahmed K. Farahat , Ali Ghodsi , Mohamed S. Kamel