English
Related papers

Related papers: New Randomized Global Generalized Minimum Residual…

200 papers

This work focuses on developing and motivating a stochastic version of a wellknown inverse problem methodology. Specifically, we consider the iteratively regularized Gauss-Newton method, originally proposed by Bakushinskii for…

Numerical Analysis · Mathematics 2024-09-20 El Houcine Bergou , Neil K. Chada , Youssef Diouane

With the growth of data, it is more important than ever to develop an efficient and robust method for solving the consistent matrix equation AXB=C. The randomized Kaczmarz (RK) method has received a lot of attention because of its…

Numerical Analysis · Mathematics 2025-07-21 Nian-Ci Wu , Yang Zhou , Zhaolu Tian

We consider solution of multiply shifted systems of nonsymmetric linear equations, possibly also with multiple right-hand sides. First, for a single right-hand side, the matrix is shifted by several multiples of the identity. Such problems…

Mathematical Physics · Physics 2008-11-26 Dean Darnell , Ronald B. Morgan , Walter Wilcox

This paper addresses the problem of finding the closest generalized essential matrix from a given $6\times 6$ matrix, with respect to the Frobenius norm. To the best of our knowledge, this nonlinear constrained optimization problem has not…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Pedro Miraldo , Joao R. Cardoso

We describe a parallel approximation algorithm for maximizing monotone submodular functions subject to hereditary constraints on distributed memory multiprocessors. Our work is motivated by the need to solve submodular optimization problems…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-18 Shivaram Gopal , S M Ferdous , Hemanta K. Maji , Alex Pothen

Numerical homogenization and multiscale finite element methods construct effective properties on a coarse grid by solving local problems and extracting the average effective properties from these local solutions. In some cases, the…

Numerical Analysis · Mathematics 2016-06-21 Eric T. Chung , Yalchin Efendiev , Wing Tat Leung , Maria Vasilyeva

In this paper, two efficient iterative algorithms based on the simpler GMRES method are proposed for solving shifted linear systems. To make full use of the shifted structure, the proposed algorithms utilizing the deflated restarting…

Numerical Analysis · Mathematics 2021-07-26 Hong-Xiu Zhong , Xian-Ming Gu

In this work, we develop an alternating nonlinear Generalized Minimum Residual (NGMRES) algorithm with depth $m$ and periodicity $p$, denoted by aNGMRES($m, p$), applied to linear systems. We provide a theoretical analysis to quantify by…

Numerical Analysis · Mathematics 2025-10-31 Yunhui He

This paper introduces a novel error estimator for the Proper Generalized Decomposition (PGD) approximation of parametrized equations. The estimator is intrinsically random: It builds on concentration inequalities of Gaussian maps and an…

Numerical Analysis · Mathematics 2019-10-28 Kathrin Smetana , Olivier Zahm

We consider distributed estimation of the inverse covariance matrix, also called the concentration or precision matrix, in Gaussian graphical models. Traditional centralized estimation often requires global inference of the covariance…

Machine Learning · Statistics 2015-06-15 Zhaoshi Meng , Dennis Wei , Ami Wiesel , Alfred O. Hero

We propose a randomized first order optimization algorithm Gradient Projection Iterative Sketch (GPIS) and an accelerated variant for efficiently solving large scale constrained Least Squares (LS). We provide theoretical convergence…

Optimization and Control · Mathematics 2017-07-18 Junqi Tang , Mohammad Golbabaee , Mike Davies

Randomized algorithms for very large matrix problems have received a great deal of attention in recent years. Much of this work was motivated by problems in large-scale data analysis, and this work was performed by individuals from many…

Data Structures and Algorithms · Computer Science 2011-11-16 Michael W. Mahoney

We propose a generalized multiscale finite element method (GMsFEM) based on clustering algorithm to study the elliptic PDEs with random coefficients in the multi-query setting. Our method consists of offline and online stages. In the…

Numerical Analysis · Mathematics 2018-08-01 Eric T. Chung , Yalchin Efendiev , Wing Tat Leung , Zhiwen Zhang

Consider using the right-preconditioned GMRES (AB-GMRES) for obtaining the minimum-norm solution of inconsistent underdetermined systems of linear equations. Morikuni (Ph.D. thesis, 2013) showed that for some inconsistent and…

Numerical Analysis · Mathematics 2022-05-25 Zeyu Liao , Ken Hayami , Keiichi Morikuni , Jun-Feng Yin

We present a novel greedy Gauss-Seidel method for solving large linear least squares problem. This method improves the greedy randomized coordinate descent (GRCD) method proposed recently by Bai and Wu [Bai ZZ, and Wu WT. On greedy…

Numerical Analysis · Mathematics 2020-04-09 Yanjun Zhang , Hanyu Li

This paper is concerned with the modeling errors appeared in the numerical methods of inverse medium scattering problems (IMSP). Optimization based iterative methods are wildly employed to solve IMSP, which are computationally intensive due…

Numerical Analysis · Mathematics 2021-02-23 Junxiong Jia , Bangyu Wu , Jigen Peng , Jinghuai Gao

The GMRES method is used to solve sparse, non-symmetric systems of linear equations arising from many scientific applications. The solver performance within a single node is memory bound, due to the low arithmetic intensity of its…

Numerical Analysis · Mathematics 2020-11-04 Neil Lindquist , Piotr Luszczek , Jack Dongarra

An inexact semismooth Newton method has been proposed for solving semi-linear elliptic optimal control problems in this paper. This method incorporates the generalized minimal residual (GMRES) method, a type of Krylov subspace method, to…

Optimization and Control · Mathematics 2025-11-14 Shiqi Chen , Xuesong Chen

The randomized Kaczmarz algorithm is one of the most popular approaches for solving large-scale linear systems due to its simplicity and efficiency. In this paper, we propose two classes of global randomized Kaczmarz methods for solving…

Numerical Analysis · Mathematics 2025-12-23 Yu-Qi Niu , Bing Zheng

We extend results known for the randomized Gauss-Seidel and the Gauss-Southwell methods for the case of a Hermitian and positive definite matrix to certain classes of non-Hermitian matrices. We obtain convergence results for a whole range…

Numerical Analysis · Mathematics 2023-01-02 Andreas Frommer , Daniel B. Szyld