English
Related papers

Related papers: Infinite GMRES for parameterized linear systems

200 papers

The GMRES algorithm of Saad and Schultz (1986) is an iterative method for approximately solving linear systems $A{\bf x}={\bf b}$, with initial guess ${\bf x}_0$ and residual ${\bf r}_0 = {\bf b} - A{\bf x}_0$. The algorithm employs the…

Numerical Analysis · Mathematics 2023-03-22 Stephen Thomas , Erin Carson , Miro Rozložník , Arielle Carr , Kasia Świrydowicz

We consider an effective new method for solving trust-region and norm-regularization problems that arise as subproblems in many optimization applications. We show that the solutions to such subproblems effectively lie in a…

Numerical Analysis · Mathematics 2026-03-03 Hussam Al Daas , Nicholas I. M. Gould

A new algorithm is presented for computing a canonical rank-R tensor approximation that has minimal distance to a given tensor in the Frobenius norm, where the canonical rank-R tensor consists of the sum of R rank-one components. Each…

Numerical Analysis · Mathematics 2011-05-27 Hans De Sterck

Efficient algorithms for the sparse solution of under-determined linear systems $Ax = b$ are known for matrices $A$ satisfying suitable assumptions like the restricted isometry property (RIP). Without such assumptions little is known and…

Machine Learning · Computer Science 2021-01-22 G. Welper

We consider adaptive approximations of the parameter-to-solution map for elliptic operator equations depending on a large or infinite number of parameters, comparing approximation strategies of different degrees of nonlinearity: sparse…

Numerical Analysis · Mathematics 2017-04-04 Markus Bachmayr , Albert Cohen , Wolfgang Dahmen

We present a complexity reduction algorithm for a family of parameter-dependent linear systems when the system parameters belong to a compact semi-algebraic set. This algorithm potentially describes the underlying dynamical system with…

Systems and Control · Computer Science 2012-09-25 Farhad Farokhi , Henrik Sandberg , Karl H. Johansson

We consider the uniform approximation of the smallest eigenvalue of a large parameter-dependent Hermitian matrix by that of a smaller counterpart obtained through projections. The projection subspaces are constructed iteratively by means of…

Numerical Analysis · Mathematics 2026-01-16 Mattia Manucci , Emre Mengi , Nicola Guglielmi

Finite linear least squares is one of the core problems of numerical linear algebra, with countless applications across science and engineering. Consequently, there is a rich and ongoing literature on algorithms for solving linear least…

Numerical Analysis · Mathematics 2021-10-27 Paz Fink Shustin , Haim Avron

This paper proposes a matrix-free residual evaluation technique for the hybridizable discontinuous Galerkin method requiring a number of operations scaling only linearly with the number of degrees of freedom. The method results from…

Numerical Analysis · Mathematics 2020-07-24 Immo Huismann , Jörg Stiller , Jochen Fröhlich

We compare two approaches to compute a portion of the spectrum of dense symmetric definite generalized eigenproblems: one is based on the reduction to tridiagonal form, and the other on the Krylov-subspace iteration. Two large-scale…

We propose NEP_MiniMax, a novel computational method for solving nonlinear eigenvalue problems (NEPs) $T(\lambda)\mathbf{u}= 0$ on compact continua $\Omega \subset \mathbb{C}$. The method combines two key components: (1) a rational minimax…

Numerical Analysis · Mathematics 2026-03-17 Chenkun Zhang , Jiawei Gu , Lei-Hong Zhang

In some cases, computational benefit can be gained by exploring the hyper parameter space using a deterministic set of grid points instead of a Markov chain. We view this as a numerical integration problem and make three unique…

Computation · Statistics 2016-09-30 Chaitanya Joshi , Paul T. Brown , Stephen Joe

In this paper we construct nonlinear partial differential equations in more than 3 independent variables, possessing a manifold of analytic solutions with high, but not full, dimensionality. For this reason we call them ``partially…

Exactly Solvable and Integrable Systems · Physics 2009-11-11 A. I. Zenchuk , P. M. Santini

In this work, we introduce a highly efficient algorithm to address the nonnegative matrix underapproximation (NMU) problem, i.e., nonnegative matrix factorization (NMF) with an additional underapproximation constraint. NMU results are…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Mariano Tepper , Guillermo Sapiro

Performing Bayesian inference on large spatio-temporal models requires extracting inverse elements of large sparse precision matrices for marginal variances, as well as estimating model hyperparameters. Although direct matrix factorizations…

Computation · Statistics 2026-03-17 Abylay Zhumekenov , Elias T. Krainski , Håvard Rue

Modeling complex multiway relationships in large-scale networks is becoming more and more challenging in data science. The multilinear PageRank problem, arising naturally in the study of higher-order Markov chains, is a powerful framework…

Numerical Analysis · Mathematics 2025-09-30 Maryam Boubekraoui , Ridwane Tahiri

In this work, the matrix-free solution of quasi-static phase-field fracture problems is further investigated. More specifically, we consider a quasi-monolithic formulation in which the irreversibility constraint is imposed with a…

Numerical Analysis · Mathematics 2024-08-27 Leon Maximilian Kolditz , Thomas Wick

We introduce a parallel algorithm to construct a preconditioner for solving a large, sparse linear system where the coefficient matrix is a Laplacian matrix (a.k.a., graph Laplacian). Such a linear system arises from applications such as…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-30 Tianyu Liang , Chao Chen , Yotam Yaniv , Hengrui Luo , David Tench , Xiaoye S. Li , Aydin Buluc , James Demmel

We examine the problem of approximating a positive, semidefinite matrix $\Sigma$ by a dyad $xx^T$, with a penalty on the cardinality of the vector $x$. This problem arises in sparse principal component analysis, where a decomposition of…

Optimization and Control · Mathematics 2007-06-13 Laurent El Ghaoui

The Nonlinear GMRES (NGMRES) proposed by Washio and Oosterlee [Electron. Trans. Numer. Anal, 6(271-290), 1997] is an acceleration method for fixed point iterations. It has been demonstrated to be effective, but its convergence properties…

Numerical Analysis · Mathematics 2026-02-11 Chen Greif , Yunhui He