English
Related papers

Related papers: Computationally enhanced projection methods for sy…

200 papers

Flexible Krylov methods are a common standpoint for inverse problems. In particular, they are used to address the challenges associated with explicit variational regularization when it goes beyond the two-norm, for example involving an…

Numerical Analysis · Mathematics 2025-10-22 Malena Sabaté Landman

With appropriately chosen sampling probabilities, sampling-based random projection can be used to implement large-scale statistical methods, substantially reducing computational cost while maintaining low statistical error. However,…

Machine Learning · Statistics 2026-01-13 Yifan Chen , Yun Yang

Randomized block Krylov subspace methods form a powerful class of algorithms for computing the extreme eigenvalues of a symmetric matrix or the extreme singular values of a general matrix. The purpose of this paper is to develop new…

Numerical Analysis · Mathematics 2021-10-05 Joel A. Tropp

We study structure-preserving Krylov subspace methods for approximating the matrix-vector products f(H)b, where H is a large Hamiltonian matrix and f denotes either the matrix exponential or the related phi-function. Such computations are…

Numerical Analysis · Mathematics 2026-02-24 Peter Benner , Heike Faßbender , Michel-Niklas Senn

The paper presents two variants of a Krylov-Simplex iterative method that combines Krylov and simplex iterations to minimize the residual $r = b-Ax$. The first method minimizes $\|r\|_\infty$, i.e. maximum of the absolute residuals. The…

Numerical Analysis · Mathematics 2021-01-28 Wim Vanroose , Jeffrey Cornelis

The numerical solution of large-scale Lyapunov matrix equations with symmetric banded data has so far received little attention in the rich literature on Lyapunov equations. We aim to contribute to this open problem by introducing two…

Numerical Analysis · Mathematics 2018-04-16 Davide Palitta , Valeria Simoncini

Several problems in machine learning, statistics, and other fields rely on computing eigenvectors. For large scale problems, the computation of these eigenvectors is typically performed via iterative schemes such as subspace iteration or…

Numerical Analysis · Mathematics 2020-11-03 Vasileios Charisopoulos , Austin R. Benson , Anil Damle

Classical Krylov subspace projection methods for the solution of linear problem $Ax = b$ output an approximate solution $\widetilde{x}\simeq x$. Recently, it has been recognized that projection methods can be understood from a statistical…

Numerical Analysis · Mathematics 2024-02-09 Vladimir Fanaskov

In this paper we present deflation and augmentation techniques that have been designed to accelerate the convergence of Krylov subspace methods for the solution of linear systems of equations. We review numerical approaches both for linear…

Numerical Analysis · Mathematics 2013-03-25 Olivier Coulaud , Luc Giraud , Pierre Ramet , Xavier Vasseur

Randomized Krylov subspace methods that employ the sketch-and-solve paradigm to substantially reduce orthogonalization cost have recently shown great promise in speeding up computations for many core linear algebra tasks (e.g., solving…

Numerical Analysis · Mathematics 2026-03-13 Emil Krieger , Marcel Schweitzer

This work is devoted to establish the strong convergence results of an iterative algorithm generated by the shrinking projection method in Hilbert spaces. The proposed approximation sequence is used to find a common element in the set of…

Functional Analysis · Mathematics 2018-03-07 Abdul Ghaffar , Zafar Ullah , Muhammad Aqeel Ahmad Khan , Faisal Mumtaz

In this work, we consider a class of convex optimization problems in a real Hilbert space that can be solved by performing a single projection, i.e., by projecting an infeasible point onto the feasible set. Our results improve those…

Optimization and Control · Mathematics 2024-04-10 Hoa T. Bui , Regina S. Burachik , Evgeni A. Nurminski , Matthew K. Tam

We consider the solution of the Sylvester equation $AX+XB=C$ in mixed precision. We derive a new iterative refinement scheme to solve perturbed quasi-triangular Sylvester equations; our rounding error analysis provides sufficient conditions…

Numerical Analysis · Mathematics 2026-03-27 Andrii Dmytryshyn , Massimiliano Fasi , Nicholas J. Higham , Xiaobo Liu

In the numerical solution of the algebraic Riccati equation $A^* X + X A - X BB^* X + C^* C =0$, where $A$ is large, sparse and stable, and $B$, $C$ have low rank, projection methods have recently emerged as a possible alternative to the…

Numerical Analysis · Mathematics 2016-02-02 V. Simoncini

We present a preconditioner based on spectral projection that is combined with a deflated Krylov subspace method for solving ill conditioned linear systems of equations. Our results show that the proposed algorithm requires many fewer…

Numerical Analysis · Mathematics 2016-09-23 Man-Chung Yeung , Craig C. Douglas , Long Lee

Smoothing accelerated gradient methods achieve faster convergence rates than that of the subgradient method for some nonsmooth convex optimization problems. However, Nesterov's extrapolation may require gradients at infeasible points, and…

Optimization and Control · Mathematics 2025-04-24 Akatsuki Nishioka , Yoshihiro Kanno

This work is on a user-friendly reduced basis method for solving a family of parametric PDEs by preconditioned Krylov subspace methods including the conjugate gradient method, generalized minimum residual method, and bi-conjugate gradient…

Numerical Analysis · Mathematics 2026-02-24 Yuwen Li , Ludmil T. Zikatanov , Cheng Zuo

Linear matrix equations, such as the Sylvester and Lyapunov equations, play an important role in various applications, including the stability analysis and dimensionality reduction of linear dynamical control systems and the solution of…

Numerical Analysis · Mathematics 2019-05-30 Daniel Kressner , Stefano Massei , Leonardo Robol

This paper presents two new augmented flexible (AF)-Krylov subspace methods, AF-GMRES and AF-LSQR, to compute solutions of large-scale linear discrete ill-posed problems that can be modeled as the sum of two independent random variables,…

Numerical Analysis · Mathematics 2023-10-10 Malena Sabate Landman , Jiahua Jiang , Jianru Zhang , Wuwei Ren

This paper deals with supervised classification and feature selection in high dimensional space. A classical approach is to project data on a low dimensional space and classify by minimizing an appropriate quadratic cost. A strict control…

Machine Learning · Computer Science 2019-12-02 Michel Barlaud , Antonin Chambolle , Jean-Baptiste Caillau