English
Related papers

Related papers: Inexact Krylov Subspace Algorithms for Large Matri…

200 papers

In this paper, we consider the application of exponential integrators to problems that are advection dominated, either on the entire or on a subset of the domain. In this context, we compare Leja and Krylov based methods to compute the…

Numerical Analysis · Mathematics 2024-10-17 Lukas Einkemmer , Trung-Hau Hoang , Alexander Ostermann

The FEAST eigenvalue algorithm is a subspace iteration algorithm that uses contour integration in the complex plane to obtain the eigenvectors of a matrix for the eigenvalues that are located in any user-defined search interval. By…

Numerical Analysis · Mathematics 2017-06-05 Brendan Gavin , Eric Polizzi

Randomized sketching is currently introduced into every area of numerical linear algebra. In Krylov subspace methods, it allows runtime savings at the cost of small accuracy reductions. This work offers a different view on sketching in…

Numerical Analysis · Mathematics 2026-04-09 Kai Bergermann

Principal component analysis (PCA) has well-documented merits for data extraction and dimensionality reduction. PCA deals with a single dataset at a time, and it is challenged when it comes to analyzing multiple datasets. Yet in certain…

Machine Learning · Computer Science 2017-10-27 Gang Wang , Jia Chen , Georgios B. Giannakis

We propose a modification of linear discriminant analysis, referred to as compressive regularized discriminant analysis (CRDA), for analysis of high-dimensional datasets. CRDA is specially designed for feature elimination purpose and can be…

Methodology · Statistics 2018-04-12 Muhammad Naveed Tabassum , Esa Ollila

Regularized linear discriminant analysis (RLDA) is a widely used tool for classification and dimensionality reduction, but its performance in high-dimensional scenarios is inconsistent. Existing theoretical analyses of RLDA often lack clear…

Machine Learning · Statistics 2025-07-23 Yonghan Zhang , Zhangni Pu , Lu Yan , Jiang Hu

Unsupervised domain adaptation (UDA) aims to transfer and adapt knowledge from a labeled source domain to an unlabeled target domain. Traditionally, subspace-based methods form an important class of solutions to this problem. Despite their…

Machine Learning · Computer Science 2022-01-07 Kowshik Thopalli , Jayaraman J Thiagarajan , Rushil Anirudh , Pavan K Turaga

Data representation techniques have made a substantial contribution to advancing data processing and machine learning (ML). Improving predictive power was the focus of previous representation techniques, which unfortunately perform rather…

Machine Learning · Computer Science 2022-05-24 Qiyou Duan , Hadi Ghauch , Taejoon Kim

We propose a novel algorithm based on inexact GMRES methods for linear response calculations in density functional theory. Such calculations require iteratively solving a nested linear problem $\mathcal{E} \delta\rho = b$ to obtain the…

Numerical Analysis · Mathematics 2025-10-30 Michael F. Herbst , Bonan Sun

Determining physical properties inside an object without access to direct measurements of target regions can be formulated as a specific type of \textit{inverse problem}. One of such problems is applied in \textit{Electrical Impedance…

Numerical Analysis · Mathematics 2023-01-30 Ivan Pombo , Luis Sarmento

An a posteriori estimate for the error of a standard Krylov approximation to the matrix exponential is derived. The estimate is based on the defect (residual) of the Krylov approximation and is proven to constitute a rigorous upper bound on…

Numerical Analysis · Mathematics 2020-02-03 Tobias Jawecki , Winfried Auzinger , Othmar Koch

In this paper, we investigate the application of exponential integrators to advection-dominated problems. We focus on Krylov subspace and Leja interpolation methods to compute the action of exponential and related matrix functions.…

Numerical Analysis · Mathematics 2025-12-04 Thi Tam Dang , Trung Hau Hoang

In this work, we are interested in solving large linear systems stemming from the Extra-Membrane-Intra (EMI) model, which is employed for simulating excitable tissues at a cellular scale. After setting the related systems of partial…

Numerical Analysis · Mathematics 2023-08-24 Pietro Benedusi , Paola Ferrari , Marie Rognes , Stefano Serra-Capizzano

Krylov subspace recycling is a powerful tool for solving long series of large, sparse linear systems that change slowly. In PDE constrained shape optimization, these appear naturally, as hundreds or more optimization steps are needed with…

Numerical Analysis · Mathematics 2020-10-23 Matthias Bolten , Eric de Sturler , Camilla Hahn

We consider the problem of approximating the von Neumann entropy of a large, sparse, symmetric positive semidefinite matrix $A$, defined as $\operatorname{tr}(f(A))$ where $f(x)=-x\log x$. After establishing some useful properties of this…

Numerical Analysis · Mathematics 2023-06-23 Michele Benzi , Michele Rinelli , Igor Simunec

Exponential integrators that use Krylov approximations of matrix functions have turned out to be efficient for the time-integration of certain ordinary differential equations (ODEs). This holds in particular for linear homogeneous ODEs,…

Numerical Analysis · Mathematics 2015-02-25 Antti Koskela , Elias Jarlebring

We propose a novel algorithm for supervised dimensionality reduction named Manifold Partition Discriminant Analysis (MPDA). It aims to find a linear embedding space where the within-class similarity is achieved along the direction that is…

Machine Learning · Computer Science 2020-11-24 Yang Zhou , Shiliang Sun

Mixed-effects models are widely used to model data with hierarchical grouping structures and high-cardinality categorical predictor variables. However, for high-dimensional crossed random effects, current standard computations relying on…

Methodology · Statistics 2026-05-15 Pascal Kündig , Fabio Sigrist

Krylov subspace methods are a powerful family of iterative solvers for linear systems of equations, which are commonly used for inverse problems due to their intrinsic regularization properties. Moreover, these methods are naturally suited…

This paper explores variants of the subspace iteration algorithm for computing approximate invariant subspaces. The standard subspace iteration approach is revisited and new variants that exploit gradient-type techniques combined with a…

Numerical Analysis · Mathematics 2024-05-14 Foivos Alimisis , Yousef Saad , Bart Vandereycken