English
Related papers

Related papers: Low-Rank SPIKE Framework for Solving Large Sparse …

200 papers

The paradigm of differentiable programming has significantly enhanced the scope of machine learning via the judicious use of gradient-based optimization. However, standard differentiable programming methods (such as autodiff) typically…

As integrated circuits become increasingly complex, the demand for efficient and accurate simulation solvers continues to rise. Traditional solvers often struggle with large-scale sparse systems, leading to prolonged simulation times and…

Numerical Analysis · Mathematics 2025-09-12 Zijian Zhang , Rui Hong , Xuesong Chen , Shuting Cai

The efficient solution of discretisations of coupled systems of partial differential equations (PDEs) is at the core of much of numerical simulation. Significant effort has been expended on scalable algorithms to precondition Krylov…

Mathematical Software · Computer Science 2018-02-22 Robert C. Kirby , Lawrence Mitchell

Iterative methods for solving large sparse systems of linear equations are widely used in many HPC applications. Extreme scaling of these methods can be difficult, however, since global communication to form dot products is typically…

Mathematical Software · Computer Science 2020-09-29 Nick Brown , J. Mark Bull , Iain Bethune

We present a new computational approach to approximating a large, noisy data table by a low-rank matrix with sparse singular vectors. The approximation is obtained from thresholded subspace iterations that produce the singular vectors…

Methodology · Statistics 2011-12-13 Dan Yang , Zongming Ma , Andreas Buja

In the paper, we propose a collocation method based on multivariate polynomial splines over triangulation or tetrahedralization for solving Stokes and Navier-Stokes equations. We start with a detailed explanation of the method for the…

Numerical Analysis · Mathematics 2023-12-11 Jinsil Lee

In the fields of control theory and machine learning, the dynamic low-rank approximation for large-scale matrices has received substantial attention. Considering large-scale semilinear stiff matrix differential equations, we propose…

Numerical Analysis · Mathematics 2025-10-14 Zi Wu , Yong-Liang Zhao , Xian-Ming Gu

Semidefinite programming (SDP) problems are challenging to solve because of their high dimensionality. However, solving sparse SDP problems with small tree-width are known to be relatively easier because: (1) they can be decomposed into…

Optimization and Control · Mathematics 2024-11-01 Tianyun Tang , Kim-Chuan Toh

Pseudospectral analysis is fundamental for quantifying the sensitivity and transient behavior of nonnormal matrices, yet its computational cost scales cubically with dimension, rendering it prohibitive for large-scale systems. While…

Numerical Analysis · Mathematics 2026-02-03 Vladimir R. Kostic , Dragana Lj. Cvetkovic , Ljiljana Cvetkovic

Sparse linear systems are typically solved using preconditioned iterative methods, but applying preconditioners via sparse triangular solves introduces bottlenecks due to irregular memory accesses and data dependencies. This work leverages…

Performance · Computer Science 2025-08-08 Atharva Gondhalekar , Kjetil Haugen , Thomas Gibson , Wu-chun Feng

Hyperspectral images provide abundant spatial and spectral information that is very valuable for material detection in diverse areas of practical science. The high-dimensions of data lead to many processing challenges that can be addressed…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Saeideh Ghanbari Azar , Saeed Meshgini , Tohid Yousefi Rezaii , Soosan Beheshti

We consider the problem of efficiently solving Sylvester and Lyapunov equations of medium and large scale, in case of rank-structured data, i.e., when the coefficient matrices and the right-hand side have low-rank off-diagonal blocks. This…

Numerical Analysis · Mathematics 2018-08-23 Stefano Massei , Davide Palitta , Leonardo Robol

Block elimination algorithms for solving sparse discrete optimization problems are considered. The numerical example is provided. The benchmarking is done in order to define real computational capabilities of block elimination algorithms…

Discrete Mathematics · Computer Science 2012-01-04 Alexander Sviridenko , Oleg Shcherbina

In this paper, we propose a low rank approximation method for efficiently solving stochastic partial differential equations. Specifically, our method utilizes a novel low rank approximation of the stiffness matrices, which can significantly…

Numerical Analysis · Mathematics 2023-10-20 Yujun Zhu , Ju Ming , Jie Zhu , Zhongming Wang

In contrast with many other convex optimization classes, state-of-the-art semidefinite programming solvers are yet unable to efficiently solve large scale instances. This work aims to reduce this scalability gap by proposing a novel…

Optimization and Control · Mathematics 2018-12-20 Mario Souto , Joaquim D. Garcia , Alvaro Veiga

The paper describes a sparse direct solver for the linear systems that arise from the discretization of an elliptic PDE on a two dimensional domain. The scheme decomposes the domain into thin subdomains, or ``slabs'' and uses a two-level…

Numerical Analysis · Mathematics 2025-09-01 Anna Yesypenko , Per-Gunnar Martinsson

Recent work has demonstrated that using a carefully designed sensing matrix rather than a random one, can improve the performance of compressed sensing. In particular, a well-designed sensing matrix can reduce the coherence between the…

Information Theory · Computer Science 2010-09-09 Kevin Rosenblum , Lihi Zelnik-Manor , Yonina C. Eldar

Direct factorization methods for the solution of large, sparse linear systems that arise from PDE discretizations are robust, but typically show poor time and memory scalability for large systems. In this paper, we describe an efficient…

Numerical Analysis · Computer Science 2015-07-21 Jeffrey N. Chadwick , David S. Bindel

In this work, we develop a new fast algorithm, spaQR -- sparsified QR, for solving large, sparse linear systems. The key to our approach is using low-rank approximations to sparsify the separators in a Nested Dissection based Householder QR…

Numerical Analysis · Mathematics 2020-10-15 Abeynaya Gnanasekaran , Eric Darve

Recursive blocked algorithms have proven to be highly efficient at the numerical solution of the Sylvester matrix equation and its generalizations. In this work, we show that these algorithms extend in a seamless fashion to…

Numerical Analysis · Mathematics 2019-05-24 Minhong Chen , Daniel Kressner