English
Related papers

Related papers: Low-Rank SPIKE Framework for Solving Large Sparse …

200 papers

This paper proposes a novel low-rank approximation to the multivariate State-Space Model. The Stochastic Partial Differential Equation (SPDE) approach is applied component-wise to the independent-in-time Mat\'ern Gaussian innovation term in…

A class of splitting alternating algorithms is proposed for finding the sparse solution of linear systems with concatenated orthogonal matrices. Depending on the number of matrices concatenated, the proposed algorithms are classified into…

Information Theory · Computer Science 2025-09-30 Yun-Bin Zhao , Zhong-Feng Sun

Sparse PCA (SPCA) is a fundamental model in machine learning and data analytics, which has witnessed a variety of application areas such as finance, manufacturing, biology, healthcare. To select a prespecified-size principal submatrix from…

Machine Learning · Statistics 2020-08-31 Yongchun Li , Weijun Xie

In this work, we develop a fast hierarchical solver for solving large, sparse least squares problems. We build upon the algorithm, spaQR (sparsified QR), that was developed by the authors to solve large sparse linear systems. Our algorithm…

Numerical Analysis · Mathematics 2021-03-05 Abeynaya Gnanasekaran , Eric Darve

In this paper we propose and analyze new efficient sparse approximate inverse (SPAI) smoothers for solving the two-dimensional (2D) and three-dimensional (3D) Laplacian linear system with geometric multigrid methods. Local Fourier analysis…

Numerical Analysis · Mathematics 2022-06-14 Yunhui He , Jun Liu , Xiang-Sheng Wang

An efficient linear solver plays an important role while solving partial differential equations (PDEs) and partial integro-differential equations (PIDEs) type mathematical models. In most cases, the efficiency depends on the stability and…

Numerical Analysis · Mathematics 2013-04-15 Samir Kumar Bhowmik

We present the design and analysis of a near linear-work parallel algorithm for solving symmetric diagonally dominant (SDD) linear systems. On input of a SDD $n$-by-$n$ matrix $A$ with $m$ non-zero entries and a vector $b$, our algorithm…

Data Structures and Algorithms · Computer Science 2011-11-09 Guy E. Blelloch , Anupam Gupta , Ioannis Koutis , Gary L. Miller , Richard Peng , Kanat Tangwongsan

We consider the parallel-in-time solution of hyperbolic partial differential equation (PDE) systems in one spatial dimension, both linear and nonlinear. In the nonlinear setting, the discretized equations are solved with a preconditioned…

Numerical Analysis · Mathematics 2025-10-10 O. A. Krzysik , H. De Sterck , R. D. Falgout , J. B. Schroder

Iterative methods based on matrix splittings are useful in solving large sparse linear systems. In this direction, proper splittings and its several extensions are used to deal with singular and rectangular linear systems. In this article,…

Numerical Analysis · Mathematics 2019-07-08 Ashish Kumar Nandi , Jajati Keshari Sahoo , Debasisha Mishra

A new approximation format for solutions of partial differential equations depending on infinitely many parameters is introduced. By combining low-rank tensor approximation in a selected subset of variables with a sparse polynomial…

Numerical Analysis · Mathematics 2025-06-25 Markus Bachmayr , Huqing Yang

High-order implicit shock tracking (fitting) is a class of high-order numerical methods that use numerical optimization to simultaneously compute a high-order approximation to a conservation law solution and align elements of the…

Numerical Analysis · Mathematics 2024-06-28 Jakob Vandergrift , Matthew J. Zahr

We give an efficient algorithm for finding sparse approximate solutions to linear systems of equations with nonnegative coefficients. Unlike most known results for sparse recovery, we do not require {\em any} assumption on the matrix other…

Data Structures and Algorithms · Computer Science 2015-01-09 Aditya Bhaskara , Ananda Theertha Suresh , Morteza Zadimoghaddam

Although some preconditioners are available for solving dense linear systems, there are still many matrices for which preconditioners are lacking, in particular in cases where the size of the matrix $N$ becomes very large. There remains…

Numerical Analysis · Mathematics 2016-02-05 Pieter Coulier , Hadi Pouransari , Eric Darve

We introduce spiky rank, a new matrix parameter that enhances blocky rank by combining the combinatorial structure of the latter with linear-algebraic flexibility. A spiky matrix is block-structured with diagonal blocks that are arbitrary…

Computational Complexity · Computer Science 2026-03-02 Lianna Hambardzumyan , Konstantin Myasnikov , Artur Riazanov , Morgan Shirley , Adi Shraibman

We present a natural generalization of the recent low rank + sparse matrix decomposition and consider the decomposition of matrices into components of multiple scales. Such decomposition is well motivated in practice as data matrices often…

Systems and Control · Computer Science 2016-08-04 Frank Ong , Michael Lustig

Semidefinite programming (SDP) is a central topic in mathematical optimization with extensive studies on its efficient solvers. In this paper, we present a proof-of-principle sublinear-time algorithm for solving SDPs with low-rank…

Data Structures and Algorithms · Computer Science 2020-08-07 Nai-Hui Chia , Tongyang Li , Han-Hsuan Lin , Chunhao Wang

We propose a new class of multi-layer iterative schemes for solving sparse linear systems in saddle point structure. The new scheme consist of an iterative preconditioner that is based on the (approximate) nullspace method, combined with an…

Numerical Analysis · Mathematics 2026-02-09 Murat Manguoğlu , Volker Mehrmann

In this article, we derive fast and robust parallel-in-time preconditioned iterative methods for the all-at-once linear systems arising upon discretization of time-dependent PDEs. The discretization we employ is based on a Runge--Kutta…

Numerical Analysis · Mathematics 2023-04-25 Santolo Leveque , Luca Bergamaschi , Ángeles Martínez , John W. Pearson

We consider several classes of highly important semidefinite optimization problems that involve both a convex objective function (smooth or nonsmooth) and additional linear or nonlinear smooth and convex constraints, which are ubiquitous in…

Optimization and Control · Mathematics 2025-04-08 Dan Garber , Atara Kaplan

Spectral Clustering (SC) is one of the most widely used methods for data clustering. It first finds a low-dimensonal embedding $U$ of data by computing the eigenvectors of the normalized Laplacian matrix, and then performs k-means on…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Canyi Lu , Shuicheng Yan , Zhouchen Lin