English
Related papers

Related papers: Linearly Convergent Randomized Iterative Methods f…

200 papers

In this short note, we prove a formula for the group inverse of a block matrix and consider the pseudo principal pivot transform expressed in terms of group inverses. Extensions of the usual principal pivot transform, where the usual…

Rings and Algebras · Mathematics 2016-05-09 Kavita Bisht , K. C. Sivakumar

The L1-regularized Gaussian maximum likelihood estimator (MLE) has been shown to have strong statistical guarantees in recovering a sparse inverse covariance matrix, or alternatively the underlying graph structure of a Gaussian Markov…

Machine Learning · Computer Science 2013-06-14 Cho-Jui Hsieh , Matyas A. Sustik , Inderjit S. Dhillon , Pradeep Ravikumar

A new generalized matrix inverse is derived which is consistent with respect to arbitrary nonsingular diagonal transformations, e.g., it preserves units associated with variables under state space transformations, thus providing a general…

Numerical Analysis · Mathematics 2026-04-02 Jeffrey Uhlmann

In this note, we present an algorithm that yields many new methods for constructing doubly stochastic and symmetric doubly stochastic matrices for the inverse eigenvalue problem. In addition, we introduce new open problems in this area that…

Spectral Theory · Mathematics 2012-02-15 Bassam Mourad , Hassan Abbas , Ayman Mourad , Ahmad Ghaddar , Issam Kaddoura

We present improved approximation bounds for the Moore-Penrose inverses of banded matrices, where the bandedness is induced by a metric on the index set. We show that the pseudoinverse of a banded matrix can be approximated by another…

Optimization and Control · Mathematics 2026-01-12 Sungho Shin , Wallace Gian Yion Tan , Mihai Anitescu

This work unifies the analysis of various randomized methods for solving linear and nonlinear inverse problems by framing the problem in a stochastic optimization setting. By doing so, we show that many randomized methods are variants of a…

Numerical Analysis · Mathematics 2023-06-21 Jonathan Wittmer , C. G. Krishnanunni , Hai V. Nguyen , Tan Bui-Thanh

We present a new framework for the analysis and design of randomized algorithms for solving various types of linear systems, including consistent or inconsistent, full rank or rank-deficient. Our method is formulated with four randomized…

Optimization and Control · Mathematics 2022-08-25 Deren Han , Jiaxin Xie

We propose a novel sparse sliced inverse regression method based on random projections in a large $p$ small $n$ setting. Embedded in a generalized eigenvalue framework, the proposed approach finally reduces to parallel execution of…

Methodology · Statistics 2023-08-04 Jia Zhang , Runxiong Wu , Xin Chen

We present a method for estimating sparse high-dimensional inverse covariance and partial correlation matrices, which exploits the connection between the inverse covariance matrix and linear regression. The method is a two-stage estimation…

Machine Learning · Statistics 2025-05-13 Samuel Erickson , Tobias Rydén

We study the inverse eigenvalue problem for finding doubly stochastic matrices with specified eigenvalues. By making use of a combination of Dykstra's algorithm and an alternating projection process onto a non-convex set, we derive hybrid…

Numerical Analysis · Mathematics 2023-05-31 Kassem Rammal , Bassam Mourad , Hassan Abbas , Hassan Issa

A substantial body of work in machine learning (ML) and randomized numerical linear algebra (RandNLA) has exploited various sorts of random sketching methodologies, including random sampling and random projection, with much of the analysis…

Numerical Analysis · Mathematics 2026-03-04 Chengmei Niu , Zhenyu Liao , Zenan Ling , Michael W. Mahoney

In this work we are interested in general linear inverse problems where the corresponding forward problem is solved iteratively using fixed point methods. Then one-shot methods, which iterate at the same time on the forward problem solution…

Numerical Analysis · Mathematics 2024-05-15 Marcella Bonazzoli , Houssem Haddar , Tuan Anh Vu

The efficient inversion of matrix polynomials is a critical challenge in computational mathematics. We design a procedure to determine the inverse of matrices polynomial of multidimensional Laplace matrices. The method is based on…

Numerical Analysis · Mathematics 2026-02-12 Sabia Asghar , Qiyao Peng , Fred Vermolen , Cornelis Vuik

There has recently been renewed recognition of the need to understand the consistency properties that must be preserved when a generalized matrix inverse is required. The most widely known generalized inverse, the Moore-Penrose…

Numerical Analysis · Computer Science 2018-08-03 Jeffrey Uhlmann

We take a random matrix theory approach to random sketching and show an asymptotic first-order equivalence of the regularized sketched pseudoinverse of a positive semidefinite matrix to a certain evaluation of the resolvent of the same…

Numerical Analysis · Mathematics 2023-10-09 Daniel LeJeune , Pratik Patil , Hamid Javadi , Richard G. Baraniuk , Ryan J. Tibshirani

We present several algorithms aimed at constructing sparse and structured sparse (row-sparse) generalized inverses, with application to the efficient computation of least-squares solutions, for inconsistent systems of linear equations, in…

Optimization and Control · Mathematics 2025-07-09 Gabriel Ponte , Marcia Fampa , Jon Lee , Luze Xu

The inverse of a large matrix can often be accurately approximated by a polynomial of degree significantly lower than the order of the matrix. The iteration polynomial generated by a run of the GMRES algorithm is a good candidate, and its…

Numerical Analysis · Mathematics 2025-02-26 Mark Embree , Joel A. Henningsen , Jordan Jackson , Ronald B. Morgan

The Moore-Penrose pseudo-inverse $X^\dagger$, defined for rectangular matrices, naturally emerges in many areas of mathematics and science. For a pair of rectangular matrices $X, Y$ where the corresponding entries are jointly Gaussian and…

Spectral Theory · Mathematics 2025-07-01 Uri Cohen

We give a constructive characterization of matrices satisfying the reverse-order law for the Moore--Penrose pseudoinverse. In particular, for a given matrix $A$ we construct another matrix $B$, of arbitrary compatible size and chosen rank,…

Numerical Analysis · Mathematics 2024-04-12 Oskar Kędzierski

Traditional numerical methods for calculating matrix eigenvalues are prohibitively expensive for high-dimensional problems. Iterative random sparsification methods allow for the estimation of a single dominant eigenvalue at reduced cost by…

Numerical Analysis · Mathematics 2023-10-03 Samuel M. Greene , Robert J. Webber , Timothy C. Berkelbach , Jonathan Weare