English
Related papers

Related papers: Efficient arithmetic operations for rank-structure…

200 papers

We consider the problem of reconstructing a low rank matrix from a subset of its entries and analyze two variants of the so-called Alternating Minimization algorithm, which has been proposed in the past. We establish that when the…

Machine Learning · Statistics 2016-09-21 David Gamarnik , Sidhant Misra

The hierarchical matrix framework partitions matrices into subblocks that are either small or of low numerical rank, enabling linear storage complexity and efficient matrix-vector multiplication. This work focuses on the $H^2$-matrix format…

Numerical Analysis · Mathematics 2026-02-02 Anna Yesypenko , Per-Gunnar Martinsson

In this work, we consider two types of large-scale quadratic matrix equations: Continuous-time algebraic Riccati equations, which play a central role in optimal and robust control, and unilateral quadratic matrix equations, which arise from…

Numerical Analysis · Mathematics 2019-03-07 Daniel Kressner , Patrick Kürschner , Stefano Massei

The class of quasiseparable matrices is defined by the property that any submatrix entirely below or above the main diagonal has small rank, namely below a bound called the order of quasiseparability. These matrices arise naturally in…

Symbolic Computation · Computer Science 2019-10-22 Clement Pernet , Arne Storjohann

Linear matrix equations, such as the Sylvester and Lyapunov equations, play an important role in various applications, including the stability analysis and dimensionality reduction of linear dynamical control systems and the solution of…

Numerical Analysis · Mathematics 2019-05-30 Daniel Kressner , Stefano Massei , Leonardo Robol

Matrix completion is a problem that arises in many data-analysis settings where the input consists of a partially-observed matrix (e.g., recommender systems, traffic matrix analysis etc.). Classical approaches to matrix completion assume…

Machine Learning · Computer Science 2017-05-02 Natali Ruchansky , Mark Crovella , Evimaria Terzi

This article introduces HODLR2D, a new hierarchical low-rank representation for a class of dense matrices arising out of $N$ body problems in two dimensions. Using this new hierarchical framework, we propose a new fast matrix-vector product…

Numerical Analysis · Mathematics 2022-04-13 V A Kandappan , Vaishnavi Gujjula , Sivaram Ambikasaran

In the iterative solution of dense linear systems from boundary integral equations or systems involving kernel matrices, the main challenges are the expensive matrix-vector multiplication and the storage cost which are usually tackled by…

Numerical Analysis · Mathematics 2018-11-13 Xin Xing , Edmond Chow

Low rank approximation of a matrix (hereafter LRA) is a highly important area of Numerical Linear and Multilinear Algebra and Data Mining and Analysis. One can operate with an LRA at sublinear cost -- by using much fewer memory cells and…

Numerical Analysis · Mathematics 2025-07-11 Soo Go , Qi Luan , Victor Y. Pan , John Svadlenka , Liang Zhao

Low-rank modeling has a lot of important applications in machine learning, computer vision and social network analysis. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has…

Numerical Analysis · Computer Science 2016-05-02 Quanming Yao , James T. Kwok , Wenliang Zhong

Low-rank modeling plays a pivotal role in signal processing and machine learning, with applications ranging from collaborative filtering, video surveillance, medical imaging, to dimensionality reduction and adaptive filtering. Many modern…

Machine Learning · Statistics 2018-05-04 Yudong Chen , Yuejie Chi

We consider the problem of learning a low-rank matrix, constrained to lie in a linear subspace, and introduce a novel factorization for modeling such matrices. A salient feature of the proposed factorization scheme is it decouples the…

Machine Learning · Statistics 2018-06-18 Pratik Jawanpuria , Bamdev Mishra

Hierarchical matrix computations have attracted significant attention in the science and engineering community as exploiting data-sparse structures can significantly reduce the computational complexity of many important kernels. One…

Numerical Analysis · Mathematics 2025-01-10 Erin Carson , Xinye Chen , Xiaobo Liu

Many of today's problems require techniques that involve the solution of arbitrarily large systems $A\mathbf{x}=\mathbf{b}$. A popular numerical approach is the so-called Greedy Rank-One Update Algorithm, based on a particular tensor…

Numerical Analysis · Mathematics 2022-09-07 J. A. Conejero , A. Falcó , M. Mora-Jiménez

Structured dense matrices result from boundary integral problems in electrostatics and geostatistics, and also Schur complements in sparse preconditioners such as multi-frontal methods. Exploiting the structure of such matrices can reduce…

Numerical Analysis · Mathematics 2023-11-03 Sameer Deshmukh , Qinxiang Ma , Rio Yokota , George Bosilca

For reconstruction of low-rank matrices from undersampled measurements, we develop an iterative algorithm based on least-squares estimation. While the algorithm can be used for any low-rank matrix, it is also capable of exploiting a-priori…

Statistics Theory · Mathematics 2012-06-13 Dave Zachariah , Martin Sundin , Magnus Jansson , Saikat Chatterjee

Matrices with hierarchical low-rank structure, including HODLR and HSS matrices, constitute a versatile tool to develop fast algorithms for addressing large-scale problems. While existing software packages for such matrices often focus on…

Numerical Analysis · Mathematics 2020-01-30 Stefano Massei , Leonardo Robol , Daniel Kressner

In this paper, we propose a low rank approximation method for efficiently solving stochastic partial differential equations. Specifically, our method utilizes a novel low rank approximation of the stiffness matrices, which can significantly…

Numerical Analysis · Mathematics 2023-10-20 Yujun Zhu , Ju Ming , Jie Zhu , Zhongming Wang

We present a random-subspace variant of cubic regularization algorithm that chooses the size of the subspace adaptively, based on the rank of the projected second derivative matrix. Iteratively, our variant only requires access to…

Optimization and Control · Mathematics 2025-01-09 Edward Tansley , Coralia Cartis

Recently, convex formulations of low-rank matrix factorization problems have received considerable attention in machine learning. However, such formulations often require solving for a matrix of the size of the data matrix, making it…

Machine Learning · Computer Science 2017-08-29 Benjamin D. Haeffele , Rene Vidal