English
Related papers

Related papers: Input-Sparsity Low Rank Approximation in Schatten …

200 papers

Principal component analysis (PCA) requires the computation of a low-rank approximation to a matrix containing the data being analyzed. In many applications of PCA, the best possible accuracy of any rank-deficient approximation is at most a…

Computation · Statistics 2010-06-04 Vladimir Rokhlin , Arthur Szlam , Mark Tygert

This paper investigates numerical solution methods for the Schatten-$p$ quasi-norm regularized problem with $p \in [0,1]$, which has been widely studied for finding low-rank solutions of linear inverse problems and gained successful…

Optimization and Control · Mathematics 2026-03-03 Weiping Shen , Linglingzhi Zhu , Yaohua Hu , Chong Li , Xiaoqi Yang

Let ${\mathcal S}_m$ be the set of all $m\times m$ density matrices (Hermitian positively semi-definite matrices of unit trace). Consider a problem of estimation of an unknown density matrix $\rho\in {\mathcal S}_m$ based on outcomes of $n$…

Machine Learning · Statistics 2016-04-18 Dong Xia , Vladimir Koltchinskii

We consider the matrix completion problem of recovering a structured low rank matrix with partially observed entries with mixed data types. Vast majority of the solutions have proposed computationally feasible estimators with strong…

Machine Learning · Statistics 2020-05-27 Daqian Sun , Martin T. Wells

Low rank matrix approximation (LRMA), which aims to recover the underlying low rank matrix from its degraded observation, has a wide range of applications in computer vision. The latest LRMA methods resort to using the nuclear norm…

Computer Vision and Pattern Recognition · Computer Science 2016-11-03 Yuan Xie , Shuhang Gu , Yan Liu , Wangmeng Zuo , Wensheng Zhang , Lei Zhang

We revisit Matrix Balancing, a pre-conditioning task used ubiquitously for computing eigenvalues and matrix exponentials. Since 1960, Osborne's algorithm has been the practitioners' algorithm of choice and is now implemented in most…

Optimization and Control · Mathematics 2021-07-06 Jason M. Altschuler , Pablo A. Parrilo

We prove new results about the robustness of well-known convex noise-blind optimization formulations for the reconstruction of low-rank matrices from underdetermined linear measurements. Our results are applicable for symmetric rank-one…

Information Theory · Computer Science 2020-10-26 Felix Krahmer , Christian Kümmerle , Oleh Melnyk

We study algorithms for approximating pairwise similarity matrices that arise in natural language processing. Generally, computing a similarity matrix for $n$ data points requires $\Omega(n^2)$ similarity computations. This quadratic…

Machine Learning · Computer Science 2022-04-28 Archan Ray , Nicholas Monath , Andrew McCallum , Cameron Musco

Given a matrix $A$, a matrix nearness problem seeks an $X$ that most closely approximates $A$ in the sense of minimizing $\lVert A - X\rVert$ under a variety of constraints on $X$. A generalized matrix nearness problem seeks the same but…

Numerical Analysis · Mathematics 2026-05-29 Rongbiao Thomas Wang , Chi-Kwong Li , Lek-Heng Lim

An approximate sparse recovery system consists of parameters $k,N$, an $m$-by-$N$ measurement matrix, $\Phi$, and a decoding algorithm, $\mathcal{D}$. Given a vector, $x$, the system approximates $x$ by $\widehat x =\mathcal{D}(\Phi x)$,…

Data Structures and Algorithms · Computer Science 2014-02-10 Anna C. Gilbert , Yi Li , Ely Porat , Martin J. Strauss

The problem of solving linear systems is one of the most fundamental problems in computer science, where given a satisfiable linear system $(A,b)$, for $A \in \mathbb{R}^{n \times n}$ and $b \in \mathbb{R}^n$, we wish to find a vector $x…

Data Structures and Algorithms · Computer Science 2021-06-25 Mitali Bafna , Nikhil Vyas

We describe a second-order accurate approach to sparsifying the off-diagonal blocks in the hierarchical approximate factorizations of sparse symmetric positive definite matrices. The norm of the error made by the new approach depends…

Numerical Analysis · Mathematics 2020-08-05 Bazyli Klockiewicz , Léopold Cambier , Ryan Humble , Hamdi Tchelepi , Eric Darve

Rank deficient Hankel matrices are at the core of several applications. However, in practice, the coefficients of these matrices are noisy due to e.g. measurements errors and computational errors, so generically the involved matrices are…

Numerical Analysis · Mathematics 2020-12-15 Antonio Fazzi , Nicola Guglielmi , Ivan Markovsky

We develop a new refinement of the Kato's inequality and using this refinement we obtain several upper bounds for the numerical radius of a bounded linear operator as well as the product of operators, which improve the well known existing…

Functional Analysis · Mathematics 2024-07-09 Pintu Bhunia , Satyajit Sahoo

Constrained submodular maximization problems have long been studied, with near-optimal results known under a variety of constraints when the submodular function is monotone. The case of non-monotone submodular maximization is less…

Data Structures and Algorithms · Computer Science 2010-10-07 Anupam Gupta , Aaron Roth , Grant Schoenebeck , Kunal Talwar

We propose a new technique for constructing low-rank approximations of matrices that arise in kernel methods for machine learning. Our approach pairs a novel automatically constructed analytic expansion of the underlying kernel function…

Machine Learning · Computer Science 2022-02-09 John Paul Ryan , Anil Damle

Singular values of a data in a matrix form provide insights on the structure of the data, the effective dimensionality, and the choice of hyper-parameters on higher-level data analysis tools. However, in many practical applications such as…

Machine Learning · Statistics 2017-03-21 Ashish Khetan , Sewoong Oh

Sparse tensor best rank-1 approximation (BR1Approx), which is a sparsity generalization of the dense tensor BR1Approx, and is a higher-order extension of the sparse matrix BR1Approx, is one of the most important problems in sparse tensor…

Numerical Analysis · Mathematics 2022-07-15 Xianpeng Mao , Yuning Yang

We present a polynomial-time reduction from solving noisy linear equations over $\mathbb{Z}/q\mathbb{Z}$ in dimension $\Theta(k\log n/\mathsf{poly}(\log k,\log q,\log\log n))$ with a uniformly random coefficient matrix to noisy linear…

Computational Complexity · Computer Science 2024-11-20 Kiril Bangachev , Guy Bresler , Stefan Tiegel , Vinod Vaikuntanathan

We consider the problem of computing the k-sparse approximation to the discrete Fourier transform of an n-dimensional signal. We show: * An O(k log n)-time randomized algorithm for the case where the input signal has at most k non-zero…

Data Structures and Algorithms · Computer Science 2012-04-09 Haitham Hassanieh , Piotr Indyk , Dina Katabi , Eric Price