English
Related papers

Related papers: Efficient Rank Reduction of Correlation Matrices

200 papers

Standard regularization methods that are used to compute solutions to ill-posed inverse problems require knowledge of the forward model. In many real-life applications, the forward model is not known, but training data is readily available.…

Numerical Analysis · Mathematics 2015-06-19 Julianne Chung , Matthias Chung

The problem of low-rank matrix estimation recently received a lot of attention due to challenging applications. A lot of work has been done on rank-penalized methods and convex relaxation, both on the theoretical and applied sides. However,…

Machine Learning · Statistics 2018-06-27 Pierre Alquier

Positive semi-definite matrices commonly occur as normal matrices of least squares problems in statistics or as kernel matrices in machine learning and approximation theory. They are typically large and dense. Thus algorithms to solve…

Numerical Analysis · Mathematics 2020-12-01 Markus Hegland , Frank deHoog

We outline a new approach for solving optimization problems which enforce triangle inequalities on output variables. We refer to this as metric-constrained optimization, and give several examples where problems of this form arise in machine…

Numerical Analysis · Computer Science 2018-06-06 Nate Veldt , David Gleich , Anthony Wirth , James Saunderson

Low-rank matrix approximations, such as the truncated singular value decomposition and the rank-revealing QR decomposition, play a central role in data analysis and scientific computing. This work surveys and extends recent research which…

Numerical Analysis · Mathematics 2014-04-29 Nathan Halko , Per-Gunnar Martinsson , Joel A. Tropp

In this paper, a reduced-rank scheme with joint iterative optimization is presented for direction of arrival estimation. A rank-reduction matrix and an auxiliary reduced-rank parameter vector are jointly optimized to calculate the output…

Data Structures and Algorithms · Computer Science 2016-11-17 L. Wang , R. C. de Lamare , M. Haardt

The nonnegative rank of a nonnegative matrix is the minimum number of nonnegative rank-one factors needed to reconstruct it exactly. The problem of determining this rank and computing the corresponding nonnegative factors is difficult;…

Optimization and Control · Mathematics 2012-08-30 Nicolas Gillis , François Glineur

The procedure of Least Square-Errors curve fitting is extensively used in many computer applications for fitting a polynomial curve of a given degree to approximate a set of data. Although various methodologies exist to carry out curve…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-12-29 Poorna Banerjee Dasgupta

This work considers the low-rank approximation of a matrix $A(t)$ depending on a parameter $t$ in a compact set $D \subset \mathbb{R}^d$. Application areas that give rise to such problems include computational statistics and dynamical…

Numerical Analysis · Mathematics 2024-04-18 Daniel Kressner , Hei Yin Lam

We describe several algorithms for matrix completion and matrix approximation when only some of its entries are known. The approximation constraint can be any whose approximated solution is known for the full matrix. For low rank…

Numerical Analysis · Mathematics 2014-07-01 Gil Shabat , Yaniv Shmueli , Amir Averbuch

Matrix rank minimization problem is in general NP-hard. The nuclear norm is used to substitute the rank function in many recent studies. Nevertheless, the nuclear norm approximation adds all singular values together and the approximation…

Computer Vision and Pattern Recognition · Computer Science 2015-11-02 Zhao Kang , Chong Peng , Qiang Cheng

There are a number of approximation algorithms for NP-hard versions of low rank approximation, such as finding a rank-$k$ matrix $B$ minimizing the sum of absolute values of differences to a given $n$-by-$n$ matrix $A$,…

Data Structures and Algorithms · Computer Science 2020-04-20 Zhao Song , David P. Woodruff , Peilin Zhong

The minimum rank problem is to determine for a graph $G$ the smallest rank of a Hermitian (or real symmetric) matrix whose off-diagonal zero-nonzero pattern is that of the adjacency matrix of $G$. Here $G$ is taken to be a circulant graph,…

Combinatorics · Mathematics 2015-11-26 Louis Deaett , Seth A. Meyer

In this paper we consider general rank minimization problems with rank appearing in either objective function or constraint. We first establish that a class of special rank minimization problems has closed-form solutions. Using this result,…

Optimization and Control · Mathematics 2012-05-30 Zhaosong Lu , Yong Zhang

In this paper we introduce min-plus low rank matrix approximation. By using min and plus rather than plus and times as the basic operations in the matrix multiplication; min-plus low rank matrix approximation is able to detect…

Numerical Analysis · Mathematics 2017-08-23 James Hook

Correlation matrices are standardized covariance matrices. They form an affine space of symmetric matrices defined by setting the diagonal entries to one. We study the geometry of maximum likelihood estimation for this model and linear…

Statistics Theory · Mathematics 2021-02-02 Carlos Améndola , Piotr Zwiernik

Randomized sampling has recently been demonstrated to be an efficient technique for computing approximate low-rank factorizations of matrices for which fast methods for computing matrix vector products are available. This paper describes an…

Numerical Analysis · Mathematics 2008-06-17 Per-Gunnar Martinsson

A novel algorithm for the recovery of low-rank matrices acquired via compressive linear measurements is proposed and analyzed. The algorithm, a variation on the iterative hard thresholding algorithm for low-rank recovery, is designed to…

Numerical Analysis · Mathematics 2018-10-30 Simon Foucart , Srinivas Subramanian

The problem of completing a low-rank matrix from a subset of its entries is often encountered in the analysis of incomplete data sets exhibiting an underlying factor model with applications in collaborative filtering, computer vision and…

Machine Learning · Computer Science 2009-02-24 Amit Singer , Mihai Cucuringu

We consider gradient-related methods for low-rank matrix optimization with a smooth cost function. The methods operate on single factors of the low-rank factorization and share aspects of both alternating and Riemannian optimization. Two…

Optimization and Control · Mathematics 2025-05-06 Guillaume Olikier , André Uschmajew , Bart Vandereycken