English
Related papers

Related papers: Efficient Algorithms for Positive Semi-Definite To…

200 papers

The problem of decomposing a given covariance matrix as the sum of a positive semi-definite matrix of given rank and a positive semi-definite diagonal matrix, is considered. We present a projection-type algorithm to address this problem.…

Optimization and Control · Mathematics 2018-06-13 Valentina Ciccone , Augusto Ferrante , Mattia Zorzi

The matrix completion problem aims to reconstruct a low-rank matrix based on a revealed set of possibly noisy entries. Prior works consider completing the entire matrix with generalization error guarantees. However, the completion accuracy…

Machine Learning · Computer Science 2023-12-19 Elad Hazan , Adam Tauman Kalai , Varun Kanade , Clara Mohri , Y. Jennifer Sun

In this paper we establish links between, and new results for, three problems that are not usually considered together. The first is a matrix decomposition problem that arises in areas such as statistical modeling and signal processing:…

Optimization and Control · Mathematics 2013-02-05 James Saunderson , Venkat Chandrasekaran , Pablo A. Parrilo , Alan S. Willsky

This paper addresses the problem of low-rank distance matrix completion. This problem amounts to recover the missing entries of a distance matrix when the dimension of the data embedding space is possibly unknown but small compared to the…

Optimization and Control · Mathematics 2013-04-26 B. Mishra , G. Meyer , R. Sepulchre

The positive semidefinite Procrustes (PSDP) problem is the following: given rectangular matrices $X$ and $B$, find the symmetric positive semidefinite matrix $A$ that minimizes the Frobenius norm of $AX-B$. No general procedure is known…

Optimization and Control · Mathematics 2017-12-05 Nicolas Gillis , Punit Sharma

This work is concerned with the numerical solution of large-scale symmetric positive definite matrix equations of the form $A_1XB_1^\top + A_2XB_2^\top + \dots + A_\ell X B_\ell^\top = F$, as they arise from discretized partial differential…

Numerical Analysis · Mathematics 2024-12-04 Ivan Bioli , Daniel Kressner , Leonardo Robol

Alternating minimization represents a widely applicable and empirically successful approach for finding low-rank matrices that best fit the given data. For example, for the problem of low-rank matrix completion, this method is believed to…

Machine Learning · Statistics 2012-12-04 Prateek Jain , Praneeth Netrapalli , Sujay Sanghavi

We consider the symmetric Toeplitz matrix completion problem, whose matrix under consideration possesses specific row and column structures. This problem, which has wide application in diverse areas, is well-known to be computationally…

Optimization and Control · Mathematics 2024-03-15 Xihong Yan , Jiahao Guo , Yi Xu

We introduce a new fundamental algorithm called Matrix-POAFD to solve the matrix least square problem. The method is based on the matching pursuit principle. The method directly extracts, among the given features as column vectors of the…

Information Theory · Computer Science 2025-03-19 Wei Qu , Chi Tin Hon , Yiqiao Zhang , Tao Qian

Nonnegative (linear) least square problems are a fundamental class of problems that is well-studied in statistical learning and for which solvers have been implemented in many of the standard programming languages used within the machine…

Optimization and Control · Mathematics 2022-03-09 Jelena Diakonikolas , Chenghui Li , Swati Padmanabhan , Chaobing Song

The problem of minimizing the rank of a symmetric positive semidefinite matrix subject to constraints can be cast equivalently as a semidefinite program with complementarity constraints (SDCMPCC). The formulation requires two positive…

Optimization and Control · Mathematics 2018-02-02 Xin Shen , John E. Mitchell

We present two algorithms for large-scale low-rank Euclidean distance matrix completion problems, based on semidefinite optimization. Our first method works by relating cliques in the graph of the known distances to faces of the positive…

Optimization and Control · Mathematics 2015-08-27 Dmitriy Drusvyatskiy , Nathan Krislock , Yuen-Lam Voronin , Henry Wolkowicz

We present and analyze an efficient implementation of an iteratively reweighted least squares algorithm for recovering a matrix from a small number of linear measurements. The algorithm is designed for the simultaneous promotion of both a…

Numerical Analysis · Mathematics 2011-07-19 Massimo Fornasier , Holger Rauhut , Rachel Ward

This paper introduces an efficient algorithm for computing the best approximation of a given matrix onto the intersection of linear equalities, inequalities and the doubly nonnegative cone (the cone of all positive semidefinite matrices…

Optimization and Control · Mathematics 2018-03-20 Ying Cui , Defeng Sun , Kim-Chuan Toh

Matrix completion results deal with the question of when a partially specified symmetric matrix can be completed to a member of certain matrix cones. Results from positive semidefinite matrix completion and completely positive matrix…

General Mathematics · Mathematics 2025-09-25 Markus Gabl

Solving very large linear systems of equations is a key computational task in science and technology. In many cases, the coefficient matrix of the linear system is rank-deficient, leading to systems that may be underdetermined,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-13 Mónica Chillarón , Gregorio Quintana-Ortí , Vicente Vidal , Per-Gunnar Martinsson

Factor analysis, a classical multivariate statistical technique is popularly used as a fundamental tool for dimensionality reduction in statistics, econometrics and data science. Estimation is often carried out via the Maximum Likelihood…

Optimization and Control · Mathematics 2018-01-19 Koulik Khamaru , Rahul Mazumder

We consider least squares semidefinite programming (LSSDP) where the primal matrix variable must satisfy given linear equality and inequality constraints, and must also lie in the intersection of the cone of symmetric positive semidefinite…

Optimization and Control · Mathematics 2015-05-26 Defeng Sun , Kim-Chuan Toh , Liuqin Yang

We give a new framework for solving the fundamental problem of low-rank matrix completion, i.e., approximating a rank-$r$ matrix $\mathbf{M} \in \mathbb{R}^{m \times n}$ (where $m \ge n$) from random observations. First, we provide an…

Machine Learning · Computer Science 2023-08-08 Jonathan A. Kelner , Jerry Li , Allen Liu , Aaron Sidford , Kevin Tian

We use techniques from (tracial noncommutative) polynomial optimization to formulate hierarchies of semidefinite programming lower bounds on matrix factorization ranks. In particular, we consider the nonnegative rank, the positive…

Optimization and Control · Mathematics 2018-11-06 Sander Gribling , David de Laat , Monique Laurent