English
Related papers

Related papers: Factorization Approach for Low-complexity Matrix C…

200 papers

This paper studies the relationship between the nuclear norm-regularized minimization problem, which minimizes the sum of a $C^2$ function $h$ and a positive multiple of the nuclear norm, denoted by $f$, and its factorized problem obtained…

Optimization and Control · Mathematics 2026-01-06 Wenqing Ouyang , Ting Kei Pong , Man-Chung Yue

This paper studies the role of over-parametrization in solving non-convex optimization problems. The focus is on the important class of low-rank matrix sensing, where we propose an infinite hierarchy of non-convex problems via the lifting…

Optimization and Control · Mathematics 2023-02-16 Ziye Ma , Igor Molybog , Javad Lavaei , Somayeh Sojoudi

Many problems in data science can be treated as estimating a low-rank matrix from highly incomplete, sometimes even corrupted, observations. One popular approach is to resort to matrix factorization, where the low-rank matrix factors are…

Machine Learning · Computer Science 2021-04-23 Tian Tong , Cong Ma , Yuejie Chi

We address the rectangular matrix completion problem by lifting the unknown matrix to a positive semidefinite matrix in higher dimension, and optimizing a nonconvex objective over the semidefinite factor using a simple gradient descent…

Machine Learning · Statistics 2016-11-23 Qinqing Zheng , John Lafferty

Identifying discrete patterns in binary data is an important dimensionality reduction tool in machine learning and data mining. In this paper, we consider the problem of low-rank binary matrix factorisation (BMF) under Boolean arithmetic.…

Optimization and Control · Mathematics 2021-08-05 Reka A. Kovacs , Oktay Gunluk , Raphael A. Hauser

This paper introduces an algorithm for the nonnegative matrix factorization-and-completion problem, which aims to find nonnegative low-rank matrices X and Y so that the product XY approximates a nonnegative data matrix M whose elements are…

Information Theory · Computer Science 2015-11-23 Yangyang Xu , Wotao Yin , Zaiwen Wen , Yin Zhang

Recently, convex formulations of low-rank matrix factorization problems have received considerable attention in machine learning. However, such formulations often require solving for a matrix of the size of the data matrix, making it…

Machine Learning · Computer Science 2017-08-29 Benjamin D. Haeffele , Rene Vidal

We present an online algorithm for time-varying semidefinite programs (TV-SDPs), based on the tracking of the solution trajectory of a low-rank matrix factorization, also known as the Burer-Monteiro factorization, in a path-following…

Optimization and Control · Mathematics 2024-01-17 Antonio Bellon , Mareike Dressler , Vyacheslav Kungurtsev , Jakub Marecek , André Uschmajew

The problem of computing a representation for a real polynomial as a sum of minimum number of squares of polynomials can be casted as finding a symmetric positive semidefinite real matrix (Gram matrix) of minimum rank subject to linear…

Optimization and Control · Mathematics 2011-01-28 Yue Ma , Lihong Zhi

We provide a number of algorithmic results for the following family of problems: For a given binary m\times n matrix A and integer k, decide whether there is a "simple" binary matrix B which differs from A in at most k entries. For an…

Data Structures and Algorithms · Computer Science 2018-03-19 Fedor V. Fomin , Petr A. Golovach , Fahad Panolan

The orthogonal group synchronization problem, which focuses on recovering orthogonal group elements from their corrupted pairwise measurements, encompasses examples such as high-dimensional Kuramoto model on general signed networks,…

Information Theory · Computer Science 2025-03-03 Shuyang Ling

In binary polynomial optimization, the goal is to find a binary point maximizing a given polynomial function. In this paper, we propose a novel way of formulating this general optimization problem, which we call factorized binary polynomial…

Optimization and Control · Mathematics 2024-07-08 Alberto Del Pia

The low-rank matrix completion problem can be succinctly stated as follows: given a subset of the entries of a matrix, find a low-rank matrix consistent with the observations. While several low-complexity algorithms for matrix completion…

Information Theory · Computer Science 2010-06-11 Wei Dai , Ely Kerman , Olgica Milenkovic

The so-called Burer-Monteiro method is a well-studied technique for solving large-scale semidefinite programs (SDPs) via low-rank factorization. The main idea is to solve rank-restricted, albeit non-convex, surrogates instead of the SDP.…

Optimization and Control · Mathematics 2019-08-29 Yulun Tian , Kasra Khosoussi , Jonathan P. How

Addressing the interpretability problem of NMF on Boolean data, Boolean Matrix Factorization (BMF) uses Boolean algebra to decompose the input into low-rank Boolean factor matrices. These matrices are highly interpretable and very useful in…

Machine Learning · Computer Science 2023-07-18 Sebastian Dalleiger , Jilles Vreeken

Nonnegative Matrix Factorization consists in (approximately) factorizing a nonnegative data matrix by the product of two low-rank nonnegative matrices. It has been successfully applied as a data analysis technique in numerous domains, e.g.,…

Optimization and Control · Mathematics 2012-08-13 Nicolas Gillis , François Glineur

A novel approach to Boolean matrix factorization (BMF) is presented. Instead of solving the BMF problem directly, this approach solves a nonnegative optimization problem with the constraint over an auxiliary matrix whose Boolean structure…

Data Structures and Algorithms · Computer Science 2021-08-27 Duc P. Truong , Erik Skau , Derek Desantis , Boian Alexandrov

We consider the problem of robust matrix completion, which aims to recover a low rank matrix $L_*$ and a sparse matrix $S_*$ from incomplete observations of their sum $M=L_*+S_*\in\mathbb{R}^{m\times n}$. Algorithmically, the robust matrix…

Machine Learning · Statistics 2020-03-25 Yunfeng Cai , Ping Li

We propose an algorithm for low rank matrix completion for matrices with binary entries which obtains explicit binary factors. Our algorithm, which we call TBMC (\emph{Tiling for Binary Matrix Completion}), gives interpretable output in the…

Numerical Analysis · Mathematics 2020-06-23 Melanie Beckerleg , Andrew Thompson

Motivated by an application in computational biology, we consider low-rank matrix factorization with $\{0,1\}$-constraints on one of the factors and optionally convex constraints on the second one. In addition to the non-convexity shared…

Machine Learning · Statistics 2014-01-24 Martin Slawski , Matthias Hein , Pavlo Lutsik