English
Related papers

Related papers: Computing the nc-rank via discrete convex optimiza…

200 papers

In multi-objective optimization, computing the entire non-dominated set (also known as the Pareto front or the Pareto frontier) is often intractable. However, for any multiplicative factor greater than one, an approximation set can be…

Optimization and Control · Mathematics 2026-04-30 Levin Nemesch , Stefan Ruzika , Clemens Thielen , Alina Wittmann

Low-rank matrix models have been universally useful for numerous applications, from classical system identification to more modern matrix completion in signal processing and statistics. The nuclear norm has been employed as a convex…

Statistics Theory · Mathematics 2023-03-06 Kiryung Lee , Rakshith Sharma Srinivasa , Marius Junge , Justin Romberg

We present new deterministic algorithms for several cases of the maximum rank matrix completion problem (for short matrix completion), i.e. the problem of assigning values to the variables in a given symbolic matrix as to maximize the…

Data Structures and Algorithms · Computer Science 2014-07-11 Gábor Ivanyos , Marek Karpinski , Nitin Saxena

This paper studies the estimation of low-rank Markov chains from empirical trajectories. We propose a non-convex estimator based on rank-constrained likelihood maximization. Statistical upper bounds are provided for the Kullback-Leiber…

Machine Learning · Statistics 2018-07-20 Xudong Li , Mengdi Wang , Anru Zhang

In the search for a logic capturing polynomial time the most promising candidates are Choiceless Polynomial Time (CPT) and rank logic. Rank logic extends fixed-point logic with counting by a rank operator over prime fields. We show that the…

Logic in Computer Science · Computer Science 2023-08-15 Moritz Lichter

Low-rank approximation is a technique to approximate a tensor or a matrix with a reduced rank to reduce the memory required and computational cost for simulation. Its broad applications include dimension reduction, signal processing,…

Computational Physics · Physics 2019-06-25 Zhuogang Peng , Ryan G. McClarren , Martin Frank

We develop a spatial branch-and-cut approach for nonconvex Quadratically Constrained Quadratic Programs with bounded complex variables (CQCQP). Linear valid inequalities are added at each node of the search tree to strengthen semidefinite…

Optimization and Control · Mathematics 2017-05-26 Chen Chen , Alper Atamturk , Shmuel S. Oren

In this paper, we propose a new algorithm for recovery of low-rank matrices from compressed linear measurements. The underlying idea of this algorithm is to closely approximate the rank function with a smooth function of singular values,…

Information Theory · Computer Science 2016-11-18 Mohammadreza Malek-Mohammadi , Massoud Babaie-Zadeh , Mikael Skoglund

We propose a new method for robust PCA -- the task of recovering a low-rank matrix from sparse corruptions that are of unknown value and support. Our method involves alternating between projecting appropriate residuals onto the set of…

Information Theory · Computer Science 2014-10-29 Praneeth Netrapalli , U N Niranjan , Sujay Sanghavi , Animashree Anandkumar , Prateek Jain

We propose an efficient matrix rank reduction method for non-negative matrices, whose time complexity is quadratic in the number of rows or columns of a matrix. Our key insight is to formulate rank reduction as a mean-field approximation by…

Machine Learning · Statistics 2021-03-05 Kazu Ghalamkari , Mahito Sugiyama

The nonnegative rank of a nonnegative matrix is the minimum number of nonnegative rank-one factors needed to reconstruct it exactly. The problem of determining this rank and computing the corresponding nonnegative factors is difficult;…

Optimization and Control · Mathematics 2012-08-30 Nicolas Gillis , François Glineur

This paper describes a new approach, based on linear programming, for computing nonnegative matrix factorizations (NMFs). The key idea is a data-driven model for the factorization where the most salient features in the data are used to…

Optimization and Control · Mathematics 2013-02-05 Victor Bittorf , Benjamin Recht , Christopher Re , Joel A. Tropp

Substantial progress has been made recently on developing provably accurate and efficient algorithms for low-rank matrix factorization via nonconvex optimization. While conventional wisdom often takes a dim view of nonconvex optimization…

Machine Learning · Computer Science 2019-10-23 Yuejie Chi , Yue M. Lu , Yuxin Chen

We study several variants of decomposing a symmetric matrix into a sum of a low-rank positive semidefinite matrix and a diagonal matrix. Such decompositions have applications in factor analysis and they have been studied for many decades.…

Optimization and Control · Mathematics 2023-10-02 Levent Tunçel , Stephen A. Vavasis , Jingye Xu

This preliminary note presents a heuristic for determining rank constrained solutions to linear matrix equations (LME). The method proposed here is based on minimizing a non-convex quadratic functional, which will hence-forth be termed as…

Optimization and Control · Mathematics 2018-09-10 Shravan Mohan

We study the problem of estimating low-rank matrices from linear measurements (a.k.a., matrix sensing) through nonconvex optimization. We propose an efficient stochastic variance reduced gradient descent algorithm to solve a nonconvex…

Machine Learning · Statistics 2017-01-17 Xiao Zhang , Lingxiao Wang , Quanquan Gu

We address the noncommutative version of the Edmonds' problem, which asks to determine the inner rank of a matrix in noncommuting variables. We provide an algorithm for the calculation of this inner rank by relating the problem with the…

Operator Algebras · Mathematics 2024-12-10 Johannes Hoffmann , Tobias Mai , Roland Speicher

In this manuscript, we research on the behaviors of surrogates for the rank function on different image processing problems and their optimization algorithms. We first propose a novel nonconvex rank surrogate on the general rank…

Machine Learning · Computer Science 2024-09-23 Cho-Ying Wu , Jian-Jiun Ding

The paper is devoted to the solution of a weighted nonlinear least-squares problem for low-rank signal estimation, which is related to Hankel structured low-rank approximation problems. A modified weighted Gauss-Newton method, which uses…

Numerical Analysis · Mathematics 2020-12-01 N. Zvonarev , N. Golyandina

In this paper, we theoretically investigate the low-rank matrix recovery problem in the context of the unconstrained regularized nuclear norm minimization (RNNM) framework. Our theoretical findings show that, the RNNM method is able to…

Numerical Analysis · Mathematics 2021-03-09 Wendong Wang , Feng Zhang , Jianjun Wang