English
Related papers

Related papers: Burer-Monteiro factorizability of nuclear norm reg…

200 papers

This paper considers the problem of minimizing the sum of a smooth function and the Schatten-$p$ norm of the matrix. Our contribution involves proposing accelerated iteratively reweighted nuclear norm methods designed for solving the…

Optimization and Control · Mathematics 2024-06-27 Hao Wang , Ye Wang , Xiangyu Yang

In recent years, the nuclear norm minimization (NNM) problem has been attracting much attention in computer vision and machine learning. The NNM problem is capitalized on its convexity and it can be solved efficiently. The standard nuclear…

Computer Vision and Pattern Recognition · Computer Science 2014-05-26 Qi Xie , Deyu Meng , Shuhang Gu , Lei Zhang , Wangmeng Zuo , Xiangchu Feng , Zongben Xu

In this paper, we theoretically investigate the low-rank matrix recovery problem in the context of the unconstrained regularized nuclear norm minimization (RNNM) framework. Our theoretical findings show that, the RNNM method is able to…

Numerical Analysis · Mathematics 2021-03-09 Wendong Wang , Feng Zhang , Jianjun Wang

We consider the NP-hard problem of finding the closest rank-one binary tensor to a given binary tensor, which we refer to as the rank-one Boolean tensor factorization (BTF) problem. This optimization problem can be used to recover a planted…

Optimization and Control · Mathematics 2024-05-06 Alberto Del Pia , Aida Khajavirad

The $p$-regularized subproblem (p-RS) is a regularisation technique in computing a Newton-like step for unconstrained optimization, which globally minimizes a local quadratic approximation of the objective function while incorporating with…

Optimization and Control · Mathematics 2018-05-01 Yong Hsia , Ruey-Lin Sheu , Ya-xiang Yuan

Nonnegative matrix factorization (NMF) has become a ubiquitous tool for data analysis. An important variant is the sparse NMF problem which arises when we explicitly require the learnt features to be sparse. A natural measure of sparsity is…

Machine Learning · Computer Science 2013-03-20 Vamsi K. Potluru , Sergey M. Plis , Jonathan Le Roux , Barak A. Pearlmutter , Vince D. Calhoun , Thomas P. Hayes

Optimization problems over permutation matrices appear widely in facility layout, chip design, scheduling, pattern recognition, computer vision, graph matching, etc. Since this problem is NP-hard due to the combinatorial nature of…

Optimization and Control · Mathematics 2016-09-01 Bo Jiang , Ya-Feng Liu , Zaiwen Wen

Finding a minimal factorization for a generic semigroup can be done by using the Froidure-Pin Algorithm, which is not feasible for semigroups of large sizes. On the other hand, if we restrict our attention to just a particular semigroup, we…

Rings and Algebras · Mathematics 2024-02-14 Daniele Marchei , Emanuela Merelli , Andrew Francis

When solving rank-deficient or discrete ill-posed problems by regularization methods, the choice of the regularization parameter is crucial. It is also of interest, the regularization norm used in the selection of the solution. In this…

Numerical Analysis · Mathematics 2024-10-30 Ibrahima Dione

We study the general norm optimization for combinatorial problems, initiated by Chakrabarty and Swamy (STOC 2019). We propose a general formulation that captures a large class of combinatorial structures: we are given a set $U$ of $n$…

Data Structures and Algorithms · Computer Science 2025-05-01 Kuowen Chen , Jian Li , Yuval Rabani , Yiran Zhang

We consider semidefinite programs (SDPs) of size n with equality constraints. In order to overcome scalability issues, Burer and Monteiro proposed a factorized approach based on optimizing over a matrix Y of size $n$ by $k$ such that $X =…

Machine Learning · Statistics 2018-11-29 Thomas Pumir , Samy Jelassi , Nicolas Boumal

This paper is concerned with the unconstrained binary polynomial program (UBPP), which has a host of applications in many science and engineering fields. By leveraging the global exact penalty for its DC constrained SDP reformulation, we…

Optimization and Control · Mathematics 2021-11-09 Yitian Qian , Shaohua Pan

Low-rank matrix recovery addresses the problem of recovering an unknown low-rank matrix from few linear measurements. Nuclear-norm minimization is a tractible approach with a recent surge of strong theoretical backing. Analagous to the…

Numerical Analysis · Mathematics 2015-05-27 Yonina C. Eldar , Deanna Needell , Yaniv Plan

Penalizing the nuclear norm of a function's Jacobian encourages it to locally behave like a low-rank linear map. Such functions vary locally along only a handful of directions, making the Jacobian nuclear norm a natural regularizer for…

Machine Learning · Computer Science 2024-10-11 Christopher Scarvelis , Justin Solomon

Recht, Fazel, and Parrilo provided an analogy between rank minimization and $\ell_0$-norm minimization. Subject to the rank-restricted isometry property, nuclear norm minimization is a guaranteed algorithm for rank minimization. The…

Numerical Analysis · Mathematics 2009-05-01 Kiryung Lee , Yoram Bresler

A large class of two-dimensional $\mathcal{N}=(2,2)$ superconformal field theories can be understood as IR fixed-points of Landau-Ginzburg models. In particular, there are rational conformal field theories that also have a Landau-Ginzburg…

High Energy Physics - Theory · Physics 2015-06-11 Nicolas Behr , Stefan Fredenhagen

This paper is concerned with the factorization form of the rank regularized loss minimization problem. To cater for the scenario in which only a coarse estimation is available for the rank of the true matrix, an $\ell_{2,0}$-norm…

Optimization and Control · Mathematics 2019-08-27 Shujun Bi , Ting Tao , Shaohua Pan

Given a finite sequence of vectors $\mathcal F_0$ in $\C^d$ we characterize in a complete and explicit way the optimal completions of $\mathcal F_0$ obtained by adding a finite sequence of vectors with prescribed norms, where optimality is…

Functional Analysis · Mathematics 2013-02-18 Pedro Massey , Mariano Ruiz , Demetrio Stojanoff

The solution to empirical risk minimization with $f$-divergence regularization (ERM-$f$DR) is presented under mild conditions on $f$. Under such conditions, the optimal measure is shown to be unique. Examples of the solution for particular…

Machine Learning · Statistics 2024-10-25 Francisco Daunas , Iñaki Esnaola , Samir M. Perlaza , H. Vincent Poor

We study the problem of decomposing a polynomial $p$ into a sum of $r$ squares by minimizing a quadratically penalized objective $f_p(\mathbf{u}) = \left\lVert \sum_{i=1}^r u_i^2 - p\right\lVert^2$. This objective is nonconvex and is…

Optimization and Control · Mathematics 2023-10-03 Benoît Legat , Chenyang Yuan , Pablo A. Parrilo