English
Related papers

Related papers: Unified View of Matrix Completion under General St…

200 papers

The S-matrix bootstrap maps out the space of S-matrices allowed by analyticity, crossing, unitarity, and other constraints. For the $2\rightarrow 2$ scattering matrix $S_{2\rightarrow 2}$ such space is an infinite dimensional convex space…

High Energy Physics - Theory · Physics 2021-09-15 Yifei He , Martin Kruczenski

We investigate finite-dimensional constrained structured optimization problems, featuring composite objective functions and set-membership constraints. Offering an expressive yet simple language, this problem class provides a modeling…

Optimization and Control · Mathematics 2023-02-09 Alberto De Marchi , Xiaoxi Jia , Christian Kanzow , Patrick Mehlitz

Matrix Completion is the problem of recovering an unknown real-valued low-rank matrix from a subsample of its entries. Important recent results show that the problem can be solved efficiently under the assumption that the unknown matrix is…

Computational Complexity · Computer Science 2014-04-11 Moritz Hardt , Raghu Meka , Prasad Raghavendra , Benjamin Weitz

We investigate the problem of reconstructing n-by-n structured matrix signal X via convex programming, where each column xj is a vector of s-sparsity and all columns have the same l1-norm. The regularizer in use is matrix norm…

Statistics Theory · Mathematics 2019-12-03 Yuan Tian

Matrix completion results deal with the question of when a partially specified symmetric matrix can be completed to a member of certain matrix cones. Results from positive semidefinite matrix completion and completely positive matrix…

General Mathematics · Mathematics 2025-09-25 Markus Gabl

We propose and analyze a regularization approach for structured prediction problems. We characterize a large class of loss functions that allows to naturally embed structured outputs in a linear space. We exploit this fact to design…

Machine Learning · Computer Science 2017-07-31 Carlo Ciliberto , Alessandro Rudi , Lorenzo Rosasco

Optimization problems with rank constraints arise in many applications, including matrix regression, structured PCA, matrix completion and matrix decomposition problems. An attractive heuristic for solving such problems is to factorize the…

Statistics Theory · Mathematics 2015-09-11 Yudong Chen , Martin J. Wainwright

We give a new proof for an equality of certain max-min and min-max approximation problems involving normal matrices. The previously published proofs of this equality apply tools from matrix theory, (analytic) optimization theory and…

Numerical Analysis · Mathematics 2013-10-23 Jörg Liesen , Petr Tichý

We study a regularizer which is defined as a parameterized infimum of quadratics, and which we call the box-norm. We show that the k-support norm, a regularizer proposed by [Argyriou et al, 2012] for sparse vector prediction problems,…

Machine Learning · Computer Science 2016-01-12 Andrew M. McDonald , Massimiliano Pontil , Dimitris Stamos

Latent variable models are a fundamental modeling tool in machine learning applications, but they present significant computational and analytical challenges. The popular EM algorithm and its variants, is a much used algorithmic tool; yet…

Machine Learning · Computer Science 2015-12-08 Xinyang Yi , Constantine Caramanis

The matrix completion problem consists of finding or approximating a low-rank matrix based on a few samples of this matrix. We propose a new algorithm for matrix completion that minimizes the least-square distance on the sampling set over…

Optimization and Control · Mathematics 2012-09-19 Bart Vandereycken

Finding an unconstrained and statistically interpretable reparameterization of a covariance matrix is still an open problem in statistics. Its solution is of central importance in covariance estimation, particularly in the recent…

Methodology · Statistics 2012-02-09 Mohsen Pourahmadi

Joint inversion refers to the simultaneous inference of multiple parameter fields from observations of systems governed by single or multiple forward models. In many cases these parameter fields reflect different attributes of a single…

Numerical Analysis · Mathematics 2019-01-30 Benjamin Crestel , Georg Stadler , Omar Ghattas

It is well-understood that the robustness of mechanical and robotic control systems depends critically on minimizing sensitivity to arbitrary application-specific details whenever possible. For example, if a system is defined and performs…

Signal Processing · Electrical Eng. & Systems 2018-06-06 Bo Zhang , Jeffrey Uhlmann

Many applications require recovering a matrix of minimal rank within an affine constraint set, with matrix completion a notable special case. Because the problem is NP-hard in general, it is common to replace the matrix rank with the…

Machine Learning · Computer Science 2015-07-08 Bo Xin , David Wipf

In this paper, we develop a relative error bound for nuclear norm regularized matrix completion, with the focus on the completion of full-rank matrices. Under the assumption that the top eigenspaces of the target matrix are incoherent, we…

Machine Learning · Computer Science 2024-05-30 Lijun Zhang , Tianbao Yang , Rong Jin , Zhi-Hua Zhou

This paper presents a regularized Newton method (RNM) with generalized regularization terms for unconstrained convex optimization problems. The generalized regularization includes quadratic, cubic, and elastic net regularizations as special…

Optimization and Control · Mathematics 2024-07-11 Yuya Yamakawa , Nobuo Yamashita

We present an analysis of sets of matrices with rank less than or equal to a specified number $s$. We provide a simple formula for the normal cone to such sets, and use this to show that these sets are prox-regular at all points with rank…

Optimization and Control · Mathematics 2018-09-24 D. Russell Luke

We present a novel algebraic combinatorial view on low-rank matrix completion based on studying relations between a few entries with tools from algebraic geometry and matroid theory. The intrinsic locality of the approach allows for the…

Machine Learning · Computer Science 2014-08-20 Franz J. Király , Louis Theran , Ryota Tomioka

Matrix completion is the problem of recovering a low rank matrix by observing a small fraction of its entries. A series of recent works [KOM12,JNS13,HW14] have proposed fast non-convex optimization based iterative algorithms to solve this…

Numerical Analysis · Computer Science 2014-11-06 Prateek Jain , Praneeth Netrapalli