English
Related papers

Related papers: Matrix Completion via Max-Norm Constrained Optimiz…

200 papers

Low-rank matrix completion is a problem of immense practical importance. Recent works on the subject often use nuclear norm as a convex surrogate of the rank function. Despite its solid theoretical foundation, the convex version of the…

Computer Vision and Pattern Recognition · Computer Science 2014-10-29 Yu-Xiang Wang , Choon Meng Lee , Loong-Fah Cheong , Kim-Chuan Toh

Alternating minimization represents a widely applicable and empirically successful approach for finding low-rank matrices that best fit the given data. For example, for the problem of low-rank matrix completion, this method is believed to…

Machine Learning · Statistics 2012-12-04 Prateek Jain , Praneeth Netrapalli , Sujay Sanghavi

Low-rank matrix completion concerns the problem of estimating unobserved entries in a matrix using a sparse set of observed entries. We consider the non-uniform setting where the observed entries are sampled with highly varying…

Machine Learning · Statistics 2024-03-04 Xumei Xi , Christina Lee Yu , Yudong Chen

We consider the problem of noisy matrix completion, in which the goal is to reconstruct a structured matrix whose entries are partially observed in noise. Standard approaches to this underdetermined inverse problem are based on assuming…

Machine Learning · Statistics 2017-09-04 Nihar B. Shah , Sivaraman Balakrishnan , Martin J. Wainwright

In this paper we consider the trace regression model where $n$ entries or linear combinations of entries of an unknown $m_1\times m_2$ matrix $A_0$ corrupted by noise are observed. We establish for the nuclear-norm penalized estimator of…

Statistics Theory · Mathematics 2011-10-26 Karim Lounici

We propose a novel Riemannian method for solving the Extreme multi-label classification problem that exploits the geometric structure of the sparse low-dimensional local embedding models. A constrained optimization problem is formulated as…

Optimization and Control · Mathematics 2021-10-01 Jayadev Naram , Tanmay Kumar Sinha , Pawan Kumar

Inspired by regularization techniques in statistics and machine learning, we study complementary composite minimization in the stochastic setting. This problem corresponds to the minimization of the sum of a (weakly) smooth function endowed…

Machine Learning · Computer Science 2024-01-24 Alexandre d'Aspremont , Cristóbal Guzmán , Clément Lezane

Motivated by applications in single-cell biology and metagenomics, we investigate the problem of matrix reordering based on a noisy disordered monotone Toeplitz matrix model. We establish the fundamental statistical limit for this problem…

Statistics Theory · Mathematics 2023-08-15 T. Tony Cai , Rong Ma

Atomic norm minimization is a convex optimization framework to recover point sources from a subset of their low-pass observations, or equivalently the underlying frequencies of a spectrally-sparse signal. When the amplitudes of the sources…

Information Theory · Computer Science 2021-02-24 Maxime Ferreira Da Costa , Yuejie Chi

We study the problem of learning a tensor from a set of linear measurements. A prominent methodology for this problem is based on a generalization of trace norm regularization, which has been used extensively for learning low rank matrices,…

Machine Learning · Computer Science 2013-07-18 Bernardino Romera-Paredes , Massimiliano Pontil

The de-facto standard approach of promoting sparsity by means of $\ell_1$-regularization becomes ineffective in the presence of simplex constraints, i.e.,~the target is known to have non-negative entries summing up to a given constant. The…

Methodology · Statistics 2016-05-04 Ping Li , Syama Sundar Rangapuram , Martin Slawski

Affine matrix rank minimization problem is a fundamental problem with a lot of important applications in many fields. It is well known that this problem is combinatorial and NP-hard in general. In this paper, a continuous promoting low rank…

Optimization and Control · Mathematics 2017-05-02 Angang Cui , Jigen Peng , Haiyang Li , Chengyi Zhang , Yongchao Yu

We consider the problem of matrix completion with graphs as side information depicting the interrelations between variables. The key challenge lies in leveraging the similarity structure of the graph to enhance matrix recovery. Existing…

Machine Learning · Computer Science 2025-02-13 Yao Wang , Yiyang Yang , Kaidong Wang , Shanxing Gao , Xiuwu Liao

In this work we construct an optimal shrinkage estimator for the precision matrix in high dimensions. We consider the general asymptotics when the number of variables $p\rightarrow\infty$ and the sample size $n\rightarrow\infty$ so that…

Statistics Theory · Mathematics 2023-04-19 Taras Bodnar , Arjun K. Gupta , Nestor Parolya

We consider the densest submatrix problem, which seeks the submatrix of fixed size of a given binary matrix that contains the most nonzero entries. This problem is a natural generalization of fundamental problems in combinatorial…

Optimization and Control · Mathematics 2026-03-13 Valentine Olanubi , Phineas Agar , Brendan Ames

It is the main goal of this paper to propose a novel method to perform matrix completion on-line. Motivated by a wide variety of applications, ranging from the design of recommender systems to sensor network localization through seismic…

Machine Learning · Statistics 2014-01-13 Charanpal Dhanjal , Romaric Gaudel , Stéphan Clémençon

Matrix completion is a basic machine learning problem that has wide applications, especially in collaborative filtering and recommender systems. Simple non-convex optimization algorithms are popular and effective in practice. Despite recent…

Machine Learning · Computer Science 2018-07-24 Rong Ge , Jason D. Lee , Tengyu Ma

We present a novel method for matrix completion, specifically designed for matrices where one dimension is significantly larger than the other. Our Columns Selected Matrix Completion (CSMC) method combines Column Subset Selection with…

Machine Learning · Computer Science 2026-04-14 Antonina Krajewska , Ewa Niewiadomska-Szynkiewicz

Compressive sampling has become a widely used approach to construct polynomial chaos surrogates when the number of available simulation samples is limited. Originally, these expensive simulation samples would be obtained at random locations…

Computation · Statistics 2018-07-04 Negin Alemazkoor , Hadi Meidani

We introduce a new criterion, the Rank Selection Criterion (RSC), for selecting the optimal reduced rank estimator of the coefficient matrix in multivariate response regression models. The corresponding RSC estimator minimizes the Frobenius…

Statistics Theory · Mathematics 2011-10-18 Florentina Bunea , Yiyuan She , Marten H. Wegkamp