English
Related papers

Related papers: A New Convex Relaxation for Tensor Completion

200 papers

We consider the problem of supervised learning with convex loss functions and propose a new form of iterative regularization based on the subgradient method. Unlike other regularization approaches, in iterative regularization no constraint…

Machine Learning · Statistics 2015-04-02 Junhong Lin , Lorenzo Rosasco , Ding-Xuan Zhou

Higher-order tensors are becoming prevalent in many scientific areas such as computer vision, social network analysis, data mining and neuroscience. Traditional tensor decomposition approaches face three major challenges: model selecting,…

Numerical Analysis · Computer Science 2014-07-08 Fanhua Shang , Yuanyuan Liu , James Cheng

In this paper we consider ill-posed inverse problems, both linear and nonlinear, by a heavy ball method in which a strongly convex regularization function is incorporated to detect the feature of the sought solution. We develop ideas on how…

Numerical Analysis · Mathematics 2024-04-05 Qinian Jin , Qin Huang

Tensor completion is a technique of filling missing elements of the incomplete data tensors. It being actively studied based on the convex optimization scheme such as nuclear-norm minimization. When given data tensors include some noises,…

Computer Vision and Pattern Recognition · Computer Science 2018-01-11 Tatsuya Yokota , Hidekata Hontani

To alleviate the bias generated by the l1-norm in the low-rank tensor completion problem, nonconvex surrogates/regularizers have been suggested to replace the tensor nuclear norm, although both can achieve sparsity. However, the…

Machine Learning · Computer Science 2023-10-11 Zhi-Yong Wang , Hing Cheung So , Abdelhak M. Zoubir

Unlike the matrix case, computing low-rank approximations of tensors is NP-hard and numerically ill-posed in general. Even the best rank-1 approximation of a tensor is NP-hard. In this paper, we use convex optimization to develop…

Statistics Theory · Mathematics 2016-09-14 Anil Aswani

There is growing body of learning problems for which it is natural to organize the parameters into matrix, so as to appropriately regularize the parameters under some matrix norm (in order to impose some more sophisticated prior knowledge).…

Machine Learning · Computer Science 2010-10-19 Sham M. Kakade , Shai Shalev-Shwartz , Ambuj Tewari

The use of convex regularizers allows for easy optimization, though they often produce biased estimation and inferior prediction performance. Recently, nonconvex regularizers have attracted a lot of attention and outperformed convex ones.…

Optimization and Control · Mathematics 2017-02-14 Quanming Yao , James. T Kwok

This paper considers a large class of problems where we seek to recover a low rank matrix and/or sparse vector from some set of measurements. While methods based on convex relaxations suffer from a (possibly large) estimator bias, and other…

Machine Learning · Statistics 2021-09-28 April Sagan , John E. Mitchell

In this paper we propose an algorithm to classify tensor data. Our methodology is built on recent studies about matrix classification with the trace norm constrained weight matrix and the tensor trace norm. Similar to matrix classification,…

Numerical Analysis · Computer Science 2011-09-08 Ziqiang Shi , Tieran Zheng , Jiqing Han

Low rank tensor learning, such as tensor completion and multilinear multitask learning, has received much attention in recent years. In this paper, we propose higher order matching pursuit for low rank tensor learning problems with a convex…

Machine Learning · Statistics 2015-03-10 Yuning Yang , Siamak Mehrkanoon , Johan A. K. Suykens

In this paper we present a general convex optimization approach for solving high-dimensional multiple response tensor regression problems under low-dimensional structural assumptions. We consider using convex and weakly decomposable…

Statistics Theory · Mathematics 2017-04-17 Garvesh Raskutti , Ming Yuan , Han Chen

Multi-relational learning has received lots of attention from researchers in various research communities. Most existing methods either suffer from superlinear per-iteration cost, or are sensitive to the given ranks. To address both issues,…

Machine Learning · Computer Science 2016-01-19 Fanhua Shang , James Cheng , Hong Cheng

The Calder\'on problem consists in recovering an unknown coefficient of a partial differential equation from boundary measurements of its solution. These measurements give rise to a highly nonlinear forward operator. As a consequence, the…

Analysis of PDEs · Mathematics 2025-07-02 Giovanni S. Alberti , Romain Petit , Simone Sanna

In this work we study convex relaxations of quadratic optimisation problems over permutation matrices. While existing semidefinite programming approaches can achieve remarkably tight relaxations, they have the strong disadvantage that they…

Optimization and Control · Mathematics 2018-08-01 Florian Bernard , Christian Theobalt , Michael Moeller

In this paper we study the auxiliary problems that appear in $p$-order tensor methods for unconstrained minimization of convex functions with $\nu$-H\"{o}lder continuous $p$th derivatives. This type of auxiliary problems corresponds to the…

Optimization and Control · Mathematics 2021-06-07 Geovani Nunes Grapiglia , Yurii Nesterov

This paper considers the problem of finding a low rank matrix from observations of linear combinations of its elements. It is well known that if the problem fulfills a restricted isometry property (RIP), convex relaxations using the nuclear…

Optimization and Control · Mathematics 2017-11-13 Carl Olsson , Marcus Carlsson , Erik Bylow

The importance of accurate recommender systems has been widely recognized by academia and industry. However, the recommendation quality is still rather low. Recently, a linear sparse and low-rank representation of the user-item matrix has…

Information Retrieval · Computer Science 2016-02-29 Zhao Kang , Qiang Cheng

Convex regularizers are often used for sparse learning. They are easy to optimize, but can lead to inferior prediction performance. The difference of $\ell_1$ and $\ell_2$ ($\ell_{1-2}$) regularizer has been recently proposed as a nonconvex…

Machine Learning · Computer Science 2017-06-21 Quanming Yao , James T. Kwok , Xiawei Guo

In this paper, we propose an extension of trace ratio based Manifold learning methods to deal with multidimensional data sets. Based on recent progress on the tensor-tensor product, we present a generalization of the trace ratio criterion…

Numerical Analysis · Mathematics 2024-02-15 Mohammed Bouallala , Franck Dufrenois , khalide jbilou , Ahmed Ratnani