English
Related papers

Related papers: Incoherent Tensor Norms and Their Applications in …

200 papers

This paper is concerned with the problem of recovering third-order tensor data from limited samples. A recently proposed tensor decomposition (BMD) method has been shown to efficiently compress third-order spatiotemporal data. Using the…

Numerical Analysis · Mathematics 2024-02-21 Fan Tian , Mirjeta Pasha , Misha E. Kilmer , Eric Miller , Abani Patra

Matrix completion, the problem of completing missing entries in a data matrix with low dimensional structure (such as rank), has seen many fruitful approaches and analyses. Tensor completion is the tensor analog, that attempts to impute…

Numerical Analysis · Mathematics 2021-07-07 Zehan Chao , Longxiu Huang , Deanna Needell

We investigate the sample size requirement for exact recovery of a high order tensor of low rank from a subset of its entries. In the Tucker decomposition framework, we show that the Riemannian optimization algorithm with initial value…

Machine Learning · Statistics 2019-11-13 Jian-Feng Cai , Lizhang Miao , Yang Wang , Yin Xian

Higher-order tensors arise frequently in applications such as neuroimaging, recommendation system, social network analysis, and psychological studies. We consider the problem of low-rank tensor estimation from possibly incomplete,…

Machine Learning · Statistics 2020-12-15 Chanwoo Lee , Miaoyan Wang

We provide a novel analysis of low-rank tensor completion based on hypergraph expanders. As a proxy for rank, we minimize the max-quasinorm of the tensor, which generalizes the max-norm for matrices. Our analysis is deterministic and shows…

Machine Learning · Statistics 2021-10-11 Kameron Decker Harris , Yizhe Zhu

In the tensor completion problem, one seeks to estimate a low-rank tensor based on a random sample of revealed entries. In terms of the required sample size, earlier work revealed a large gap between estimation with unbounded computational…

Data Structures and Algorithms · Computer Science 2016-12-26 Andrea Montanari , Nike Sun

Tensor completion can estimate missing values of a high-order data from its partially observed entries. Recent works show that low rank tensor ring approximation is one of the most powerful tools to solve tensor completion problem. However,…

Numerical Analysis · Mathematics 2021-01-03 Abdul Ahad , Zhen Long , Ce Zhu , Yipeng Liu

Tensor ring (TR) decomposition has been successfully used to obtain the state-of-the-art performance in the visual data completion problem. However, the existing TR-based completion methods are severely non-convex and computationally…

Computer Vision and Pattern Recognition · Computer Science 2019-03-22 Jinshi Yu , Chao Li , Qibin Zhao , Guoxu Zhou

Finding the rank of a tensor is a problem that has many applications. Unfortunately it is often very difficult to determine the rank of a given tensor. Inspired by the heuristics of convex relaxation, we consider the nuclear norm instead of…

Optimization and Control · Mathematics 2014-04-23 Harm Derksen

One of the key problems in tensor completion is the number of uniformly random sample entries required for recovery guarantee. The main aim of this paper is to study $n_1 \times n_2 \times n_3$ third-order tensor completion based on…

Machine Learning · Statistics 2022-01-25 Guang-Jing Song , Michael K. Ng , Xiongjun Zhang

We propose a loop optimization algorithm based on nuclear norm regularization for tensor network. The key ingredient of this scheme is to introduce a rank penalty term proposed in the context of data processing. Compared to standard…

Statistical Mechanics · Physics 2024-11-07 Kenji Homma , Tsuyoshi Okubo , Naoki Kawashima

Low rank tensor learning, such as tensor completion and multilinear multitask learning, has received much attention in recent years. In this paper, we propose higher order matching pursuit for low rank tensor learning problems with a convex…

Machine Learning · Statistics 2015-03-10 Yuning Yang , Siamak Mehrkanoon , Johan A. K. Suykens

In this paper, we investigate effective sketching schemes via sparsification for high dimensional multilinear arrays or tensors. More specifically, we propose a novel tensor sparsification algorithm that retains a subset of the entries of a…

Methodology · Statistics 2017-11-17 Dong Xia , Ming Yuan

In this article, we develop methods for estimating a low rank tensor from noisy observations on a subset of its entries to achieve both statistical and computational efficiencies. There have been a lot of recent interests in this problem of…

Machine Learning · Statistics 2018-03-21 Dong Xia , Ming Yuan , Cun-Hui Zhang

The main aim of this paper is to develop a framelet representation of the tensor nuclear norm for third-order tensor completion. In the literature, the tensor nuclear norm can be computed by using tensor singular value decomposition based…

Image and Video Processing · Electrical Eng. & Systems 2020-08-25 Tai-Xiang Jiang , Michael K. Ng , Xi-Le Zhao , Ting-Zhu Huang

We study the rank one completion problem for tensors of arbitrary orders. The notion of rank one determinable tensors is introduced. We explore its properties and propose a recursive algorithm for computing rank one tensor completion. This…

Numerical Analysis · Mathematics 2026-04-28 Linghao Zhang , Ioana Dumitriu , Jiawang Nie

The recent proposed Tensor Nuclear Norm (TNN) [Lu et al., 2016; 2018a] is an interesting convex penalty induced by the tensor SVD [Kilmer and Martin, 2011]. It plays a similar role as the matrix nuclear norm which is the convex surrogate of…

Machine Learning · Statistics 2018-06-08 Canyi Lu , Jiashi Feng , Zhouchen Lin , Shuicheng Yan

We consider the problem of recovering a low-rank tensor from its noisy observation. Previous work has shown a recovery guarantee with signal to noise ratio $O(n^{\lceil K/2 \rceil /2})$ for recovering a $K$th order rank one tensor of size…

Machine Learning · Computer Science 2015-10-28 Qinqing Zheng , Ryota Tomioka

We provide guarantees for learning latent variable models emphasizing on the overcomplete regime, where the dimensionality of the latent space can exceed the observed dimensionality. In particular, we consider multiview mixtures, spherical…

Machine Learning · Computer Science 2014-12-18 Animashree Anandkumar , Rong Ge , Majid Janzamin

We introduce a new tensor norm, the average spectrum norm, to study sample complexity of tensor completion problems based on the canonical polyadic decomposition (CPD). Properties of the average spectrum norm and its dual norm are…

Information Theory · Computer Science 2024-06-19 Oscar López , Richard Lehoucq , Carlos Llosa-Vite , Arvind Prasadan , Daniel M. Dunlavy