English
Related papers

Related papers: Statistically Optimal and Computationally Efficien…

200 papers

To efficiently express tensor data using the Tucker format, a critical task is to minimize the multilinear rank such that the model would not be over-flexible and lead to overfitting. Due to the lack of rank minimization tools in tensor,…

Signal Processing · Electrical Eng. & Systems 2024-09-11 Xueke Tong , Hancheng Zhu , Lei Cheng , Yik-Chung Wu

Unlike matrix completion, tensor completion does not have an algorithm that is known to achieve the information-theoretic sample complexity rate. This paper develops a new algorithm for the special case of completion for nonnegative…

Machine Learning · Computer Science 2022-05-25 Caleb Bugg , Chen Chen , Anil Aswani

We investigate the sample size requirement for exact recovery of a high order tensor of low rank from a subset of its entries. In the Tucker decomposition framework, we show that the Riemannian optimization algorithm with initial value…

Machine Learning · Statistics 2019-11-13 Jian-Feng Cai , Lizhang Miao , Yang Wang , Yin Xian

We propose a unified framework for estimating low-rank matrices through nonconvex optimization based on gradient descent algorithm. Our framework is quite general and can be applied to both noisy and noiseless observations. In the general…

Machine Learning · Statistics 2016-10-18 Lingxiao Wang , Xiao Zhang , Quanquan Gu

Extracting latent low-dimensional structure from high-dimensional data is of paramount importance in timely inference tasks encountered with `Big Data' analytics. However, increasingly noisy, heterogeneous, and incomplete datasets as well…

Machine Learning · Statistics 2015-06-19 Morteza Mardani , Gonzalo Mateos , Georgios B. Giannakis

There has been an increased interest in multimodal language processing including multimodal dialog, question answering, sentiment analysis, and speech recognition. However, naturally occurring multimodal data is often imperfect as a result…

Machine Learning · Computer Science 2019-07-03 Paul Pu Liang , Zhun Liu , Yao-Hung Hubert Tsai , Qibin Zhao , Ruslan Salakhutdinov , Louis-Philippe Morency

Tensor decomposition is a powerful tool for extracting physically meaningful latent factors from multi-dimensional nonnegative data, and has been an increasing interest in a variety of fields such as image processing, machine learning, and…

Machine Learning · Computer Science 2024-12-03 Xiongjun Zhang , Michael K. Ng

In the present paper, we consider the problem of matrix completion with noise. Unlike previous works, we consider quite general sampling distribution and we do not need to know or to estimate the variance of the noise. Two new nuclear-norm…

Statistics Theory · Mathematics 2014-02-06 Olga Klopp

For a given symmetric tensor, we aim at finding a new one whose symmetric rank is small and that is close to the given one. There exist linear relations among the entries of low rank symmetric tensors. Such linear relations can be expressed…

Numerical Analysis · Mathematics 2017-09-08 Jiawang Nie

The low-tubal-rank tensor model has been recently proposed for real-world multidimensional data. In this paper, we study the low-tubal-rank tensor completion problem, i.e., to recover a third-order tensor by observing a subset of its…

Machine Learning · Computer Science 2016-10-12 Xiao-Yang Liu , Shuchin Aeron , Vaneet Aggarwal , Xiaodong Wang

This paper is concerned with the low Tucker-rank tensor completion problem, which is about reconstructing a tensor $ T \in\mathbb{R}^{n\times n \times n}$ of low multilinear rank from partially observed entries. Riemannian optimization…

Optimization and Control · Mathematics 2023-08-03 Haifeng Wang , Jinchi Chen , Ke Wei

We consider the problem of learning low-rank tensors from partial observations with structural constraints, and propose a novel factorization of such tensors, which leads to a simpler optimization problem. The resulting problem is an…

Machine Learning · Computer Science 2023-05-16 Jayadev Naram , Tanmay Kumar Sinha , Pawan Kumar

Matrix completion is a ubiquitous tool in machine learning and data analysis. Most work in this area has focused on the number of observations necessary to obtain an accurate low-rank approximation. In practice, however, the cost of…

Machine Learning · Computer Science 2021-04-19 Dong Hu , Alex Gittens , Malik Magdon-Ismail

Matrix completion algorithms recover a low rank matrix from a small fraction of the entries, each entry contaminated with additive errors. In practice, the singular vectors and singular values of the low rank matrix play a pivotal role for…

Methodology · Statistics 2016-05-03 Juhee Cho , Donggyu Kim , Karl Rohe

This paper proposes a novel approach to tensor completion, which recovers missing entries of data represented by tensors. The approach is based on the tensor train (TT) rank, which is able to capture hidden information from tensors thanks…

Numerical Analysis · Computer Science 2017-04-26 Johann A. Bengua , Ho N. Phien , Hoang D. Tuan , Minh N. Do

Low rank tensor ring model is powerful for image completion which recovers missing entries in data acquisition and transformation. The recently proposed tensor ring (TR) based completion algorithms generally solve the low rank optimization…

Machine Learning · Statistics 2021-04-07 Zhen Long , Ce Zhu , Jiani Liu , Yipeng Liu

Recently, a tensor factorization based method for a low tubal rank tensor completion problem of a third order tensor was proposed, which performed better than some existing methods. Tubal rank is only defined on one mode of third order…

Optimization and Control · Mathematics 2024-08-20 Quan Yu , Xinzhen Zhang , Zheng-Hai Huang

In this paper, we propose a general framework for tensor singular value decomposition (tensor SVD), which focuses on the methodology and theory for extracting the hidden low-rank structure from high-dimensional tensor data. Comprehensive…

Statistics Theory · Mathematics 2020-01-09 Anru Zhang , Dong Xia

In the tensor completion problem, one seeks to estimate a low-rank tensor based on a random sample of revealed entries. In terms of the required sample size, earlier work revealed a large gap between estimation with unbounded computational…

Data Structures and Algorithms · Computer Science 2016-12-26 Andrea Montanari , Nike Sun

Low-rank matrix estimation under heavy-tailed noise is challenging, both computationally and statistically. Convex approaches have been proven statistically optimal but suffer from high computational costs, especially since robust loss…

Statistics Theory · Mathematics 2023-05-12 Yinan Shen , Jingyang Li , Jian-Feng Cai , Dong Xia
‹ Prev 1 3 4 5 6 7 10 Next ›