English
Related papers

Related papers: Provable Sparse Tensor Decomposition

200 papers

The tensor-train (TT) decomposition is widely used to compress large tensors into a more compact form by exploiting their inherent data structures. A fundamental approach for constructing the TT format is the well-known TT-SVD method, which…

Numerical Analysis · Mathematics 2026-05-26 Yuchao Wang , Maolin Che , Yimin Wei

We consider the problem of low-rank decomposition of incomplete multiway tensors. Since many real-world data lie on an intrinsically low dimensional subspace, tensor low-rank decomposition with missing entries has applications in many data…

Numerical Analysis · Computer Science 2016-08-24 Linxiao Yang , Jun Fang , Hongbin Li , Bing Zeng

This article presents two novel adaptive-sparse polynomial dimensional decomposition (PDD) methods for solving high-dimensional uncertainty quantification problems in computational science and engineering. The methods entail global…

Numerical Analysis · Mathematics 2015-06-18 Vaibhav Yadav , Sharif Rahman

Tensor decomposition models play an increasingly important role in modern data science applications. One problem of particular interest is fitting a low-rank Canonical Polyadic (CP) tensor decomposition model when the tensor has sparse…

Numerical Analysis · Mathematics 2020-12-04 Jeremy M. Myers , Daniel M. Dunlavy , Keita Teranishi , D. S. Hollman

There are a large number of methods for solving under-determined linear inverse problem. Many of them have very high time complexity for large datasets. We propose a new method called Two-Stage Sparse Representation (TSSR) to tackle this…

Computer Vision and Pattern Recognition · Computer Science 2015-12-09 Chengyu Peng , Hong Cheng , Manchor Ko

Tensor Robust Principal Component Analysis (TRPCA) holds a crucial position in machine learning and computer vision. It aims to recover underlying low-rank structures and to characterize the sparse structures of noise. Current approaches…

Numerical Analysis · Mathematics 2026-01-15 Chao Wang , Huiwen Zheng , Raymond Chan , Youwei Wen

As tensor-valued data become increasingly common in time series analysis, there is a growing need for flexible and interpretable models that can handle high-dimensional predictors and responses across multiple modes. We propose a unified…

Methodology · Statistics 2025-06-10 Shibo Li , Yao Zheng

Coupled tensor decomposition reveals the joint data structure by incorporating priori knowledge that come from the latent coupled factors. The tensor ring (TR) decomposition is invariant under the permutation of tensors with different mode…

Machine Learning · Computer Science 2020-11-10 Huyan Huang , Yipeng Liu , Ce Zhu

Tensor Train~(TT) decomposition is widely used in the machine learning and quantum physics communities as a popular tool to efficiently compress high-dimensional tensor data. In this paper, we propose an efficient algorithm to accelerate…

Data Structures and Algorithms · Computer Science 2024-06-07 Vivek Bharadwaj , Beheshteh T. Rakhshan , Osman Asif Malik , Guillaume Rabusseau

Multi-way data arises in many applications such as electroencephalography (EEG) classification, face recognition, text mining and hyperspectral data analysis. Tensor decomposition has been commonly used to find the hidden factors and elicit…

Optimization and Control · Mathematics 2014-05-07 Yangyang Xu

Compressed sensing extends from the recovery of sparse vectors from undersampled measurements via efficient algorithms to the recovery of matrices of low rank from incomplete information. Here we consider a further extension to the…

Numerical Analysis · Mathematics 2014-11-04 Holger Rauhut , Reinhold Schneider , Zeljka Stojanac

Tensor decomposition methods are popular tools for learning latent variables given only lower-order moments of the data. However, the standard assumption is that we have sufficient data to estimate these moments to high accuracy. In this…

Machine Learning · Statistics 2019-03-13 Omer Gottesman , Weiwei Pan , Finale Doshi-Velez

In autoregressive modeling for tensor-valued time series, Tucker decomposition, when applied to the coefficient tensor, provides a clear interpretation of supervised factor modeling but loses its efficiency rapidly with increasing tensor…

Methodology · Statistics 2025-06-03 Yuxi Cai , Lan Li , Yize Wang , Guodong Li

We propose a sparse and low-rank tensor regression model to relate a univariate outcome to a feature tensor, in which each unit-rank tensor from the CP decomposition of the coefficient tensor is assumed to be sparse. This structure is both…

Machine Learning · Computer Science 2018-11-06 Lifang He , Kun Chen , Wanwan Xu , Jiayu Zhou , Fei Wang

Given a time-evolving tensor with missing entries, how can we effectively factorize it for precisely predicting the missing entries? Tensor factorization has been extensively utilized for analyzing various multi-dimensional real-world data.…

Machine Learning · Computer Science 2020-12-17 Dawon Ahn , Jun-Gi Jang , U Kang

Existing methods of vector autoregressive model for multivariate time series analysis make use of low-rank matrix approximation or Tucker decomposition to reduce the dimension of the over-parameterization issue. In this paper, we propose a…

Statistics Theory · Mathematics 2026-01-05 Sijia Xia , Michael K. Ng , Xiongjun Zhang

In tensor completion tasks, the traditional low-rank tensor decomposition models suffer from the laborious model selection problem due to their high model sensitivity. In particular, for tensor ring (TR) decomposition, the number of model…

Machine Learning · Computer Science 2018-12-03 Longhao Yuan , Chao Li , Danilo Mandic , Jianting Cao , Qibin Zhao

We study the sparse phase retrieval problem, recovering an $s$-sparse length-$n$ signal from $m$ magnitude-only measurements. Two-stage non-convex approaches have drawn much attention in recent studies for this problem. Despite…

Information Theory · Computer Science 2023-06-21 Jian-Feng Cai , Jingyang Li , Juntao You

The problem of incomplete data is common in signal processing and machine learning. Tensor completion algorithms aim to recover the incomplete data from its partially observed entries. In this paper, taking advantages of high…

Numerical Analysis · Computer Science 2018-12-03 Longhao Yuan , Jianting Cao , Qiang Wu , Qibin Zhao

In this paper, we propose a general framework for tensor singular value decomposition (tensor SVD), which focuses on the methodology and theory for extracting the hidden low-rank structure from high-dimensional tensor data. Comprehensive…

Statistics Theory · Mathematics 2020-01-09 Anru Zhang , Dong Xia