English
Related papers

Related papers: Robust Low-rank Tensor Train Recovery

200 papers

We present a new algorithm for incrementally updating the tensor train decomposition of a stream of tensor data. This new algorithm, called the {\em tensor train incremental core expansion} (TT-ICE) improves upon the current…

Numerical Analysis · Mathematics 2023-09-19 Doruk Aksoy , David J. Gorsich , Shravan Veerapaneni , Alex A. Gorodetsky

Tensor completion refers to the task of estimating the missing data from an incomplete measurement or observation, which is a core problem frequently arising from the areas of big data analysis, computer vision, and network engineering. Due…

Machine Learning · Computer Science 2021-05-21 Chenjian Pan , Chen Ling , Hongjin He , Liqun Qi , Yanwei Xu

Coupled tensor decomposition reveals the joint data structure by incorporating priori knowledge that come from the latent coupled factors. The tensor ring (TR) decomposition is invariant under the permutation of tensors with different mode…

Machine Learning · Computer Science 2020-11-10 Huyan Huang , Yipeng Liu , Ce Zhu

The advancement of sensing technology has driven the widespread application of high-dimensional data. However, issues such as missing entries during acquisition and transmission negatively impact the accuracy of subsequent tasks. Tensor…

Image and Video Processing · Electrical Eng. & Systems 2025-04-09 Jie Yang , Chang Su , Yuhan Zhang , Jianjun Zhu , Jianli Wang

In the framework of multidimensional Compressed Sensing (CS), we introduce an analytical reconstruction formula that allows one to recover an $N$th-order $(I_1\times I_2\times \cdots \times I_N)$ data tensor $\underline{\mathbf{X}}$ from a…

Information Theory · Computer Science 2015-06-19 Cesar F. Caiafa , Andrzej Cichocki

We develop new approximation algorithms and data structures for representing and computing with multivariate functions using the functional tensor-train (FT), a continuous extension of the tensor-train (TT) decomposition. The FT represents…

Numerical Analysis · Mathematics 2018-12-13 Alex A. Gorodetsky , Sertac Karaman , Youssef M. Marzouk

We propose a sampling-based method for computing the tensor ring (TR) decomposition of a data tensor. The method uses leverage score sampled alternating least squares to fit the TR cores in an iterative fashion. By taking advantage of the…

Numerical Analysis · Mathematics 2021-07-12 Osman Asif Malik , Stephen Becker

In this paper, we explore the role of tensor algebra in balanced truncation (BT) based model reduction/identification for high-dimensional multilinear/linear time invariant systems. In particular, we employ tensor train decomposition (TTD),…

Systems and Control · Electrical Eng. & Systems 2020-01-28 Can Chen , Amit Surana , Anthony Bloch , Indika Rajapakse

Our interest lies in the recoverability properties of compressed tensors under the \textit{canonical polyadic decomposition} (CPD) model. The considered problem is well-motivated in many applications, e.g., hyperspectral image and video…

Signal Processing · Electrical Eng. & Systems 2020-08-26 Shahana Ibrahim , Xiao Fu , Xingguo Li

There are several factorizations of multi-dimensional tensors into lower-dimensional components, known as `tensor networks'. We consider the popular `tensor-train' (TT) format and ask: How efficiently can we compute a low-rank approximation…

Numerical Analysis · Mathematics 2023-04-18 Melven Röhrig-Zöllner , Jonas Thies , Achim Basermann

Tensor data are multi-dimension arrays. Low-rank decomposition-based regression methods with tensor predictors exploit the structural information in tensor predictors while significantly reducing the number of parameters in tensor…

Machine Learning · Statistics 2024-12-19 Tian Yan , Yinan Li , Fang Liu

In this paper we study the problem of decomposing a given tensor into a tensor train such that the tensors at the vertices are orthogonally decomposable. When the tensor train has length two, and the orthogonally decomposable tensors at the…

Numerical Analysis · Mathematics 2021-09-27 Karim Halaseh , Tommi Muller , Elina Robeva

The goal of tensor completion is to recover a tensor from a subset of its entries, often by exploiting its low-rank property. Among several useful definitions of tensor rank, the low-tubal-rank was shown to give a valuable characterization…

Machine Learning · Computer Science 2022-10-18 Yicong He , George K. Atia

We propose a strategy to compress and store large volumes of scientific data represented on unstructured grids. Approaches utilizing tensor decompositions for data compression have already been proposed. Here, data on a structured grid is…

Numerical Analysis · Mathematics 2024-09-23 Prashant Rai , Hemanth Kolla , Lewis Cannada , Alex Gorodetsky

The problem of incomplete data is common in signal processing and machine learning. Tensor completion algorithms aim to recover the incomplete data from its partially observed entries. In this paper, taking advantages of high…

Numerical Analysis · Computer Science 2018-12-03 Longhao Yuan , Jianting Cao , Qiang Wu , Qibin Zhao

This study aims to solve the over-reliance on the rank estimation strategy in the standard tensor factorization-based tensor recovery and the problem of a large computational cost in the standard t-SVD-based tensor recovery. To this end, we…

Machine Learning · Computer Science 2023-05-22 Jingjing Zheng , Wenzhe Wang , Xiaoqin Zhang , Xianta Jiang

We study low rank approximation of tensors, focusing on the tensor train and Tucker decompositions, as well as approximations with tree tensor networks and more general tensor networks. For tensor train decomposition, we give a bicriteria…

Data Structures and Algorithms · Computer Science 2023-11-28 Arvind V. Mahankali , David P. Woodruff , Ziyu Zhang

Tensor ring (TR) decomposition is a simple but effective tensor network for analyzing and interpreting latent patterns of tensors. In this work, we propose a doubly randomized optimization framework for computing TR decomposition. It can be…

Numerical Analysis · Mathematics 2023-03-30 Yajie Yu , Hanyu Li , Jingchun Zhou

We consider the problem of recovering an unknown effectively $(s_1,s_2)$-sparse low-rank-$R$ matrix $X$ with possibly non-orthogonal rank-$1$ decomposition from incomplete and inaccurate linear measurements of the form $y = \mathcal A (X) +…

Numerical Analysis · Mathematics 2020-07-29 Massimo Fornasier , Johannes Maly , Valeriya Naumova

The memory capacity of embedding tables in deep learning recommendation models (DLRMs) is increasing dramatically from tens of GBs to TBs across the industry. Given the fast growth in DLRMs, novel solutions are urgently needed, in order to…

Machine Learning · Computer Science 2021-01-29 Chunxing Yin , Bilge Acun , Xing Liu , Carole-Jean Wu