English
Related papers

Related papers: Fast adaptive tubal rank-revealing algorithm for t…

200 papers

When the amount of entanglement in a quantum system is limited, the relevant dynamics of the system is restricted to a very small part of the state space. When restricted to this subspace the description of the system becomes efficient in…

Quantum Physics · Physics 2015-06-17 D. Tamascelli , R. Rosenbach , M. B. Plenio

Low-rank tensor recovery problems have been widely studied in many applications of signal processing and machine learning. Tucker decomposition is known as one of the most popular decompositions in the tensor framework. In recent years,…

Numerical Analysis · Mathematics 2020-07-17 Rachel Grotheer , Shuang Li , Anna Ma , Deanna Needell , Jing Qin

Tensor decompositions have rich applications in statistics and machine learning, and developing efficient, accurate algorithms for the problem has received much attention recently. Here, we present a new method built on Kruskal's uniqueness…

Machine Learning · Computer Science 2017-04-20 Miaoyan Wang , Yun S. Song

We study matrix and tensor denoising when the underlying signal is \textbf{not} necessarily low-rank. In the tensor setting, we observe \[ Y = X^\ast + Z \in \mathbb{R}^{p_1 \times p_2 \times p_3}, \] where $X^\ast$ is an unknown signal…

New algorithms are proposed for the Tucker approximation of a 3-tensor, that access it using only the tensor-by-vector-by-vector multiplication subroutine. In the matrix case, Krylov methods are methods of choice to approximate the dominant…

Numerical Analysis · Mathematics 2012-02-06 S. A. Goreinov , I. V. Oseledets , D. V. Savostyanov

The randomized singular value decomposition (SVD) has become a popular approach to computing cheap, yet accurate, low-rank approximations to matrices due to its efficiency and strong theoretical guarantees. Recent work by Boull\'e and…

Numerical Analysis · Mathematics 2024-12-10 David Persson , Nicolas Boullé , Daniel Kressner

The deployment of Large Language Models is constrained by the memory and bandwidth demands of static weights and dynamic Key-Value cache. SVD-based compression provides a hardware-friendly solution to reduce these costs. However, existing…

Computation and Language · Computer Science 2026-04-03 Ruoling Qi , Yirui Liu , Xuaner Wu , Xiangyu Wang , Ming Li , Chen Chen , Jian Chen , Yin Chen , Qizhen Weng

Low-rank modeling has many important applications in computer vision and machine learning. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has demonstrated better empirical…

Machine Learning · Computer Science 2018-07-25 Quanming Yao , James T. Kwok , Taifeng Wang , Tie-Yan Liu

Indoor localization is a supporting technology for a broadening range of pervasive wireless applications. One promis- ing approach is to locate users with radio frequency fingerprints. However, its wide adoption in real-world systems is…

Information Theory · Computer Science 2017-08-04 Xiao-Yang Liu , Shuchin Aeron , Vaneet Aggarwal , Xiaodong Wang , Min-You Wu

We propose a low-rank tensor approach to approximate linear transport and nonlinear Vlasov solutions and their associated flow maps. The approach takes advantage of the fact that the differential operators in the Vlasov equation is tensor…

Numerical Analysis · Mathematics 2022-03-23 Wei Guo , Jing-Mei Qiu

The problem of recovering a low $n$-rank tensor is an extension of sparse recovery problem from the low dimensional space (matrix space) to the high dimensional space (tensor space) and has many applications in computer vision and graphics…

Optimization and Control · Mathematics 2014-04-09 Min Zhang , Lei Yang , Zheng-Hai Huang

Tensor train (TT) decomposition provides a space-efficient representation for higher-order tensors. Despite its advantage, we face two crucial limitations when we apply the TT decomposition to machine learning problems: the lack of…

Machine Learning · Statistics 2017-08-03 Masaaki Imaizumi , Takanori Maehara , Kohei Hayashi

In this paper we suggest a new algorithm for the computation of a best rank one approximation of tensors, called alternating singular value decomposition. This method is based on the computation of maximal singular values and the…

Numerical Analysis · Mathematics 2015-03-19 S. Friedland , V. Mehrmann , R. Pajarola , S. K. Suter

A valuable feature of the tubal tensor framework is that many familiar constructions from matrix algebra carry over to tensors, including SVD and notions of rank. Importantly, it has been shown that for a specific family of tubal products,…

Numerical Analysis · Mathematics 2026-04-21 Uria Mor

We present a new computational approach to approximating a large, noisy data table by a low-rank matrix with sparse singular vectors. The approximation is obtained from thresholded subspace iterations that produce the singular vectors…

Methodology · Statistics 2011-12-13 Dan Yang , Zongming Ma , Andreas Buja

Randomized iterative algorithms, such as the randomized Kaczmarz method and the randomized Gauss-Seidel method, have gained considerable popularity due to their efficacy in solving matrix-vector and matrix-matrix regression problems. Our…

This paper proposes a novel formulation of the tensor completion problem to impute missing entries of data represented by tensors. The formulation is introduced in terms of tensor train (TT) rank which can effectively capture global…

Numerical Analysis · Computer Science 2016-01-07 Ho N. Phien , Hoang D. Tuan , Johann A. Bengua , Minh N. Do

We propose a block coordinate descent type algorithm for estimating the rank of a given tensor. In addition, the algorithm provides the canonical polyadic decomposition of a tensor. In order to estimate the tensor rank we use sparse…

Numerical Analysis · Mathematics 2019-04-30 Ramin Goudarzi Karim , Carmeliza Navasca , Da Yan

The t-SVD based Tensor Robust Principal Component Analysis (TRPCA) decomposes low rank multi-linear signal corrupted by gross errors into low multi-rank and sparse component by simultaneously minimizing tensor nuclear norm and l 1 norm. But…

Computer Vision and Pattern Recognition · Computer Science 2017-07-11 M. Baburaj , Sudhish N. George

In this paper, a new definition of tensor p-shrinkage nuclear norm (p-TNN) is proposed based on tensor singular value decomposition (t-SVD). In particular, it can be proved that p-TNN is a better approximation of the tensor average rank…

Machine Learning · Computer Science 2019-07-10 Chunsheng Liu , Hong Shan , Chunlei Chen