English
Related papers

Related papers: Mode-wise Tensor Decompositions: Multi-dimensional…

200 papers

We present an alternative approach to decompose non-negative tensors, called many-body approximation. Traditional decomposition methods assume low-rankness in the representation, resulting in difficulties in global optimization and target…

Machine Learning · Statistics 2023-10-31 Kazu Ghalamkari , Mahito Sugiyama , Yoshinobu Kawahara

Tensors, which provide a powerful and flexible model for representing multi-attribute data and multi-way interactions, play an indispensable role in modern data science across various fields in science and engineering. A fundamental task is…

Machine Learning · Computer Science 2022-06-23 Tian Tong , Cong Ma , Ashley Prater-Bennette , Erin Tripp , Yuejie Chi

We propose two provably accurate methods for low CP-rank tensor completion - one using adaptive sampling and one using nonadaptive sampling. Both of our algorithms combine matrix completion techniques for a small number of slices along with…

Numerical Analysis · Mathematics 2024-03-18 Cullen Haselby , Mark Iwen , Santhosh Karnik , Rongrong Wang

In this paper, we propose a new approaches for low rank approximation of quaternion tensors \cite{chen2019low,zhang1997quaternions,hamilton1866elements}. The first method uses quasi-norms to approximate the tensor by a low-rank tensor using…

Numerical Analysis · Mathematics 2025-11-21 Alaeddine Zahir , Ahmed Ratnani , Khalide Jbilou

High-dimensional tensor-valued predictors arise in modern applications, increasingly as learned representations from neural networks. Existing tensor classification methods rely on sparsity or Tucker structures and often lack theoretical…

Machine Learning · Computer Science 2025-12-16 Elynn Chen , Yuefeng Han , Jiayu Li

The problem of low-tubal-rank tensor estimation is a fundamental task with wide applications across high-dimensional signal processing, machine learning, and image science. Traditional approaches tackle such a problem by performing tensor…

Machine Learning · Computer Science 2025-12-24 Zhiyu Liu , Zhi Han , Yandong Tang , Jun Fan , Yao Wang

Tensor network contractions are widely used in statistical physics, quantum computing, and computer science. We introduce a method to efficiently approximate tensor network contractions using low-rank approximations, where each intermediate…

Quantum Physics · Physics 2025-01-01 Linjian Ma , Matthew Fishman , Miles Stoudenmire , Edgar Solomonik

This paper derives the CUR-type factorization for tensors in the Tucker format based on a new variant of the discrete empirical interpolation method known as L-DEIM. This novel sampling technique allows us to construct an efficient…

Numerical Analysis · Mathematics 2023-04-12 Zhengbang Cao , Yimin Wei , Pengpeng Xie

Tensor classification has become increasingly crucial in statistics and machine learning, with applications spanning neuroimaging, computer vision, and recommendation systems. However, the high dimensionality of tensors presents significant…

Methodology · Statistics 2024-09-24 Elynn Chen , Yuefeng Han , Jiayu Li

Low-rank tensor approximations have shown great potential for uncertainty quantification in high dimensions, for example, to build surrogate models that can be used to speed up large-scale inference problems (Eigel et al., Inverse Problems…

Numerical Analysis · Mathematics 2020-11-30 Paul B. Rohrbach , Sergey Dolgov , Lars Grasedyck , Robert Scheichl

There exist linear relations among tensor entries of low rank tensors. These linear relations can be expressed by multi-linear polynomials, which are called generating polynomials. We use generating polynomials to compute tensor rank…

Numerical Analysis · Mathematics 2022-08-17 Jiawang Nie , Li Wang , Zequn Zheng

In this paper, we propose an algorithm for the construction of low-rank approximations of the inverse of an operator given in low-rank tensor format. The construction relies on an updated greedy algorithm for the minimization of a suitable…

Numerical Analysis · Mathematics 2017-05-11 Loic Giraldi , Anthony Nouy , Gregory Legrain

CUR decompositions approximate a matrix using selected columns, rows, and their intersection. Classical CUR theory provides exactness results for low-rank matrices and perturbation bounds controlled by the size of the noise. In this work we…

Numerical Analysis · Mathematics 2026-05-14 Longxiu Huang

Tensor regression networks achieve high compression rate of neural networks while having slight impact on performances. They do so by imposing low tensor rank structure on the weight matrices of fully connected layers. In recent years,…

Machine Learning · Computer Science 2018-11-30 Xingwei Cao , Guillaume Rabusseau

Tensor decomposition on big data has attracted significant attention recently. Among the most popular methods is a class of algorithms that leverages compression in order to reduce the size of the tensor and potentially parallelize…

Machine Learning · Computer Science 2018-11-20 Georgios Tsitsikas , Evangelos E. Papalexakis

DeepTensor is a computationally efficient framework for low-rank decomposition of matrices and tensors using deep generative networks. We decompose a tensor as the product of low-rank tensor factors (e.g., a matrix as the outer product of…

It is well-known that tensor decompositions show separations, that is, that constraints on local terms (such as positivity) may entail an arbitrarily high cost in their representation. Here we show that many of these separations disappear…

Optimization and Control · Mathematics 2021-09-03 Gemma De las Cuevas , Andreas Klingler , Tim Netzer

Tensor completion can estimate missing values of a high-order data from its partially observed entries. Recent works show that low rank tensor ring approximation is one of the most powerful tools to solve tensor completion problem. However,…

Numerical Analysis · Mathematics 2021-01-03 Abdul Ahad , Zhen Long , Ce Zhu , Yipeng Liu

Low-rank tensor estimation offers a powerful approach to addressing high-dimensional data challenges and can substantially improve solutions to ill-posed inverse problems, such as image reconstruction under noisy or undersampled conditions.…

Machine Learning · Computer Science 2025-02-06 Anh Van Nguyen , Diego Klabjan , Minseok Ryu , Kibaek Kim , Zichao Di

In this paper, we propose a novel tensor learning and coding model for third-order data completion. Our model is to learn a data-adaptive dictionary from the given observations, and determine the coding coefficients of third-order tensor…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Tai-Xiang Jiang , Xi-Le Zhao , Hao Zhang , Michael K. Ng