English
Related papers

Related papers: Faster Robust Tensor Power Method for Arbitrary Or…

200 papers

We study symmetric tensor decompositions, i.e. decompositions of the input symmetric tensor T of order 3 as sum of r 3rd-order tensor powers of u_i where u_i are vectors in \C^n. In order to obtain efficient decomposition algorithms, it is…

Data Structures and Algorithms · Computer Science 2025-03-12 Pascal Koiran , Subhayan Saha

Tensor decompositions, which represent an $N$-order tensor using approximately $N$ factors of much smaller dimensions, can significantly reduce the number of parameters. This is particularly beneficial for high-order tensors, as the number…

Machine Learning · Computer Science 2025-06-23 Zhen Qin , Michael B. Wakin , Zhihui Zhu

Tucker decomposition is a common method for the analysis of multi-way/tensor data. Standard Tucker has been shown to be sensitive against heavy corruptions, due to its L2-norm-based formulation which places squared emphasis to peripheral…

Numerical Analysis · Computer Science 2019-04-16 Dimitris G. Chachlakis , Ashley Prater-Bennette , Panos P. Markopoulos

Nonnegative Tucker decomposition (NTD) is a powerful tool for the extraction of nonnegative parts-based and physically meaningful latent components from high-dimensional tensor data while preserving the natural multilinear structure of…

Machine Learning · Computer Science 2015-09-17 Guoxu Zhou , Andrzej Cichocki , Qibin Zhao , Shengli Xie

In this paper, we propose a new unified optimization algorithm for general tensor decomposition which is formulated as an inverse problem for low-rank tensors in the general linear observation models. The proposed algorithm supports three…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Manabu Mukai , Hidekata Hontani , Tatsuya Yokota

In this paper, we aim at the problem of tensor data completion. Tensor-train decomposition is adopted because of its powerful representation ability and linear scalability to tensor order. We propose an algorithm named Sparse Tensor-train…

Numerical Analysis · Computer Science 2018-03-23 Longhao Yuan , Qibin Zhao , Jianting Cao

Tensor decomposition is one of the well-known approaches to reduce the latency time and number of parameters of a pre-trained model. However, in this paper, we propose an approach to use tensor decomposition to reduce training time of…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Mostafa Elhoushi , Ye Henry Tian , Zihao Chen , Farhan Shafiq , Joey Yiwei Li

Modeling inverse dynamics is crucial for accurate feedforward robot control. The model computes the necessary joint torques, to perform a desired movement. The highly non-linear inverse function of the dynamical system can be approximated…

Machine Learning · Computer Science 2017-11-15 Stephan Baier , Volker Tresp

We give efficient algorithms for finding power-sum decomposition of an input polynomial $P(x)= \sum_{i\leq m} p_i(x)^d$ with component $p_i$s. The case of linear $p_i$s is equivalent to the well-studied tensor decomposition problem while…

Data Structures and Algorithms · Computer Science 2022-08-02 Mitali Bafna , Jun-Ting Hsieh , Pravesh K. Kothari , Jeff Xu

We consider to model matrix time series based on a tensor CP-decomposition. Instead of using an iterative algorithm which is the standard practice for estimating CP-decompositions, we propose a new and one-pass estimation procedure based on…

Methodology · Statistics 2023-11-15 Jinyuan Chang , Jing He , Lin Yang , Qiwei Yao

We present an iterative method for the search of extreme entries in low-rank tensors which is based on a power iteration combined with a binary search. In this work we use the HT-format for low-rank tensors but other low-rank formats can be…

Numerical Analysis · Mathematics 2019-12-11 Lars Grasedyck , Lukas Juschka , Christian Löbbert

Tensor ring (TR) decomposition is a simple but effective tensor network for analyzing and interpreting latent patterns of tensors. In this work, we propose a doubly randomized optimization framework for computing TR decomposition. It can be…

Numerical Analysis · Mathematics 2023-03-30 Yajie Yu , Hanyu Li , Jingchun Zhou

Tensor completion refers to the task of estimating the missing data from an incomplete measurement or observation, which is a core problem frequently arising from the areas of big data analysis, computer vision, and network engineering. Due…

Machine Learning · Computer Science 2021-05-21 Chenjian Pan , Chen Ling , Hongjin He , Liqun Qi , Yanwei Xu

Tensor diagonalization means transforming a given tensor to an exactly or nearly diagonal form through multiplying the tensor by non-orthogonal invertible matrices along selected dimensions of the tensor. It is generalization of approximate…

Numerical Analysis · Computer Science 2016-07-04 Petr Tichavsky , Anh Huy Phan , Andrzej Cichocki

This paper presents a convolution tensor decomposition based model reduction method for solving the Allen-Cahn equation. The Allen-Cahn equation is usually used to characterize phase separation or the motion of anti-phase boundaries in…

Numerical Analysis · Mathematics 2024-11-06 Ye Lu , Chaoqian Yuan , Han Guo

We consider $N$-way data arrays and low-rank tensor factorizations where the time mode is coded as a sparse linear combination of temporal elements from an over-complete library. Our method, Shape Constrained Tensor Decomposition (SCTD) is…

Machine Learning · Statistics 2016-08-17 Bethany Lusch , Eric C. Chi , J. Nathan Kutz

Many applications in data science and scientific computing involve large-scale datasets that are expensive to store and compute with, but can be efficiently compressed and stored in an appropriate tensor format. In recent years, randomized…

Numerical Analysis · Mathematics 2019-05-20 Rachel Minster , Arvind K. Saibaba , Misha E. Kilmer

We present an algorithm that computes the composition factors of the n-th tensor power of the free associative algebra on a vector space. The composition factors admit a description in terms of certain coefficients $c_{\lambda\mu}$…

Data Structures and Algorithms · Computer Science 2017-11-15 Amin Saied

We present a polynomial time algorithm to approximately scale tensors of any format to arbitrary prescribed marginals (whenever possible). This unifies and generalizes a sequence of past works on matrix, operator and tensor scaling. Our…

Data Structures and Algorithms · Computer Science 2020-03-10 Peter Bürgisser , Cole Franks , Ankit Garg , Rafael Oliveira , Michael Walter , Avi Wigderson

We present a stochastic optimization method that uses a fourth-order regularized model to find local minima of smooth and potentially non-convex objective functions with a finite-sum structure. This algorithm uses sub-sampled derivatives…

Optimization and Control · Mathematics 2023-07-18 Aurelien Lucchi , Jonas Kohler