English
Related papers

Related papers: General Tensor Decomposition, Moment Matrices and …

200 papers

Tucker decomposition is a common method for the analysis of multi-way/tensor data. Standard Tucker has been shown to be sensitive against heavy corruptions, due to its L2-norm-based formulation which places squared emphasis to peripheral…

Numerical Analysis · Computer Science 2019-04-16 Dimitris G. Chachlakis , Ashley Prater-Bennette , Panos P. Markopoulos

In this paper we propose novel methods for compression and recovery of multilinear data under limited sampling. We exploit the recently proposed tensor- Singular Value Decomposition (t-SVD)[1], which is a group theoretic framework for…

Information Theory · Computer Science 2013-11-01 Zemin Zhang , Gregory Ely , Shuchin Aeron , Ning Hao , Misha Kilmer

We propose a theory of eigenvalues, eigenvectors, singular values, and singular vectors for tensors based on a constrained variational approach much like the Rayleigh quotient for symmetric matrix eigenvalues. These notions are particularly…

Spectral Theory · Mathematics 2007-05-23 Lek-Heng Lim

We propose a new algorithm for tensor decomposition, based on Jennrich's algorithm, and apply our new algorithmic ideas to blind deconvolution and Gaussian mixture models. Our first contribution is a simple and efficient algorithm to…

Machine Learning · Computer Science 2021-02-23 Haolin Chen , Luis Rademacher

We consider the problem of automatically decomposing operations over tensors or arrays so that they can be executed in parallel on multiple devices. We address two, closely-linked questions. First, what programming abstraction should…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-04 Daniel Bourgeois , Zhimin Ding , Dimitrije Jankov , Jiehui Li , Mahmoud Sleem , Yuxin Tang , Jiawen Yao , Xinyu Yao , Chris Jermaine

We define lower triangular tensors, and show that all diagonal entries of such a tensor are eigenvalues of that tensor. We then define lower triangular sub-symmetric tensors, and show that the number of independent entries of a lower…

Rings and Algebras · Mathematics 2024-12-24 Liqun Qi , Chunfeng Cui , Ziyan Luo

Tensor decomposition is a well-known tool for multiway data analysis. This work proposes using stochastic gradients for efficient generalized canonical polyadic (GCP) tensor decomposition of large-scale tensors. GCP tensor decomposition is…

Numerical Analysis · Mathematics 2020-11-25 Tamara G. Kolda , David Hong

This paper introduces matrix product state (MPS) decomposition as a computational tool for extracting features of multidimensional data represented by higher-order tensors. Regardless of tensor order, MPS extracts its relevant features to…

Computer Vision and Pattern Recognition · Computer Science 2016-01-22 Johann A. Bengua , Ho N. Phien , Hoang D. Tuan , Minh N. Do

We propose a novel matrix regularization for tensor fields. In this regularization, tensor fields are described as rectangular matrices and both area-preserving diffeomorphisms and local rotations of the orthonormal frame are realized as…

High Energy Physics - Theory · Physics 2022-11-08 Hiroyuki Adachi , Goro Ishiki , Satoshi Kanno , Takaki Matsumoto

By representing documents as mixtures of topics, topic modeling has allowed the successful analysis of datasets across a wide spectrum of applications ranging from ecology to genetics. An important body of recent work has demonstrated the…

Statistics Theory · Mathematics 2025-01-03 Yating Liu , Claire Donnat

Tensor networks have in recent years emerged as the powerful tools for solving the large-scale optimization problems. One of the most popular tensor network is tensor train (TT) decomposition that acts as the building blocks for the…

Numerical Analysis · Computer Science 2016-06-20 Qibin Zhao , Guoxu Zhou , Shengli Xie , Liqing Zhang , Andrzej Cichocki

We characterize some variations of pseudoskeleton (also called CUR) decompositions for matrices and tensors over arbitrary fields. These characterizations extend previous results to arbitrary fields and to decompositions which use…

Numerical Analysis · Mathematics 2022-07-01 Keaton Hamm

In this paper we suggest a new algorithm for the computation of a best rank one approximation of tensors, called alternating singular value decomposition. This method is based on the computation of maximal singular values and the…

Numerical Analysis · Mathematics 2015-03-19 S. Friedland , V. Mehrmann , R. Pajarola , S. K. Suter

Decoupling multivariate polynomials is useful for obtaining an insight into the workings of a nonlinear mapping, performing parameter reduction, or approximating nonlinear functions. Several different tensor-based approaches have been…

Numerical Analysis · Mathematics 2019-01-31 Konstantin Usevich , Philippe Dreesen , Mariya Ishteva

Tensor network decompositions offer an efficient description of certain many-body states of a lattice system and are the basis of a wealth of numerical simulation algorithms. In a recent paper [arXiv:0907.2994v1] we discussed how to…

Strongly Correlated Electrons · Physics 2011-06-01 Sukhwinder Singh , Robert N. C. Pfeifer , Guifre Vidal

Tensor completion and tensor decomposition are important problems in many domains. In this work, we leverage the connection between these problems to learn a distance metric that improves both decomposition and completion. We show that the…

Optimization and Control · Mathematics 2022-09-02 Maryam Bagherian , Davoud A. Tarzanagh , Ivo Dinov , Joshua D. Welch

A generalized covariant method of analysis applicable to frames for which time is not orthogonal to space, such as spacetime around a star possessing angular momentum or on a rotating disk, is presented. Important aspects of such an…

General Relativity and Quantum Cosmology · Physics 2007-05-23 Robert D. Klauber

By a tensor we mean an element of a tensor product of vector spaces over a field. Up to a choice of bases in factors of tensor products, every tensor may be coordinatized, that is, represented as an array consisting of numbers. This note is…

Functional Analysis · Mathematics 2019-01-11 R. N. Gumerov , A. S. Sharafutdinov

Most state of the art deep neural networks are overparameterized and exhibit a high computational cost. A straightforward approach to this problem is to replace convolutional kernels with its low-rank tensor approximations, whereas the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Anh-Huy Phan , Konstantin Sobolev , Konstantin Sozykin , Dmitry Ermilov , Julia Gusak , Petr Tichavsky , Valeriy Glukhov , Ivan Oseledets , Andrzej Cichocki

Tensors or {\em multi-way arrays} are functions of three or more indices $(i,j,k,\cdots)$ -- similar to matrices (two-way arrays), which are functions of two indices $(r,c)$ for (row,column). Tensors have a rich history, stretching over…