English
Related papers

Related papers: Numerical Optimization for Symmetric Tensor Decomp…

200 papers

Tensor decomposition methods are popular tools for learning latent variables given only lower-order moments of the data. However, the standard assumption is that we have sufficient data to estimate these moments to high accuracy. In this…

Machine Learning · Statistics 2019-03-13 Omer Gottesman , Weiwei Pan , Finale Doshi-Velez

Tensor network decompositions offer an efficient description of certain many-body states of a lattice system and are the basis of a wealth of numerical simulation algorithms. In a recent paper [arXiv:0907.2994v1] we discussed how to…

Strongly Correlated Electrons · Physics 2011-06-01 Sukhwinder Singh , Robert N. C. Pfeifer , Guifre Vidal

Tensor train (TT) decomposition is a powerful representation for high-order tensors, which has been successfully applied to various machine learning tasks in recent years. However, since the tensor product is not commutative, permutation of…

Numerical Analysis · Computer Science 2017-05-31 Qibin Zhao , Masashi Sugiyama , Andrzej Cichocki

Low-rank tensors appear to be prosperous in many applications. However, the sets of bounded-rank tensors are non-smooth and non-convex algebraic varieties, rendering the low-rank optimization problems to be challenging. To this end, we…

Optimization and Control · Mathematics 2024-11-22 Bin Gao , Renfeng Peng , Ya-xiang Yuan

We introduce the ``skew apolarity lemma'' and we use it to give algorithms for the skew-symmetric rank and the decompositions of tensors in {$\bigwedge^dV_{\mathbb{C}}$ with $d\leq 3$ and $\dim V_{\mathbb{C}} \leq 8$}. New algorithms to…

Algebraic Geometry · Mathematics 2019-08-08 Enrique Arrondo , Alessandra Bernardi , Pedro Macias Marques , Bernard Mourrain

In this paper, we first introduce the invertibility of even-order tensors and the separable tensors, including separable symmetry tensors and separable anti-symmetry tensors, defined respectively as the sum and the algebraic sum of rank-1…

Algebraic Geometry · Mathematics 2022-03-25 Changqing Xu

We study the symmetric tensor rank of multiplication over finite field extensions using linearized polynomials. Via field trace, symmetric linearized polynomials are identified with symmetric bilinear forms and symmetric matrices, allowing…

Combinatorics · Mathematics 2026-05-13 Giuseppe Cotardo , Ferdinando Zullo

Many combinatorial problems can be formulated as a polynomial optimization problem that can be solved by state-of-the-art methods in real algebraic geometry. In this paper we explain many important methods from real algebraic geometry, we…

Combinatorics · Mathematics 2014-11-11 Erik Sjöland

We consider the problem of factorizing a structured 3-way tensor into its constituent Canonical Polyadic (CP) factors. This decomposition, which can be viewed as a generalization of singular value decomposition (SVD) for tensors, reveals…

Machine Learning · Computer Science 2020-07-01 Sirisha Rambhatla , Xingguo Li , Jarvis Haupt

We propose a sampling-based method for computing the tensor ring (TR) decomposition of a data tensor. The method uses leverage score sampled alternating least squares to fit the TR cores in an iterative fashion. By taking advantage of the…

Numerical Analysis · Mathematics 2021-07-12 Osman Asif Malik , Stephen Becker

Inspired by some problems in Quantum Information Theory, we present some results concerning decompositions of positive operators acting on finite dimensional Hilbert spaces. We focus on decompositions by families having geometrical symmetry…

Functional Analysis · Mathematics 2017-03-23 Maria Anastasia Jivulescu , Ion Nechita , Pasc Gavruta

We propose a new method for computing the eigenvalue decomposition of a dense real normal matrix $A$ through the decomposition of its skew-symmetric part. The method relies on algorithms that are known to be efficiently implemented, such as…

Numerical Analysis · Mathematics 2026-03-31 Simon Mataigne , Kyle A. Gallivan

Spectral decomposition of matrices is a recurring and important task in applied mathematics, physics and engineering. Many application problems require the consideration of matrices of size three with spectral decomposition over the real…

Numerical Analysis · Mathematics 2021-11-04 Michal Habera , Andreas Zilian

Decompositions of tensors into factor matrices, which interact through a core tensor, have found numerous applications in signal processing and machine learning. A more general tensor model which represents data as an ordered network of…

Numerical Analysis · Computer Science 2016-09-30 Anh-Huy Phan , Andrzej Cichocki , Andre Uschmajew , Petr Tichavsky , George Luta , Danilo Mandic

This paper derives the CS decomposition for orthogonal tensors (T-CSD) and the generalized singular value decomposition for two tensors (T-GSVD) via the T-product. The structures of the two decompositions are analyzed in detail and are…

Numerical Analysis · Mathematics 2021-07-01 Yating Zhang , Xiaoxia Guo , Pengpeng Xie , Zhengbang Cao

We introduce a formal operational semantics that describes the fused execution of variable contraction problems, which compute indexed arithmetic over a semiring and generalize sparse and dense tensor algebra, relational algebra, and graph…

Programming Languages · Computer Science 2022-07-28 Scott Kovach , Fredrik Kjolstad

We first propose a concise singular value decomposition of dual matrices. Then, the randomized version of the decomposition is presented. It can significantly reduce the computational cost while maintaining the similar accuracy. We analyze…

Numerical Analysis · Mathematics 2024-07-25 Mengyu Wang , Jingchun Zhou , Hanyu Li

An $n \times n \times p$ tensor is called a T-square tensor. It arises from many applications, such as the image feature extraction problem and the multi-view clustering problem. We may symmetrize a T-square tensor to a T-symmetric tensor.…

Spectral Theory · Mathematics 2021-01-27 Liqun Qi , Xinzhen Zhang

Tensors are multidimensional arrays of numerical values and therefore generalize matrices to multiple dimensions. While tensors first emerged in the psychometrics community in the $20^{\text{th}}$ century, they have since then spread to…

Machine Learning · Statistics 2017-11-30 Stephan Rabanser , Oleksandr Shchur , Stephan Günnemann

This work studies the combinatorial optimization problem of finding an optimal core tensor shape, also called multilinear rank, for a size-constrained Tucker decomposition. We give an algorithm with provable approximation guarantees for its…

Data Structures and Algorithms · Computer Science 2024-06-19 Mehrdad Ghadiri , Matthew Fahrbach , Gang Fu , Vahab Mirrokni