Related papers: Block tensors and symmetric embeddings

In the tensor completion problem, one seeks to estimate a low-rank tensor based on a random sample of revealed entries. In terms of the required sample size, earlier work revealed a large gap between estimation with unbounded computational…

This paper proposes a new model for extracting an interpretable sentence embedding by introducing self-attention. Instead of using a vector, we use a 2-D matrix to represent the embedding, with each row of the matrix attending on a…

The benefits of exploiting the presence of symmetries in tensor network algorithms have been extensively demonstrated in the context of matrix product states (MPSs). These include the ability to select a specific symmetry sector (e.g. with…

Let n >= 1 and let p be a prime. Let t = 1 - zeta_{p^n}. Expand an integer j in [0,p^n-1], coprime to p, p-adically as j = sum_{s >= 0} a_s p^s. Denote the tensor product over Z_(p) by o . Then the #([0,j] - (p))th Z_(p)[t]-linear…

Embedded point spectra of rank one singular perturbations of an arbitrary self-adjoint operator A on a Hilbert space H is studied. It is shown that these perturbations can be regarded as self-adjoint extensions of a densely defined closed…

A tensor in applied mathematics is usually defined as a multidimensional array of numbers. This presumes a choice of basis in $\mathbb{R}^n$ or in some other vector space, and tensorial concepts are defined accordingly. In this article we…

Let $\sigma_b(X_{m,d}(\mathbb {C}))(\mathbb {R})$, $b(m+1) < \binom{m+d}{m}$, denote the set of all degree $d$ real homogeneous polynomials in $m+1$ variables (i.e. real symmetric tensors of format $(m+1)\times ... \times (m+1)$, $d$ times)…

This is an introductory survey, from a geometric perspective, on the Singular Value Decomposition (SVD) for real matrices, focusing on the role of the Terracini Lemma. We extend this point of view to tensors, we define the singular space of…

We give algorithms to compute decompositions of a given polynomial, or more generally mixed tensor, as sum of rank one tensors, and to establish whether such a decomposition is unique. In particular, we present methods to compute the…

A new approach to the algebraic classification of second order symmetric tensors in 5-dimensional space-times is presented. The possible Segre types for a symmetric two-tensor are found. A set of canonical forms for each Segre type is…

In this paper we study the identifiability of specific forms (symmetric tensors), with the target of extending recent methods for the case of $3$ variables to more general cases. In particular, we focus on forms of degree $4$ in $5$…

Multi-matrix invariants, and in particular the scalar multi-trace operators of $\mathcal{N}=4$ SYM with $U(N)$ gauge symmetry, can be described using permutation centraliser algebras (PCA), which are generalisations of the symmetric group…

With the help of the Penrose-Ward transform, which relates certain holomorphic vector bundles over the supertwistor space to the equations of motion of self-dual SYM theory in four dimensions, we construct hidden infinite-dimensional…

We propose a constructive algorithm that decomposes an arbitrary real tensor into a finite sum of orthonormal rank-1 outer products. The algorithm, named TTr1SVD, works by converting the tensor into a tensor-train rank-1 (TTr1) series via…

We give reconstruction algorithms for subclasses of depth-3 arithmetic circuits. In particular, we obtain the first efficient algorithm for finding tensor rank, and an optimal tensor decomposition as a sum of rank-one tensors, when given…

We investigate how embedding dimension affects the emergence of an internal "world model" in a transformer trained with reinforcement learning to perform bubble-sort-style adjacent swaps. Models achieve high accuracy even with very small…

The spectral decomposition of a symmetric, second-order tensor is widely adopted in many fields of Computational Mechanics. As an example, in elasto-plasticity under large strain and rotations, given the Cauchy deformation tensor, it is a…

We provide examples of operators $T(D)+V$ with decaying potentials that have embedded eigenvalues. The decay of the potential depends on the curvature of the Fermi surfaces of constant kinetic energy $T$. We make the connection to…

Fix integers $m \ge 2$, $s\ge 5$ and $d\ge 2s+2$. Here we describe the possible symmetric tensor ranks $\le 2d+s-7$ of all symmetric tensors (or homogeneous degree $d$ polynomials) in $m+1$ variables with border rank $s$.

Since every even power of the Vandermonde determinant is a symmetric polynomial, we want to understand its decomposition in terms of the basis of Schur functions. We investigate several combinatorial properties of the coefficients in the…