English
Related papers

Related papers: Almost-lossless compression of a low-rank random t…

200 papers

In this note, we prove a central limit theorem for smooth linear statistics of zeros of random polynomials which are linear combinations of orthogonal polynomials with iid standard complex Gaussian coefficients. Along the way, we obtain…

Complex Variables · Mathematics 2017-05-23 Turgay Bayraktar

To ensure interpretability of extracted sources in tensor decomposition, we introduce in this paper a dictionary-based tensor canonical polyadic decomposition which enforces one factor to belong exactly to a known dictionary. A new…

Machine Learning · Statistics 2018-03-13 Jérémy E. Cohen , Nicolas Gillis

This paper addresses the detection of a low rank high-dimensional tensor corrupted by an additive complex Gaussian noise. In the asymptotic regime where all the dimensions of the tensor converge towards $+\infty$ at the same rate, existing…

Signal Processing · Electrical Eng. & Systems 2018-02-21 Antoine Chevreuil , Philippe Loubaton

The Canonical Polyadic decomposition (CPD) is a convenient and intuitive tool for tensor factorization; however, for higher-order tensors, it often exhibits high computational cost and permutation of tensor entries, these undesirable…

Numerical Analysis · Computer Science 2018-09-05 Anh-Huy Phan , Andrzej Cichocki , Ivan Oseledets , Salman Ahmadi Asl , Giuseppe Calvi , Danilo Mandic

It is well-known that tensor decompositions show separations, that is, that constraints on local terms (such as positivity) may entail an arbitrarily high cost in their representation. Here we show that many of these separations disappear…

Optimization and Control · Mathematics 2021-09-03 Gemma De las Cuevas , Andreas Klingler , Tim Netzer

Symmetric tensor decomposition is an important problem with applications in several areas for example signal processing, statistics, data analysis and computational neuroscience. It is equivalent to Waring's problem for homogeneous…

Symbolic Computation · Computer Science 2019-09-12 Matías Bender , Jean-Charles Faugère , Ludovic Perret , Elias Tsigaridas

Canonical Polyadic Decomposition (CPD) represents a third-order tensor as the minimal sum of rank-1 terms. Because of its uniqueness properties the CPD has found many concrete applications in telecommunication, array processing, machine…

Spectral Theory · Mathematics 2019-12-06 Ignat Domanov , Lieven De Lathauwer

Canonical Polyadic (CP) tensor decomposition is a fundamental technique for analyzing high-dimensional tensor data. While the Alternating Least Squares (ALS) algorithm is widely used for computing CP decomposition due to its simplicity and…

Methodology · Statistics 2025-05-30 Runshi Tang , Julien Chhor , Olga Klopp , Anru R. Zhang

We present a simple proof that finding a rank-$R$ canonical polyadic decomposition of a 3-dimensional tensor over a finite field $\mathbb{F}$ is fixed-parameter tractable with respect to $R$ and $\mathbb{F}$. We also show a nontrivial upper…

Computational Complexity · Computer Science 2024-06-18 Jason Yang

Wu and Verd\'u developed a theory of almost lossless analog compression, where one imposes various regularity conditions on the compressor and the decompressor with the input signal being modelled by a (typically infinite-entropy)…

Dynamical Systems · Mathematics 2022-12-29 Yonatan Gutman , Adam Śpiewak

We establish the fundamental limits of lossless analog compression by considering the recovery of arbitrary m-dimensional real random vectors x from the noiseless linear measurements y=Ax with n x m measurement matrix A. Our theory is…

Functional Analysis · Mathematics 2024-10-03 Giovanni Alberti , Helmut Bölcskei , Camillo De Lellis , Günther Koliander , Erwin Riegler

In the present work, we present a new discrete logarithm algorithm, in the same vein as in recent works by Joux, using an asymptotically more efficient descent approach. The main result gives a quasi-polynomial heuristic complexity for the…

Cryptography and Security · Computer Science 2013-11-27 Razvan Barbulescu , Pierrick Gaudry , Antoine Joux , Emmanuel Thomé

Tensor decomposition is a fundamental unsupervised machine learning method in data science, with applications including network analysis and sensor data processing. This work develops a generalized canonical polyadic (GCP) low-rank tensor…

Numerical Analysis · Mathematics 2020-07-09 David Hong , Tamara G. Kolda , Jed A. Duersch

In this paper, a numerical method is proposed for canonical polyadic (CP) decomposition of small size tensors. The focus is primarily on decomposition of tensors that correspond to small matrix multiplications. Here, rank of the tensors is…

Numerical Analysis · Mathematics 2016-03-07 Petr Tichavsky , Anh Huy Phan , Andrzej Cichocki

In connection with recent work on gaps in the asymptotic subranks of complex tensors the question arose whether the number of nonnegative real numbers that arise as the asymptotic subrank of some complex tensor is countable. In this short…

Algebraic Geometry · Mathematics 2022-12-26 Andreas Blatter , Jan Draisma , Filip Rupniewski

Unlike the matrix case, computing low-rank approximations of tensors is NP-hard and numerically ill-posed in general. Even the best rank-1 approximation of a tensor is NP-hard. In this paper, we use convex optimization to develop…

Statistics Theory · Mathematics 2016-09-14 Anil Aswani

Most state of the art deep neural networks are overparameterized and exhibit a high computational cost. A straightforward approach to this problem is to replace convolutional kernels with its low-rank tensor approximations, whereas the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Anh-Huy Phan , Konstantin Sobolev , Konstantin Sozykin , Dmitry Ermilov , Julia Gusak , Petr Tichavsky , Valeriy Glukhov , Ivan Oseledets , Andrzej Cichocki

Effective non-parametric density estimation is a key challenge in high-dimensional multivariate data analysis. In this paper,we propose a novel approach that builds upon tensor factorization tools. Any multivariate density can be…

Machine Learning · Statistics 2022-10-19 Magda Amiridi , Nikos Kargas , Nicholas D. Sidiropoulos

We establish some asymptotic expansions for infinite weighted convolutions of distributions having light subexponential tails. Examples are presented, some showing that in order to obtain an expansion with two significant terms, one needs…

Probability · Mathematics 2007-06-13 Ph. Barbe , W. P. McCormick

We introduce a new asymptotic one-sided and symmetric tensor norm, the latter of which can be considered as the minimal tensor norm on the category of separable C*-algebras with homotopy classes of asymptotic homomorphisms as morphisms. We…

Operator Algebras · Mathematics 2007-05-23 V. Manuilov , K. Thomsen