English
Related papers

Related papers: Polynomial-time Tensor Decompositions with Sum-of-…

200 papers

Tensor decompositions are promising tools for big data analytics as they bring multiple modes and aspects of data to a unified framework, which allows us to discover complex internal structures and correlations of data. Unfortunately most…

Numerical Analysis · Computer Science 2014-12-30 Guoxu Zhou , Andrzej Cichocki , Shengli Xie

This work considers a computationally and statistically efficient parameter estimation method for a wide class of latent variable models---including Gaussian mixture models, hidden Markov models, and latent Dirichlet allocation---which…

Machine Learning · Computer Science 2014-11-17 Anima Anandkumar , Rong Ge , Daniel Hsu , Sham M. Kakade , Matus Telgarsky

We consider the problem of learning high dimensional polynomial transformations of Gaussians. Given samples of the form $p(x)$, where $x\sim N(0, \mathrm{Id}_r)$ is hidden and $p: \mathbb{R}^r \to \mathbb{R}^d$ is a function where every…

Machine Learning · Computer Science 2022-04-11 Sitan Chen , Jerry Li , Yuanzhi Li , Anru R. Zhang

The dynamics of many systems from physics, economics, chemistry, and biology can be modelled through polynomial functions. In this paper, we provide a computational means to find positively invariant sets of polynomial dynamical systems by…

Dynamical Systems · Mathematics 2022-08-25 Elias August , Mauricio Barahona

We consider a separation problem where the observation consists of the sum of a high amplitude smooth signal and a low amplitude transient signal. We propose a method for decomposition that relies on solving instances of a `constrained…

Signal Processing · Electrical Eng. & Systems 2020-07-15 Ilker Bayram

We provide a computational framework for approximating a class of structured matrices; here, the term structure is very general, and may refer to a regular sparsity pattern (e.g., block-banded), or be more highly structured (e.g., symmetric…

Numerical Analysis · Mathematics 2021-05-05 Misha E. Kilmer , Arvind K. Saibaba

This work studies the combinatorial optimization problem of finding an optimal core tensor shape, also called multilinear rank, for a size-constrained Tucker decomposition. We give an algorithm with provable approximation guarantees for its…

Data Structures and Algorithms · Computer Science 2024-06-19 Mehrdad Ghadiri , Matthew Fahrbach , Gang Fu , Vahab Mirrokni

In this work, we consider the optimization formulation for symmetric tensor decomposition recently introduced in the Subspace Power Method (SPM) of Kileel and Pereira. Unlike popular alternative functionals for tensor decomposition, the SPM…

Optimization and Control · Mathematics 2021-11-01 Joe Kileel , Timo Klock , João M. Pereira

In polynomial optimization problems, nonnegativity constraints are typically handled using the sum of squares condition. This can be efficiently enforced using semidefinite programming formulations, or as more recently proposed by Papp and…

Optimization and Control · Mathematics 2022-06-14 Lea Kapelevich , Chris Coey , Juan Pablo Vielma

We consider the problem of solving mixed random linear equations with $k$ components. This is the noiseless setting of mixed linear regression. The goal is to estimate multiple linear models from mixed samples in the case where the labels…

Machine Learning · Computer Science 2016-08-23 Xinyang Yi , Constantine Caramanis , Sujay Sanghavi

We propose a general method for optimization with semi-infinite constraints that involve a linear combination of functions, focusing on the case of the exponential function. Each function is lower and upper bounded on sub-intervals by…

Optimization and Control · Mathematics 2014-01-13 Bogdan Dumitrescu , Bogdan C. Sicleru , Florin Avram

It is well-known that every non-negative univariate real polynomial can be written as the sum of two polynomial squares with real coefficients. When one allows a weighted sum of finitely many squares instead of a sum of two squares, then…

Symbolic Computation · Computer Science 2017-06-14 Victor Magron , Mohab Safey El Din , Markus Schweighofer

We revisit two NP-hard geometric partitioning problems - convex decomposition and surface approximation. Building on recent developments in geometric separators, we present quasi-polynomial time algorithms for these problems with improved…

Computational Geometry · Computer Science 2014-04-16 Sayan Bandyapadhyay , Santanu Bhowmick , Kasturi Varadarajan

The widespread use of multi-sensor technology and the emergence of big datasets has highlighted the limitations of standard flat-view matrix models and the necessity to move towards more versatile data analysis tools. We show that…

Numerical Analysis · Computer Science 2015-06-19 A. Cichocki , D. Mandic , A-H. Phan , C. Caiafa , G. Zhou , Q. Zhao , L. De Lathauwer

We present two new algorithms for the computation of the q-integer linear decomposition of a multivariate polynomial. Such a decomposition is essential for the treatment of q-hypergeometric symbolic summation via creative telescoping and…

Symbolic Computation · Computer Science 2021-02-15 Mark Giesbrecht , Hui Huang , George Labahn , Eugene Zima

We focus on two central themes in this dissertation. The first one is on decomposing polytopes and polynomials in ways that allow us to perform nonlinear optimization. We start off by explaining important results on decomposing a polytope…

Combinatorics · Mathematics 2016-05-18 Brandon Dutra

We consider the unconstrained optimization of multivariate trigonometric polynomials by the sum-of-squares hierarchy of lower bounds. We first show a convergence rate of $O(1/s^2)$ for the relaxation with degree $s$ without any assumption…

Optimization and Control · Mathematics 2023-04-19 Francis Bach , Alessandro Rudi

We give a new, constructive uniqueness theorem for tensor decomposition. It applies to order 3 tensors of format $n \times n \times p$ and can prove uniqueness of decomposition for generic tensors up to rank $r=4n/3$ as soon as $p \geq 4$.…

Data Structures and Algorithms · Computer Science 2025-02-12 Pascal Koiran

We bound the tensor ranks of elementary symmetric polynomials, and we give explicit decompositions into powers of linear forms. The bound is attained when the degree is odd.

Algebraic Geometry · Mathematics 2015-08-24 Hwangrae Lee

The CANDECOMP/PARAFAC (CP) decomposition is a leading method for the analysis of multiway data. The standard alternating least squares algorithm for the CP decomposition (CP-ALS) involves a series of highly overdetermined linear least…

Numerical Analysis · Computer Science 2018-08-23 Casey Battaglino , Grey Ballard , Tamara G. Kolda