English
Related papers

Related papers: A new Algorithm for Overcomplete Tensor Decomposit…

200 papers

We study the symmetric outer product decomposition which decomposes a fully (partially) symmetric tensor into a sum of rank-one fully (partially) symmetric tensors. We present iterative algorithms for the third-order partially symmetric…

Numerical Analysis · Mathematics 2013-12-31 Na Li , Carmeliza Navasca

High-order tensor methods that employ Taylor-based local models (of degree $p\ge 3$) within adaptive regularization frameworks have been recently proposed for both convex and nonconvex optimization problems. They have been shown to have…

Optimization and Control · Mathematics 2024-04-19 Wenqi Zhu , Coralia Cartis

It is well-known that every non-negative univariate real polynomial can be written as the sum of two polynomial squares with real coefficients. When one allows a weighted sum of finitely many squares instead of a sum of two squares, then…

Symbolic Computation · Computer Science 2017-06-14 Victor Magron , Mohab Safey El Din , Markus Schweighofer

Motivated by a connection with the factorization of multivariate polynomials, we study integral convex polytopes and their integral decompositions in the sense of the Minkowski sum. We first show that deciding decomposability of integral…

Combinatorics · Mathematics 2007-05-23 S. Gao , A. G. B. Lauder

In this survey we consider polynomial optimization problems, asking to minimize a polynomial function over a compact semialgebraic set, defined by polynomial inequalities. This models a great variety of (in general, nonlinear nonconvex)…

Optimization and Control · Mathematics 2025-01-16 Monique Laurent , Lucas Slot

We consider simultaneous Waring decompositions: Given forms $ f_d $ of degrees $ kd $, $ (d = 2,3 )$, which admit a representation as $ d $-th power sums of $ k $-forms $ q_1,\ldots,q_m $, when is it possible to reconstruct the addends $…

Algebraic Geometry · Mathematics 2023-05-12 Alexander Taveira Blomenhofer

We consider two problems that arise in machine learning applications: the problem of recovering a planted sparse vector in a random linear subspace and the problem of decomposing a random low-rank overcomplete 3-tensor. For both problems,…

Data Structures and Algorithms · Computer Science 2016-02-04 Samuel B. Hopkins , Tselil Schramm , Jonathan Shi , David Steurer

The popular Alternating Least Squares (ALS) algorithm for tensor decomposition is efficient and easy to implement, but often converges to poor local optima---particularly when the weights of the factors are non-uniform. We propose a…

Machine Learning · Computer Science 2017-09-26 Vatsal Sharan , Gregory Valiant

We study sum of squares (SOS) relaxations to optimize polynomial functions over a set $V\cap R^n$, where $V$ is a complex algebraic variety. We propose a new methodology that, rather than relying on some algebraic description, represents…

Optimization and Control · Mathematics 2017-11-21 Diego Cifuentes , Pablo A. Parrilo

We propose a constructive algorithm that decomposes an arbitrary real tensor into a finite sum of orthonormal rank-1 outer products. The algorithm, named TTr1SVD, works by converting the tensor into a tensor-train rank-1 (TTr1) series via…

Numerical Analysis · Mathematics 2015-06-26 Kim Batselier , Haotian Liu , Ngai Wong

Estimation is the computational task of recovering a hidden parameter $x$ associated with a distribution $D_x$, given a measurement $y$ sampled from the distribution. High dimensional estimation problems arise naturally in statistics,…

Data Structures and Algorithms · Computer Science 2019-08-07 Prasad Raghavendra , Tselil Schramm , David Steurer

Motivated by applications in robotics and computer vision, we study problems related to spatial reasoning of a 3D environment using sublevel sets of polynomials. These include: tightly containing a cloud of points (e.g., representing an…

Optimization and Control · Mathematics 2017-03-09 Amir Ali Ahmadi , Georgina Hall , Ameesh Makadia , Vikas Sindhwani

We investigate the representation of symmetric polynomials as a sum of squares. Since this task is solved using semidefinite programming tools we explore the geometric, algebraic, and computational implications of the presence of discrete…

Commutative Algebra · Mathematics 2007-05-23 Karin Gatermann , Pablo A. Parrilo

It is well-known that any sum of squares (SOS) program can be cast as a semidefinite program (SDP) of a particular structure and that therein lies the computational bottleneck for SOS programs, as the SDPs generated by this procedure are…

Optimization and Control · Mathematics 2017-10-05 Amir Ali Ahmadi , Georgina Hall , Antonis Papachristodoulou , James Saunderson , Yang Zheng

We propose an iterative algorithm for the numerical computation of sums of squares of polynomials approximating given data at prescribed interpolation points. The method is based on the definition of a convex functional $G$ arising from the…

Optimization and Control · Mathematics 2020-03-17 Bruno Després , Maxime Herda

This chapter studies the problem of decomposing a tensor into a sum of constituent rank one tensors. While tensor decompositions are very useful in designing learning algorithms and data analysis, they are NP-hard in the worst-case. We will…

Data Structures and Algorithms · Computer Science 2020-07-31 Aravindan Vijayaraghavan

The problem of writing a totally positive element as a sum of squares has a long history in mathematics, going back to Bachet and Lagrange. While for some specific rings (like integers or polynomials over the rationals), there are known…

Number Theory · Mathematics 2021-11-17 Przemysław Koprowski

A Waring decomposition of a (homogeneous) polynomial f is a minimal sum of powers of linear forms expressing f. Under certain conditions, such a decomposition is unique. We discuss some algorithms to compute the Waring decomposition, which…

Algebraic Geometry · Mathematics 2025-10-16 Luke Oeding , Giorgio Ottaviani

The Sum-of-Squares (SOS) approximation method is a technique used in optimization problems to derive lower bounds on the optimal value of an objective function. By representing the objective function as a sum of squares in a feature space,…

Optimization and Control · Mathematics 2024-03-12 Francis Bach , Elisabetta Cornacchia , Luca Pesce , Giovanni Piccioli

We present a hierarchy of semidefinite programs (SDPs) for the problem of fitting a shape-constrained (multivariate) polynomial to noisy evaluations of an unknown shape-constrained function. These shape constraints include convexity or…

Optimization and Control · Mathematics 2022-10-31 Mihaela Curmei , Georgina Hall