English
Related papers

Related papers: Finding tensor decompositions with sparse optimiza…

200 papers

We give a new approach to the dictionary learning (also known as "sparse coding") problem of recovering an unknown $n\times m$ matrix $A$ (for $m \geq n$) from examples of the form \[ y = Ax + e, \] where $x$ is a random vector in $\mathbb…

Data Structures and Algorithms · Computer Science 2014-11-11 Boaz Barak , Jonathan A. Kelner , David Steurer

The prevalent fully-connected tensor network (FCTN) has achieved excellent success to compress data. However, the FCTN decomposition suffers from slow computational speed when facing higher-order and large-scale data. Naturally, there…

Machine Learning · Computer Science 2022-10-20 Peilin Yang , Weijun Sun , Qibin Zhao , Guoxu Zhou

We develop fast spectral algorithms for tensor decomposition that match the robustness guarantees of the best known polynomial-time algorithms for this problem based on the sum-of-squares (SOS) semidefinite programming hierarchy. Our…

Machine Learning · Computer Science 2017-06-28 Tselil Schramm , David Steurer

Quantum computing and modern tensor-based computing have a strong connection, which is especially demonstrated by simulating quantum computations with tensor networks. The other direction is less studied: quantum computing is not often…

Quantum Physics · Physics 2025-09-03 Valter Uotila

We show that finding rank-$R$ decompositions of a 3D tensor, for $R\le 4$, over a fixed finite field can be done in polynomial time. However, if some cells in the tensor are allowed to have arbitrary values, then rank-2 is NP-hard over the…

Computational Complexity · Computer Science 2024-04-18 Jason Yang

Tensor methods have emerged as a powerful paradigm for consistent learning of many latent variable models such as topic models, independent component analysis and dictionary learning. Model parameters are estimated via CP decomposition of…

Machine Learning · Computer Science 2015-06-22 Furong Huang , Animashree Anandkumar

This paper introduces matrix product state (MPS) decomposition as a new and systematic method to compress multidimensional data represented by higher-order tensors. It solves two major bottlenecks in tensor compression: computation and…

Machine Learning · Statistics 2017-08-02 Johann A. Bengua , Ho N. Phien , Hoang D. Tuan , Minh N. Do

This paper studies the copositive optimization problem whose objective is a sparse polynomial, with linear constraints over the nonnegative orthant. We propose sparse Moment-SOS relaxations to solve it. Necessary and sufficient conditions…

Optimization and Control · Mathematics 2026-04-02 Suhan Zhong , Jinling Zhou , Jiawang Nie , Xindong Tang

This paper introduces matrix product state (MPS) decomposition as a computational tool for extracting features of multidimensional data represented by higher-order tensors. Regardless of tensor order, MPS extracts its relevant features to…

Computer Vision and Pattern Recognition · Computer Science 2016-01-22 Johann A. Bengua , Ho N. Phien , Hoang D. Tuan , Minh N. Do

Modeling inverse dynamics is crucial for accurate feedforward robot control. The model computes the necessary joint torques, to perform a desired movement. The highly non-linear inverse function of the dynamical system can be approximated…

Machine Learning · Computer Science 2017-11-15 Stephan Baier , Volker Tresp

We introduce a new, quadratically convergent algorithm for finding maximum absolute value entries of tensors represented in the canonical format. The computational complexity of the algorithm is linear in the dimension of the tensor. We…

Numerical Analysis · Mathematics 2017-09-13 Matthew J Reynolds , Gregory Beylkin , Alireza Doostan

The tensor rank decomposition is a useful tool for the geometric interpretation of the tensors in the canonical tensor model (CTM) of quantum gravity. In order to understand the stability of this interpretation, it is important to be able…

General Relativity and Quantum Cosmology · Physics 2021-07-22 Dennis Obster , Naoki Sasakura

Over recent years it has become well accepted that user interest is not static or immutable. There are a variety of contextual factors, such as time of day, the weather or the user's mood, that influence the current interests of the user.…

Information Retrieval · Computer Science 2025-04-15 Joey De Pauw , Bart Goethals

Symmetric tensor decomposition is an important problem with applications in several areas for example signal processing, statistics, data analysis and computational neuroscience. It is equivalent to Waring's problem for homogeneous…

Symbolic Computation · Computer Science 2019-09-12 Matías Bender , Jean-Charles Faugère , Ludovic Perret , Elias Tsigaridas

Sparse and low rank tensor recovery has emerged as a significant area of research with applications in many fields such as computer vision. However, minimizing the $\ell_0$-norm of a vector or the rank of a matrix is NP-hard. Instead, their…

Optimization and Control · Mathematics 2024-04-23 Katherine Henneberger , Jing Qin

An increasing number of data science and machine learning problems rely on computation with tensors, which better capture the multi-way relationships and interactions of data than matrices. When tapping into this critical advantage, a key…

Machine Learning · Statistics 2023-02-23 Harry Dong , Tian Tong , Cong Ma , Yuejie Chi

The decomposition locus of a tensor is the set of rank-one tensors appearing in a minimal tensor-rank decomposition of the tensor. For tensors lying on the tangential variety of any Segre variety, but not on the variety itself, we show that…

Algebraic Geometry · Mathematics 2024-07-26 Alessandra Bernardi , Alessandro Oneto , Pierpaola Santarsiero

Information is extracted from large and sparse data sets organized as 3-mode tensors. Two methods are described, based on best rank-(2,2,2) and rank-(2,2,1) approximation of the tensor. The first method can be considered as a generalization…

Numerical Analysis · Mathematics 2021-02-09 L. Eldén , Maryam Dehghan

To ensure interpretability of extracted sources in tensor decomposition, we introduce in this paper a dictionary-based tensor canonical polyadic decomposition which enforces one factor to belong exactly to a known dictionary. A new…

Machine Learning · Statistics 2018-03-13 Jérémy E. Cohen , Nicolas Gillis

In the realm of tensor optimization, the low-rank Tucker decomposition is crucial for reducing the number of parameters and for saving storage. We explore the geometry of Tucker tensor varieties -- the set of tensors with bounded Tucker…

Optimization and Control · Mathematics 2024-07-16 Bin Gao , Renfeng Peng , Ya-xiang Yuan