English
Related papers

Related papers: Faster Robust Tensor Power Method for Arbitrary Or…

200 papers

Tensor data with rich structural information becomes increasingly important in process modeling, monitoring, and diagnosis. Here structural information is referred to structural properties such as sparsity, smoothness, low-rank, and…

Machine Learning · Statistics 2024-10-30 Shancong Mou , Andi Wang , Chuck Zhang , Jianjun Shi

Tensor Networks (TN) offer a powerful framework to efficiently represent very high-dimensional objects. TN have recently shown their potential for machine learning applications and offer a unifying view of common tensor decomposition models…

Machine Learning · Computer Science 2021-06-24 Meraj Hashemizadeh , Michelle Liu , Jacob Miller , Guillaume Rabusseau

Tucker decomposition is one of the most popular models for analyzing and compressing large-scale tensorial data. Existing Tucker decomposition algorithms usually rely on a single solver to compute the factor matrices and core tensor, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-21 Min Li , Chuanfu Xiao , Chao Yang

In autoregressive modeling for tensor-valued time series, Tucker decomposition, when applied to the coefficient tensor, provides a clear interpretation of supervised factor modeling but loses its efficiency rapidly with increasing tensor…

Methodology · Statistics 2025-06-03 Yuxi Cai , Lan Li , Yize Wang , Guodong Li

The power method is one of the most fundamental tools for extracting top principal components from data through low-rank matrix approximation. Yet, when the target rank is large, the cost of matrix multiplication associated with this…

Numerical Analysis · Mathematics 2026-05-12 Shabarish Chenakkod , Michał Dereziński

Tensor networks provide a powerful framework for compressing multi-dimensional data. The optimal tensor network structure for a given data tensor depends on both data characteristics and specific optimality criteria, making tensor network…

Computational Engineering, Finance, and Science · Computer Science 2026-03-23 Zheng Guo , Aditya Deshpande , Brian Kiedrowski , Xinyu Wang , Alex Gorodetsky

Many recent tensor network algorithms apply unitary operators to parts of a tensor network in order to reduce entanglement. However, many of the previously used iterative algorithms to minimize entanglement can be slow. We introduce an…

Quantum Physics · Physics 2022-01-25 Kevin Slagle

We propose a strategy to compress and store large volumes of scientific data represented on unstructured grids. Approaches utilizing tensor decompositions for data compression have already been proposed. Here, data on a structured grid is…

Numerical Analysis · Mathematics 2024-09-23 Prashant Rai , Hemanth Kolla , Lewis Cannada , Alex Gorodetsky

This paper presents a tensor-recovery method to solve probabilistic power flow problems. Our approach generates a high-dimensional and sparse generalized polynomial-chaos expansion that provides useful statistical information. The result…

Computational Engineering, Finance, and Science · Computer Science 2015-08-12 Zheng Zhang , Hung Dinh Nguyen , Konstantin Turitsyn , Luca Daniel

The Tree-Particle-Mesh (TPM) N-body algorithm couples the tree algorithm for directly computing forces on particles in an hierarchical grouping scheme with the extremely efficient mesh based PM structured approach. The combined TPM…

Astrophysics · Physics 2009-10-31 Paul Bode , Jeremiah P. Ostriker , Guohong Xu

The tensor train decomposition decomposes a tensor into a "train" of 3-way tensors that are interconnected through the summation of auxiliary indices. The decomposition is stable, has a well-defined notion of rank and enables the user to…

Numerical Analysis · Computer Science 2018-11-12 Kim Batselier

In data processing and machine learning, an important challenge is to recover and exploit models that can represent accurately the data. We consider the problem of recovering Gaussian mixture models from datasets. We investigate symmetric…

Algebraic Geometry · Mathematics 2022-06-22 Rima Khouja , Pierre-Alexandre Mattei , Bernard Mourrain

We consider convex optimization problems with the objective function having Lipshitz-continuous $p$-th order derivative, where $p\geq 1$. We propose a new tensor method, which closes the gap between the lower…

Canonical Polyadic (or CANDECOMP/PARAFAC, CP) decompositions (CPD) are widely applied to analyze high order tensors. Existing CPD methods use alternating least square (ALS) iterations and hence need to unfold tensors to each of the $N$…

Numerical Analysis · Computer Science 2013-06-27 Guoxu Zhou , Andrzej Cichocki , Shengli Xie

Tensor train decomposition is widely used in machine learning and quantum physics due to its concise representation of high-dimensional tensors, overcoming the curse of dimensionality. Cross approximation-originally developed for…

Machine Learning · Computer Science 2023-06-27 Zhen Qin , Alexander Lidiak , Zhexuan Gong , Gongguo Tang , Michael B. Wakin , Zhihui Zhu

We show how to develop sampling-based alternating least squares (ALS) algorithms for decomposition of tensors into any tensor network (TN) format. Provided the TN format satisfies certain mild assumptions, resulting algorithms will have…

Numerical Analysis · Mathematics 2022-10-11 Osman Asif Malik , Vivek Bharadwaj , Riley Murray

We consider the problem of learning mixtures of generalized linear models (GLM) which arise in classification and regression problems. Typical learning approaches such as expectation maximization (EM) or variational Bayes can get stuck in…

Machine Learning · Computer Science 2016-01-14 Hanie Sedghi , Majid Janzamin , Anima Anandkumar

Tensor train decomposition is a powerful tool for dealing with high-dimensional, large-scale tensor data, which is not suffering from the curse of dimensionality. To accelerate the calculation of the auxiliary unfolding matrix, some…

Numerical Analysis · Mathematics 2023-08-08 Gaohang Yu , Jinhong Feng , Zhongming Chen , Xiaohao Cai , Liqun Qi

The alternating least squares algorithm for CP and Tucker decomposition is dominated in cost by the tensor contractions necessary to set up the quadratic optimization subproblems. We introduce a novel family of algorithms that uses…

Numerical Analysis · Mathematics 2021-04-15 Linjian Ma , Edgar Solomonik

Tensors decompositions are a class of tools for analysing datasets of high dimensionality and variety in a natural manner, with the Canonical Polyadic Decomposition (CPD) being a main pillar. While the notion of CPD is closely intertwined…

Signal Processing · Electrical Eng. & Systems 2019-11-15 Giuseppe G. Calvi , Bruno Scalzo Dees , Danilo P. Mandic