English
Related papers

Related papers: Tensor Ring Decomposition: Optimization Landscape …

200 papers

Often, large, high dimensional datasets collected across multiple modalities can be organized as a higher order tensor. Low-rank tensor decomposition then arises as a powerful and widely used tool to discover simple low dimensional…

Machine Learning · Statistics 2020-01-29 Jonathan Kadmon , Surya Ganguli

Due to the explosive growth of large-scale data sets, tensors have been a vital tool to analyze and process high-dimensional data. Different from the matrix case, tensor decomposition has been defined in various formats, which can be…

Optimization and Control · Mathematics 2023-12-27 Rachel Grotheer , Shuang Li , Anna Ma , Deanna Needell , Jing Qin

The low multilinear rank approximation, also known as the truncated Tucker decomposition, has been extensively utilized in many applications that involve higher-order tensors. Popular methods for low multilinear rank approximation usually…

Numerical Analysis · Mathematics 2021-04-05 Chuanfu Xiao , Chao Yang , Min Li

Low rank tensor ring model is powerful for image completion which recovers missing entries in data acquisition and transformation. The recently proposed tensor ring (TR) based completion algorithms generally solve the low rank optimization…

Machine Learning · Statistics 2021-04-07 Zhen Long , Ce Zhu , Jiani Liu , Yipeng Liu

The alternating least squares (ALS/AltLS) method is a widely used algorithm for computing the CP decomposition of a tensor. However, its convergence theory is still incompletely understood. In this paper, we prove explicit quantitative…

Numerical Analysis · Mathematics 2025-05-21 Nicholas Hu , Mark A. Iwen , Deanna Needell , Rongrong Wang

Tensors decompositions are a class of tools for analysing datasets of high dimensionality and variety in a natural manner, with the Canonical Polyadic Decomposition (CPD) being a main pillar. While the notion of CPD is closely intertwined…

Signal Processing · Electrical Eng. & Systems 2019-11-15 Giuseppe G. Calvi , Bruno Scalzo Dees , Danilo P. Mandic

In the realm of tensor optimization, the low-rank Tucker decomposition is crucial for reducing the number of parameters and for saving storage. We explore the geometry of Tucker tensor varieties -- the set of tensors with bounded Tucker…

Optimization and Control · Mathematics 2024-07-16 Bin Gao , Renfeng Peng , Ya-xiang Yuan

Differential geometries derived from tensor decompositions have been extensively studied and provided the foundations for a variety of efficient numerical methods. Despite the practical success of the tensor ring (TR) decomposition, its…

Numerical Analysis · Mathematics 2026-01-30 Bin Gao , Renfeng Peng , Ya-xiang Yuan

Tensor network contraction is central to problems ranging from many-body physics to computer science. We describe how to approximate tensor network contraction through bond compression on arbitrary graphs. In particular, we introduce a…

Quantum Physics · Physics 2024-01-30 Johnnie Gray , Garnet Kin-Lic Chan

In this paper we propose an efficient method to compress a high dimensional function into a tensor ring format, based on alternating least-squares (ALS). Since the function has size exponential in $d$ where $d$ is the number of dimensions,…

Numerical Analysis · Mathematics 2019-06-28 Yuehaw Khoo , Jianfeng Lu , Lexing Ying

Quantum computing and modern tensor-based computing have a strong connection, which is especially demonstrated by simulating quantum computations with tensor networks. The other direction is less studied: quantum computing is not often…

Quantum Physics · Physics 2025-09-03 Valter Uotila

In this paper we study bipartite quantum correlations using techniques from tracial noncommutative polynomial optimization. We construct a hierarchy of semidefinite programming lower bounds on the minimal entanglement dimension of a…

Optimization and Control · Mathematics 2018-01-10 Sander Gribling , David de Laat , Monique Laurent

Tensor train (TT) decomposition is a powerful representation for high-order tensors, which has been successfully applied to various machine learning tasks in recent years. However, since the tensor product is not commutative, permutation of…

Numerical Analysis · Computer Science 2017-05-31 Qibin Zhao , Masashi Sugiyama , Andrzej Cichocki

Tensor Train~(TT) decomposition is widely used in the machine learning and quantum physics communities as a popular tool to efficiently compress high-dimensional tensor data. In this paper, we propose an efficient algorithm to accelerate…

Data Structures and Algorithms · Computer Science 2024-06-07 Vivek Bharadwaj , Beheshteh T. Rakhshan , Osman Asif Malik , Guillaume Rabusseau

Tensor Networks (TN) offer a powerful framework to efficiently represent very high-dimensional objects. TN have recently shown their potential for machine learning applications and offer a unifying view of common tensor decomposition models…

Machine Learning · Computer Science 2021-06-24 Meraj Hashemizadeh , Michelle Liu , Jacob Miller , Guillaume Rabusseau

This paper introduces a randomized variation of the alternating least squares (ALS) algorithm for rank reduction of canonical tensor formats. The aim is to address the potential numerical ill-conditioning of least squares matrices at each…

Numerical Analysis · Mathematics 2015-10-07 Matthew Reynolds , Alireza Doostan , Gregory Beylkin

Canonical Polyadic (CP) tensor decomposition is a fundamental technique for analyzing high-dimensional tensor data. While the Alternating Least Squares (ALS) algorithm is widely used for computing CP decomposition due to its simplicity and…

Methodology · Statistics 2025-05-30 Runshi Tang , Julien Chhor , Olga Klopp , Anru R. Zhang

We consider the computation of the entanglement-assisted quantum rate-distortion function, which plays a central role in quantum information theory. We propose an efficient alternating minimization algorithm based on the Lagrangian…

Information Theory · Computer Science 2025-07-29 Lingyi Chen , Deheng Yuan , Wenyi Zhang , Hao Wu , Huihui Wu

Tensor completion estimates missing components by exploiting the low-rank structure of multi-way data. The recently proposed methods based on tensor train (TT) and tensor ring (TR) show better performance in image recovery than classical…

Machine Learning · Computer Science 2020-04-24 Huyan Huang , Yipeng Liu , Ce Zhu

We consider the problem of sparse coding, where each sample consists of a sparse linear combination of a set of dictionary atoms, and the task is to learn both the dictionary elements and the mixing coefficients. Alternating minimization is…

Machine Learning · Computer Science 2014-07-30 Alekh Agarwal , Animashree Anandkumar , Prateek Jain , Praneeth Netrapalli